2024-01-19T05:04:31.643 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T05:04:31.643 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057 --description fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} --owner scheduled_yuriw@teuthology --name yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/orig.config.yaml 2024-01-19T05:04:31.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:04:31.765 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057 branch: wip-yuri8-testing-2024-01-18-0823 description: fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} email: yweinste@redhat.com first_in_suite: false job_id: '7521057' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri8-testing-2024-01-18-0823 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 0edf41a622739843d6b978b179ff3227b476dd9d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0edf41a622739843d6b978b179ff3227b476dd9d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2024-01-18-0823 sha1: 0edf41a622739843d6b978b179ff3227b476dd9d owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 6631 sha1: 0edf41a622739843d6b978b179ff3227b476dd9d sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri8-testing-2024-01-18-0823 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0edf41a622739843d6b978b179ff3227b476dd9d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfiVunQDKfNx9LTfRCAwSrrm0/hhiCKt9BVOdnWdCr+m3+AQmo7Qfa4JdQ/a9ztO0tgJNRmDGbgYir37pDdL6c= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfUEUddYhwqVdeto7MfqW7MZKsicO6ghR9JkflmRp7mkJV8r3Tf9pxoUhFdbWyrPG3i7g65u+ME2L/1VUFxKM4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_cephfs_shell teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-18_21:19:14 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-19T05:04:31.765 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa; will attempt to use it 2024-01-19T05:04:31.766 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks 2024-01-19T05:04:31.766 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-19T05:04:31.768 INFO:teuthology.task.internal:Checking packages... 2024-01-19T05:04:31.792 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0edf41a622739843d6b978b179ff3227b476dd9d' 2024-01-19T05:04:31.792 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-19T05:04:31.792 INFO:teuthology.packaging:ref: None 2024-01-19T05:04:31.792 INFO:teuthology.packaging:tag: None 2024-01-19T05:04:31.792 INFO:teuthology.packaging:branch: wip-yuri8-testing-2024-01-18-0823 2024-01-19T05:04:31.792 INFO:teuthology.packaging:sha1: 0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T05:04:31.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri8-testing-2024-01-18-0823 2024-01-19T05:04:31.936 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:04:31.937 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-19T05:04:31.949 INFO:teuthology.task.internal:no buildpackages task found 2024-01-19T05:04:31.949 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-19T05:04:31.957 INFO:teuthology.task.internal:Saving configuration 2024-01-19T05:04:31.972 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-19T05:04:31.981 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T05:04:32.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:58:04.825793', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEWFPgmWOAUznPdy05GTGCRXlFgppJMKrjgbcBJ7d5uV'} 2024-01-19T05:04:32.028 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:58:04.827183', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICbtYXNJbkqW7+1gHL+UctIRwsPATqjaYuSSS18Uvz92'} 2024-01-19T05:04:32.028 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-19T05:04:32.037 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-19T05:04:32.037 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-19T05:04:32.037 INFO:teuthology.run_tasks:Running task console_log... 2024-01-19T05:04:32.103 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1ad538e310>, signals=[15]) 2024-01-19T05:04:32.104 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-19T05:04:32.111 INFO:teuthology.task.internal:Opening connections... 2024-01-19T05:04:32.111 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:04:32.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:04:32.194 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:04:32.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:04:32.270 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-19T05:04:32.277 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-01-19T05:04:32.283 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-01-19T05:04:32.283 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-19T05:04:32.329 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-19T05:04:32.330 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-19T05:04:32.330 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2024-01-19T05:04:32.330 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-01-19T05:04:32.356 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-01-19T05:04:32.361 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-01-19T05:04:32.361 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-01-19T05:04:32.412 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-19T05:04:32.412 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-01-19T05:04:32.412 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2024-01-19T05:04:32.412 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-19T05:04:32.413 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2024-01-19T05:04:32.413 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-01-19T05:04:32.413 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-01-19T05:04:32.413 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-19T05:04:32.413 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-19T05:04:32.413 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-19T05:04:32.413 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-19T05:04:32.413 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2024-01-19T05:04:32.413 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-01-19T05:04:32.439 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-19T05:04:32.449 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-19T05:04:32.457 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-19T05:04:32.457 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-01-19T05:04:32.460 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-01-19T05:04:32.464 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-19T05:04:32.472 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-19T05:04:32.472 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-01-19T05:04:32.506 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-01-19T05:04:32.514 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-19T05:04:32.570 INFO:teuthology.run_tasks:Running task kernel... 2024-01-19T05:04:32.586 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-19T05:04:32.586 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-19T05:04:32.586 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-19T05:04:32.587 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-19T05:04:32.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:04:32.591 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-01-19T05:04:32.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:04:32.592 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-01-19T05:04:32.637 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-56-generic 2024-01-19T05:04:32.637 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.15.0-56-generic 2024-01-19T05:04:32.637 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-01-19T05:04:32.640 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-56-generic 2024-01-19T05:04:32.641 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.15.0-56-generic 2024-01-19T05:04:32.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-01-19T05:04:32.755 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-01-19T05:04:32.777 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-01-19T05:04:32.891 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T05:04:32.896 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-01-19T05:04:32.896 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-01-19T05:04:32.932 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T05:04:32.932 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-01-19T05:04:32.933 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-01-19T05:04:32.979 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-01-19T05:04:33.020 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-01-19T05:04:33.121 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [386 kB] 2024-01-19T05:04:33.175 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [386 kB] 2024-01-19T05:04:33.197 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,065 kB] 2024-01-19T05:04:33.199 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,282 kB] 2024-01-19T05:04:33.234 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [201 kB] 2024-01-19T05:04:33.240 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-01-19T05:04:33.241 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.8 kB] 2024-01-19T05:04:33.241 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,248 kB] 2024-01-19T05:04:33.245 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,282 kB] 2024-01-19T05:04:33.252 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,065 kB] 2024-01-19T05:04:33.259 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [204 kB] 2024-01-19T05:04:33.263 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-01-19T05:04:33.263 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [585 kB] 2024-01-19T05:04:33.273 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [831 kB] 2024-01-19T05:04:33.284 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [158 kB] 2024-01-19T05:04:33.286 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-01-19T05:04:33.296 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [201 kB] 2024-01-19T05:04:33.300 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-01-19T05:04:33.301 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-01-19T05:04:33.301 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-01-19T05:04:33.307 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [552 kB] 2024-01-19T05:04:33.308 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-01-19T05:04:33.311 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-01-19T05:04:33.312 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,248 kB] 2024-01-19T05:04:33.323 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [262 kB] 2024-01-19T05:04:33.329 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-01-19T05:04:33.329 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [33.2 kB] 2024-01-19T05:04:33.330 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,276 kB] 2024-01-19T05:04:33.344 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.8 kB] 2024-01-19T05:04:33.345 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [204 kB] 2024-01-19T05:04:33.350 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-01-19T05:04:33.350 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [831 kB] 2024-01-19T05:04:33.361 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [208 kB] 2024-01-19T05:04:33.363 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [585 kB] 2024-01-19T05:04:33.366 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-01-19T05:04:33.366 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,032 kB] 2024-01-19T05:04:33.375 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [158 kB] 2024-01-19T05:04:33.379 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-01-19T05:04:33.385 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [681 kB] 2024-01-19T05:04:33.392 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [231 kB] 2024-01-19T05:04:33.395 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-01-19T05:04:33.395 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-01-19T05:04:33.396 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,164 B] 2024-01-19T05:04:33.396 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-01-19T05:04:33.410 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-01-19T05:04:33.410 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [552 kB] 2024-01-19T05:04:33.411 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-01-19T05:04:33.411 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-01-19T05:04:33.411 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-01-19T05:04:33.413 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-01-19T05:04:33.413 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-01-19T05:04:33.413 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-01-19T05:04:33.414 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-01-19T05:04:33.420 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [262 kB] 2024-01-19T05:04:33.425 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-01-19T05:04:33.425 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,276 kB] 2024-01-19T05:04:33.432 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-01-19T05:04:33.432 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-01-19T05:04:33.433 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.2 kB] 2024-01-19T05:04:33.433 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-01-19T05:04:33.433 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-01-19T05:04:33.447 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [33.2 kB] 2024-01-19T05:04:33.448 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [208 kB] 2024-01-19T05:04:33.452 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-01-19T05:04:33.452 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,032 kB] 2024-01-19T05:04:33.467 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [681 kB] 2024-01-19T05:04:33.474 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [231 kB] 2024-01-19T05:04:33.477 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-01-19T05:04:33.477 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,164 B] 2024-01-19T05:04:33.478 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-01-19T05:04:33.488 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-01-19T05:04:33.488 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-01-19T05:04:33.488 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-01-19T05:04:33.489 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-01-19T05:04:33.500 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-01-19T05:04:33.501 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-01-19T05:04:33.501 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-01-19T05:04:33.501 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.2 kB] 2024-01-19T05:04:33.501 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-01-19T05:04:33.508 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-01-19T05:04:38.552 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 10.9 MB in 2s (7,032 kB/s) 2024-01-19T05:04:38.643 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 10.9 MB in 2s (6,879 kB/s) 2024-01-19T05:04:39.939 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-01-19T05:04:39.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-19T05:04:39.994 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-01-19T05:04:40.010 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-19T05:04:40.021 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-01-19T05:04:40.070 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-01-19T05:04:40.214 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-01-19T05:04:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-01-19T05:04:40.260 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-01-19T05:04:40.261 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-01-19T05:04:40.378 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T05:04:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T05:04:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T05:04:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T05:04:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-19T05:04:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: python2.7-minimal 2024-01-19T05:04:40.379 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T05:04:40.380 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-01-19T05:04:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-19T05:04:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2024-01-19T05:04:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2024-01-19T05:04:40.382 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-01-19T05:04:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-01-19T05:04:40.382 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-01-19T05:04:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: thermald 2024-01-19T05:04:40.418 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T05:04:40.418 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T05:04:40.418 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T05:04:40.419 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T05:04:40.419 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-19T05:04:40.419 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-01-19T05:04:40.419 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T05:04:40.420 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-01-19T05:04:40.420 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-19T05:04:40.420 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2024-01-19T05:04:40.421 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2024-01-19T05:04:40.422 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-01-19T05:04:40.422 INFO:teuthology.orchestra.run.smithi157.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-01-19T05:04:40.422 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-01-19T05:04:40.422 INFO:teuthology.orchestra.run.smithi157.stdout: thermald 2024-01-19T05:04:40.428 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-01-19T05:04:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-19T05:04:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2024-01-19T05:04:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.15.0-91-generic 2024-01-19T05:04:40.429 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-01-19T05:04:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-generic linux-image-generic 2024-01-19T05:04:40.459 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-01-19T05:04:40.460 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-19T05:04:40.460 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2024-01-19T05:04:40.460 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-extra-5.15.0-91-generic 2024-01-19T05:04:40.461 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-01-19T05:04:40.461 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-generic linux-image-generic 2024-01-19T05:04:40.514 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2024-01-19T05:04:40.515 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 113 MB of archives. 2024-01-19T05:04:40.515 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 582 MB of additional disk space will be used. 2024-01-19T05:04:40.515 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2024-01-19T05:04:40.557 INFO:teuthology.orchestra.run.smithi157.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2024-01-19T05:04:40.558 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 113 MB of archives. 2024-01-19T05:04:40.558 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 582 MB of additional disk space will be used. 2024-01-19T05:04:40.558 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2024-01-19T05:04:41.748 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2024-01-19T05:04:41.908 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2024-01-19T05:04:42.121 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2024-01-19T05:04:42.238 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2024-01-19T05:04:44.246 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2024-01-19T05:04:44.247 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2024-01-19T05:04:44.247 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2024-01-19T05:04:44.558 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2024-01-19T05:04:44.558 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2024-01-19T05:04:44.558 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2024-01-19T05:04:44.679 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2024-01-19T05:04:44.769 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2024-01-19T05:04:44.975 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2024-01-19T05:04:45.031 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2024-01-19T05:04:45.180 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 113 MB in 4s (26.3 MB/s) 2024-01-19T05:04:45.348 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2024-01-19T05:04:45.410 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2024-01-19T05:04:45.593 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2024-01-19T05:04:47.370 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-01-19T05:04:47.374 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T05:04:47.603 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:04:47.612 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-01-19T05:04:47.617 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T05:04:47.681 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:04:49.739 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2024-01-19T05:04:49.760 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T05:04:49.851 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:04:50.105 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2024-01-19T05:04:50.127 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T05:04:50.210 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:04:50.275 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2024-01-19T05:04:50.296 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T05:04:50.334 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:04:50.666 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2024-01-19T05:04:50.687 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T05:04:50.724 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:04:56.488 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T05:04:56.591 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T05:04:56.889 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T05:04:57.011 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T05:04:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T05:04:57.194 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T05:04:57.305 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2024-01-19T05:04:57.327 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2024-01-19T05:04:57.372 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-19T05:04:57.509 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T05:04:57.631 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T05:04:57.942 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2024-01-19T05:04:57.964 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2024-01-19T05:04:58.008 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-19T05:05:03.049 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2024-01-19T05:05:03.085 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T05:05:03.123 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:04.055 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2024-01-19T05:05:04.091 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-19T05:05:04.130 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:05.635 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T05:05:05.758 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T05:05:06.149 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-19T05:05:06.279 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:06.405 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2024-01-19T05:05:06.534 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:06.739 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2024-01-19T05:05:06.865 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-19T05:05:07.273 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-19T05:05:07.411 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:07.536 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2024-01-19T05:05:07.674 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:07.859 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-01-19T05:05:07.860 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-01-19T05:05:07.860 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2024-01-19T05:05:07.860 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2024-01-19T05:05:08.035 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:09.029 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-01-19T05:05:09.029 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-01-19T05:05:09.029 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2024-01-19T05:05:09.029 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2024-01-19T05:05:09.192 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:09.452 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2024-01-19T05:05:09.587 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:10.593 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2024-01-19T05:05:10.736 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:10.997 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-generic (5.15.0.91.88) ... 2024-01-19T05:05:11.115 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:11.172 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-01-19T05:05:11.172 INFO:teuthology.orchestra.run.smithi099.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2024-01-19T05:05:12.121 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-generic (5.15.0.91.88) ... 2024-01-19T05:05:12.263 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-19T05:05:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-01-19T05:05:12.329 INFO:teuthology.orchestra.run.smithi157.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2024-01-19T05:05:24.994 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-01-19T05:05:24.995 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub' 2024-01-19T05:05:25.007 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T05:05:25.024 INFO:teuthology.orchestra.run.smithi099.stdout:Generating grub configuration file ... 2024-01-19T05:05:25.289 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-19T05:05:25.308 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-19T05:05:25.597 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T05:05:25.602 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T05:05:25.673 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T05:05:25.679 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T05:05:25.840 INFO:teuthology.orchestra.run.smithi099.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T05:05:25.840 INFO:teuthology.orchestra.run.smithi099.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T05:05:25.840 INFO:teuthology.orchestra.run.smithi099.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T05:05:25.876 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-01-19T05:05:26.272 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-01-19T05:05:26.272 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub' 2024-01-19T05:05:26.286 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T05:05:26.306 INFO:teuthology.orchestra.run.smithi157.stdout:Generating grub configuration file ... 2024-01-19T05:05:26.347 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-01-19T05:05:26.367 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 20 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.91.88 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-01-19T05:05:26.368 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-01-19T05:05:26.369 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-01-19T05:05:26.369 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2024-01-19T05:05:26.369 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-19T05:05:26.369 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-19T05:05:26.369 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-19T05:05:26.369 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-01-19T05:05:26.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-01-19T05:05:26.530 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-01-19T05:05:26.641 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-19T05:05:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T05:05:26.666 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-19T05:05:26.667 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T05:05:26.687 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T05:05:26.770 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T05:05:26.969 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T05:05:26.975 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T05:05:27.051 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T05:05:27.057 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T05:05:27.227 INFO:teuthology.orchestra.run.smithi157.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T05:05:27.227 INFO:teuthology.orchestra.run.smithi157.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T05:05:27.227 INFO:teuthology.orchestra.run.smithi157.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T05:05:27.264 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-01-19T05:05:27.712 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 20 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.91.88 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-01-19T05:05:27.731 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-01-19T05:05:27.732 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-01-19T05:05:27.732 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-01-19T05:05:27.732 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2024-01-19T05:05:27.732 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-19T05:05:27.732 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-19T05:05:27.732 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-01-19T05:05:27.732 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-01-19T05:05:27.732 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-01-19T05:05:27.898 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-01-19T05:05:27.959 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-01-19T05:05:27.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-19T05:05:28.037 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-01-19T05:05:28.152 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T05:05:28.152 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T05:05:28.224 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T05:05:28.228 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-01-19T05:05:28.228 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-01-19T05:05:28.306 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T05:05:28.396 INFO:teuthology.orchestra.run.smithi099.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2024-01-19T05:05:28.396 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T05:05:28.396 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T05:05:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T05:05:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T05:05:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T05:05:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T05:05:28.397 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T05:05:28.439 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2024-01-19T05:05:28.441 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-01-19T05:05:28.453 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-01-19T05:05:28.453 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-01-19T05:05:28.453 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-01-19T05:05:28.453 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-01-19T05:05:28.453 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 20 2024-01-19T05:05:28.453 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-01-19T05:05:28.453 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-01-19T05:05:28.454 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-01-19T05:05:28.454 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.91.88 2024-01-19T05:05:28.454 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-19T05:05:28.454 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-19T05:05:28.454 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-01-19T05:05:28.454 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-01-19T05:05:28.454 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-01-19T05:05:28.454 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-01-19T05:05:28.454 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-01-19T05:05:28.500 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.tcttMdBviI 2024-01-19T05:05:28.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tcttMdBviI 2024-01-19T05:05:28.556 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.tcttMdBviI 2024-01-19T05:05:28.673 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.tcttMdBviI is 10KB 2024-01-19T05:05:28.686 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.tcttMdBviI 2024-01-19T05:05:28.692 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-01-19T05:05:28.747 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:05:28.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-01-19T05:05:28.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-01-19T05:05:28.810 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2024-01-19T05:05:28.810 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-grub 2024-01-19T05:05:29.462 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-01-19T05:05:29.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-19T05:05:29.531 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-01-19T05:05:29.699 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-01-19T05:05:29.700 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-01-19T05:05:29.846 INFO:teuthology.orchestra.run.smithi157.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2024-01-19T05:05:29.846 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T05:05:29.846 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T05:05:29.846 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T05:05:29.846 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T05:05:29.846 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T05:05:29.847 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T05:05:29.847 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T05:05:29.883 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2024-01-19T05:05:29.885 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-01-19T05:05:29.902 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub' 2024-01-19T05:05:29.903 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T05:05:29.905 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-01-19T05:05:29.942 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-01-19T05:05:29.942 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 20 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.91.88 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-01-19T05:05:29.943 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-01-19T05:05:29.944 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-01-19T05:05:29.988 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.jceiw25paK 2024-01-19T05:05:29.988 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jceiw25paK 2024-01-19T05:05:30.058 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.jceiw25paK 2024-01-19T05:05:30.074 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-19T05:05:30.079 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-19T05:05:30.178 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.jceiw25paK is 10KB 2024-01-19T05:05:30.193 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.jceiw25paK 2024-01-19T05:05:30.199 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-01-19T05:05:30.252 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:05:30.252 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-01-19T05:05:30.252 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-01-19T05:05:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T05:05:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T05:05:30.318 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2024-01-19T05:05:30.318 DEBUG:teuthology.orchestra.run.smithi157:> sudo update-grub 2024-01-19T05:05:30.346 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T05:05:30.351 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T05:05:30.463 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T05:05:30.464 INFO:teuthology.orchestra.run.smithi099.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T05:05:30.464 INFO:teuthology.orchestra.run.smithi099.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T05:05:30.483 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-01-19T05:05:30.492 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-01-19T05:05:31.500 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2024-01-19T05:05:31.501 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-19T05:05:31.504 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-01-19T05:05:31.686 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-19T05:05:31.691 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-19T05:05:31.930 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-19T05:05:31.935 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-19T05:05:31.977 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-19T05:05:31.982 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-19T05:05:32.103 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-19T05:05:32.103 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-19T05:05:32.103 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-19T05:05:32.128 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-01-19T05:05:32.137 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-01-19T05:06:00.523 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-19T05:06:00.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-19T05:06:00.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:06:02.141 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-19T05:06:02.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-19T05:06:02.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:06:19.068 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-19T05:06:20.604 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-19T05:06:28.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-19T05:06:28.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:06:29.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-19T05:06:29.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:06:31.132 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-19T05:06:32.668 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-19T05:06:43.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-19T05:06:43.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:06:44.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-19T05:06:44.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:06:46.204 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-19T05:06:47.744 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-19T05:07:01.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-19T05:07:01.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:07:02.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-19T05:07:02.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:07:04.288 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-19T05:07:21.276 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-01-19T05:07:22.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-19T05:07:22.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:07:22.638 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-01-19T05:07:23.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-19T05:07:23.124 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-91-generic"... 2024-01-19T05:07:23.124 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-01-19T05:07:23.170 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-91-generic 2024-01-19T05:07:23.170 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2024-01-19T05:07:23.170 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-19T05:07:23.171 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-19T05:07:24.171 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-19T05:07:24.171 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-19T05:07:24.243 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-01-19T05:07:24.280 DEBUG:teuthology.parallel:result is None 2024-01-19T05:07:39.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-19T05:07:39.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:07:39.575 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-01-19T05:07:40.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-19T05:07:40.331 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-91-generic"... 2024-01-19T05:07:40.332 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-01-19T05:07:40.379 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-91-generic 2024-01-19T05:07:40.379 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2024-01-19T05:07:40.379 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-19T05:07:40.379 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-19T05:07:41.380 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-19T05:07:41.381 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-19T05:07:41.468 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-01-19T05:07:41.493 DEBUG:teuthology.parallel:result is None 2024-01-19T05:07:41.493 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-19T05:07:41.501 INFO:teuthology.task.internal:Creating test directory... 2024-01-19T05:07:41.501 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-19T05:07:41.504 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-19T05:07:41.509 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-19T05:07:41.515 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-19T05:07:41.522 INFO:teuthology.task.internal:Creating archive directory... 2024-01-19T05:07:41.522 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-19T05:07:41.551 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-19T05:07:41.645 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-19T05:07:41.652 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-19T05:07:41.653 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-19T05:07:41.655 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-19T05:07:41.670 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T05:07:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T05:07:41.680 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T05:07:41.689 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-19T05:07:41.690 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-19T05:07:41.697 INFO:teuthology.task.internal:Configuring sudo... 2024-01-19T05:07:41.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-19T05:07:41.723 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-19T05:07:41.745 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-19T05:07:41.754 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-19T05:07:41.754 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-19T05:07:41.780 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-19T05:07:41.792 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-19T05:07:41.830 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-19T05:07:41.878 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:07:41.878 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-19T05:07:41.945 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-19T05:07:41.951 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-19T05:07:42.000 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:07:42.000 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-19T05:07:42.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-01-19T05:07:42.071 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-01-19T05:07:42.147 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-19T05:07:42.155 INFO:teuthology.task.internal:Starting timer... 2024-01-19T05:07:42.155 INFO:teuthology.run_tasks:Running task pcp... 2024-01-19T05:07:42.165 INFO:teuthology.run_tasks:Running task selinux... 2024-01-19T05:07:42.173 DEBUG:teuthology.task.selinux:Excluding smithi099: OS 'ubuntu' does not support SELinux 2024-01-19T05:07:42.173 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-01-19T05:07:42.173 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-19T05:07:42.173 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-19T05:07:42.173 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-19T05:07:42.173 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-19T05:07:42.181 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-19T05:07:42.200 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-19T05:07:42.201 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-19T05:14:25.305 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-01-19T05:14:25.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-19T05:14:25.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:14:25.391 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-01-19T05:14:25.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-19T05:14:25.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-19T05:14:25.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T05:14:25.547 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-01-19T05:14:25.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-01-19T05:14:25.625 INFO:teuthology.run_tasks:Running task clock... 2024-01-19T05:14:25.635 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-19T05:14:25.635 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-19T05:14:25.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T05:14:25.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-19T05:14:25.638 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T05:14:25.664 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-19T05:14:25.664 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Command line: ntpd -gq 2024-01-19T05:14:25.664 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: ---------------------------------------------------- 2024-01-19T05:14:25.664 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: ntp-4 is maintained by Network Time Foundation, 2024-01-19T05:14:25.664 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-19T05:14:25.664 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: corporation. Support and training for ntp-4 are 2024-01-19T05:14:25.665 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: available at https://www.nwtime.org/support 2024-01-19T05:14:25.665 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: ---------------------------------------------------- 2024-01-19T05:14:25.665 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: proto: precision = 0.060 usec (-24) 2024-01-19T05:14:25.665 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: basedate set to 2022-02-04 2024-01-19T05:14:25.665 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: gps base set to 2022-02-06 (week 2196) 2024-01-19T05:14:25.666 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T05:14:25.666 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: restrict ::: KOD does nothing without LIMITED. 2024-01-19T05:14:25.666 INFO:teuthology.orchestra.run.smithi099.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T05:14:25.666 INFO:teuthology.orchestra.run.smithi099.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-19T05:14:25.667 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Listen and drop on 0 v6wildcard [::]:123 2024-01-19T05:14:25.667 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-19T05:14:25.667 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Listen normally on 2 lo 127.0.0.1:123 2024-01-19T05:14:25.667 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Listen normally on 3 enp3s0f1 172.21.15.99:123 2024-01-19T05:14:25.667 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Listen normally on 4 lo [::1]:123 2024-01-19T05:14:25.667 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d803%5]:123 2024-01-19T05:14:25.667 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:25 ntpd[16835]: Listening on routing socket on fd #22 for interface updates 2024-01-19T05:14:25.694 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-19T05:14:25.694 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Command line: ntpd -gq 2024-01-19T05:14:25.694 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: ---------------------------------------------------- 2024-01-19T05:14:25.694 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: ntp-4 is maintained by Network Time Foundation, 2024-01-19T05:14:25.695 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-19T05:14:25.695 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: corporation. Support and training for ntp-4 are 2024-01-19T05:14:25.695 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: available at https://www.nwtime.org/support 2024-01-19T05:14:25.695 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: ---------------------------------------------------- 2024-01-19T05:14:25.695 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: proto: precision = 0.057 usec (-24) 2024-01-19T05:14:25.696 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: basedate set to 2022-02-04 2024-01-19T05:14:25.696 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: gps base set to 2022-02-06 (week 2196) 2024-01-19T05:14:25.696 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T05:14:25.696 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-19T05:14:25.696 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: restrict ::: KOD does nothing without LIMITED. 2024-01-19T05:14:25.697 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-19T05:14:25.698 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Listen and drop on 0 v6wildcard [::]:123 2024-01-19T05:14:25.698 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-19T05:14:25.698 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Listen normally on 2 lo 127.0.0.1:123 2024-01-19T05:14:25.698 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-01-19T05:14:25.698 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Listen normally on 4 lo [::1]:123 2024-01-19T05:14:25.698 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-01-19T05:14:25.698 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:25 ntpd[16822]: Listening on routing socket on fd #22 for interface updates 2024-01-19T05:14:26.665 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:26.665 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:26.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:26 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:26 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:26 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:26 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:26 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:26 ntpd[16822]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:26 ntpd[16822]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:27 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:27 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:27 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:27 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:27 ntpd[16822]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:27 ntpd[16822]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:28.665 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:28.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:28.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:28.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:28.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:28 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:28 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:28 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:28 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:28 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:28 ntpd[16822]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:28 ntpd[16822]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:29.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:29 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:29.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:29 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:29.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:29 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:29.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:29 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:29.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:29 ntpd[16822]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:29.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:29 ntpd[16822]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:30.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:30 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:30 ntpd[16822]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:31 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:31 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:31 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:31 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:31 ntpd[16822]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:31 ntpd[16822]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:32.665 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:32.667 INFO:teuthology.orchestra.run.smithi099.stdout:19 Jan 05:14:32 ntpd[16835]: ntpd: time slew -0.001011 s 2024-01-19T05:14:32.667 INFO:teuthology.orchestra.run.smithi099.stdout:ntpd: time slew -0.001011s 2024-01-19T05:14:32.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-19T05:14:32.667 INFO:teuthology.orchestra.run.smithi099.stderr:19 Jan 05:14:32 ntpd[16835]: can't open /var/log/ntpstats/loopstats.20240119: Permission denied 2024-01-19T05:14:32.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:32.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:32.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:32.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:32.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-19T05:14:32.695 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: can't open /var/log/ntpstats/rawstats.20240119: Permission denied 2024-01-19T05:14:32.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-19T05:14:32.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: can't open /var/log/ntpstats/peerstats.20240119: Permission denied 2024-01-19T05:14:32.696 INFO:teuthology.orchestra.run.smithi157.stdout:19 Jan 05:14:32 ntpd[16822]: ntpd: time slew +0.000646 s 2024-01-19T05:14:32.696 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew +0.000646s 2024-01-19T05:14:32.696 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-19T05:14:32.697 INFO:teuthology.orchestra.run.smithi157.stderr:19 Jan 05:14:32 ntpd[16822]: can't open /var/log/ntpstats/loopstats.20240119: Permission denied 2024-01-19T05:14:32.747 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T05:14:32.747 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-01-19T05:14:32.747 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:14:32.747 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:14:32.747 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:14:32.747 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:14:32.795 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T05:14:32.795 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-01-19T05:14:32.795 INFO:teuthology.orchestra.run.smithi099.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:14:32.795 INFO:teuthology.orchestra.run.smithi099.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:14:32.795 INFO:teuthology.orchestra.run.smithi099.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:14:32.795 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:14:32.796 INFO:teuthology.run_tasks:Running task install... 2024-01-19T05:14:32.804 DEBUG:teuthology.task.install:project ceph 2024-01-19T05:14:32.804 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}} 2024-01-19T05:14:32.804 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'} 2024-01-19T05:14:32.804 INFO:teuthology.task.install:Using flavor: default 2024-01-19T05:14:32.811 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-19T05:14:32.811 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-19T05:14:32.811 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-key list | grep Ceph 2024-01-19T05:14:32.812 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2024-01-19T05:14:32.875 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-19T05:14:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-19T05:14:32.903 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-19T05:14:32.904 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2024-01-19T05:14:32.905 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-19T05:14:32.905 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-19T05:14:32.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T05:14:32.928 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-19T05:14:32.929 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph.com (release key) 2024-01-19T05:14:32.929 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-19T05:14:32.929 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-19T05:14:32.929 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T05:14:33.056 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default/ 2024-01-19T05:14:33.056 INFO:teuthology.task.install.deb:Package version is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:14:33.095 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default/ 2024-01-19T05:14:33.096 INFO:teuthology.task.install.deb:Package version is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:14:33.270 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:14:33.270 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-19T05:14:33.285 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-01-19T05:14:33.324 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:14:33.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-19T05:14:33.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-01-19T05:14:33.454 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T05:14:33.454 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T05:14:33.469 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T05:14:33.489 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T05:14:33.511 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-19T05:14:33.524 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-19T05:14:33.543 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-19T05:14:33.627 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-19T05:14:33.628 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy InRelease 2024-01-19T05:14:33.679 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-19T05:14:33.682 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy InRelease 2024-01-19T05:14:33.728 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-19T05:14:33.732 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-19T05:14:33.777 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-01-19T05:14:33.802 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-19T05:14:33.831 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-19T05:14:33.853 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-01-19T05:14:33.912 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-19T05:14:33.917 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 28.9 kB in 0s (65.1 kB/s) 2024-01-19T05:14:34.006 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 28.9 kB in 0s (61.3 kB/s) 2024-01-19T05:14:34.795 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-01-19T05:14:34.811 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-766-g0edf41a6-1jammy cephadm=19.0.0-766-g0edf41a6-1jammy ceph-mds=19.0.0-766-g0edf41a6-1jammy ceph-mgr=19.0.0-766-g0edf41a6-1jammy ceph-common=19.0.0-766-g0edf41a6-1jammy ceph-fuse=19.0.0-766-g0edf41a6-1jammy ceph-test=19.0.0-766-g0edf41a6-1jammy ceph-volume=19.0.0-766-g0edf41a6-1jammy radosgw=19.0.0-766-g0edf41a6-1jammy python3-rados=19.0.0-766-g0edf41a6-1jammy python3-rgw=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy python3-rbd=19.0.0-766-g0edf41a6-1jammy libcephfs2=19.0.0-766-g0edf41a6-1jammy libcephfs-dev=19.0.0-766-g0edf41a6-1jammy librados2=19.0.0-766-g0edf41a6-1jammy librbd1=19.0.0-766-g0edf41a6-1jammy rbd-fuse=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy cephfs-shell=19.0.0-766-g0edf41a6-1jammy cephfs-top=19.0.0-766-g0edf41a6-1jammy cephfs-mirror=19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:14:34.864 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-01-19T05:14:34.933 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-01-19T05:14:34.948 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-766-g0edf41a6-1jammy cephadm=19.0.0-766-g0edf41a6-1jammy ceph-mds=19.0.0-766-g0edf41a6-1jammy ceph-mgr=19.0.0-766-g0edf41a6-1jammy ceph-common=19.0.0-766-g0edf41a6-1jammy ceph-fuse=19.0.0-766-g0edf41a6-1jammy ceph-test=19.0.0-766-g0edf41a6-1jammy ceph-volume=19.0.0-766-g0edf41a6-1jammy radosgw=19.0.0-766-g0edf41a6-1jammy python3-rados=19.0.0-766-g0edf41a6-1jammy python3-rgw=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy python3-rbd=19.0.0-766-g0edf41a6-1jammy libcephfs2=19.0.0-766-g0edf41a6-1jammy libcephfs-dev=19.0.0-766-g0edf41a6-1jammy librados2=19.0.0-766-g0edf41a6-1jammy librbd1=19.0.0-766-g0edf41a6-1jammy rbd-fuse=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy cephfs-shell=19.0.0-766-g0edf41a6-1jammy cephfs-top=19.0.0-766-g0edf41a6-1jammy cephfs-mirror=19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:14:34.998 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-01-19T05:14:35.031 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-01-19T05:14:35.031 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-01-19T05:14:35.171 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-01-19T05:14:35.171 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-01-19T05:14:35.186 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T05:14:35.186 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T05:14:35.186 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T05:14:35.186 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T05:14:35.187 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T05:14:35.187 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T05:14:35.187 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-19T05:14:35.189 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-19T05:14:35.190 INFO:teuthology.orchestra.run.smithi157.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-01-19T05:14:35.191 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2024-01-19T05:14:35.292 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-01-19T05:14:35.292 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-19T05:14:35.293 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-19T05:14:35.293 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-19T05:14:35.294 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-19T05:14:35.294 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T05:14:35.294 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-19T05:14:35.294 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-19T05:14:35.294 INFO:teuthology.orchestra.run.smithi157.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-19T05:14:35.294 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-19T05:14:35.295 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-19T05:14:35.296 INFO:teuthology.orchestra.run.smithi157.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-19T05:14:35.296 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-19T05:14:35.296 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-19T05:14:35.296 INFO:teuthology.orchestra.run.smithi157.stdout: socat unzip xmlstarlet zip 2024-01-19T05:14:35.324 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T05:14:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T05:14:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T05:14:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T05:14:35.324 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-19T05:14:35.326 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-19T05:14:35.327 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-19T05:14:35.328 INFO:teuthology.orchestra.run.smithi099.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-19T05:14:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-19T05:14:35.329 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-01-19T05:14:35.329 INFO:teuthology.orchestra.run.smithi099.stdout: btrfs-tools 2024-01-19T05:14:35.433 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-01-19T05:14:35.433 INFO:teuthology.orchestra.run.smithi099.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-19T05:14:35.433 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-19T05:14:35.433 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-19T05:14:35.433 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-19T05:14:35.433 INFO:teuthology.orchestra.run.smithi099.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-19T05:14:35.433 INFO:teuthology.orchestra.run.smithi099.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-19T05:14:35.433 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-19T05:14:35.434 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-19T05:14:35.435 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-19T05:14:35.435 INFO:teuthology.orchestra.run.smithi099.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-19T05:14:35.435 INFO:teuthology.orchestra.run.smithi099.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-19T05:14:35.435 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-19T05:14:35.435 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-19T05:14:35.435 INFO:teuthology.orchestra.run.smithi099.stdout: socat unzip xmlstarlet zip 2024-01-19T05:14:35.482 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 124 newly installed, 0 to remove and 266 not upgraded. 2024-01-19T05:14:35.482 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 173 MB of archives. 2024-01-19T05:14:35.482 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 719 MB of additional disk space will be used. 2024-01-19T05:14:35.482 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-19T05:14:35.497 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 124 newly installed, 0 to remove and 266 not upgraded. 2024-01-19T05:14:35.497 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 173 MB of archives. 2024-01-19T05:14:35.497 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 719 MB of additional disk space will be used. 2024-01-19T05:14:35.497 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-19T05:14:35.518 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-19T05:14:35.529 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-19T05:14:35.564 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-19T05:14:35.580 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-19T05:14:35.593 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-766-g0edf41a6-1jammy [3,516 kB] 2024-01-19T05:14:35.603 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-19T05:14:35.606 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-19T05:14:35.610 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-19T05:14:35.620 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-19T05:14:35.672 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-19T05:14:35.676 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-19T05:14:35.688 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-19T05:14:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-19T05:14:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-19T05:14:35.701 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-19T05:14:35.703 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-19T05:14:35.705 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-19T05:14:35.707 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-19T05:14:35.707 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-19T05:14:35.717 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-19T05:14:35.719 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-766-g0edf41a6-1jammy [3,516 kB] 2024-01-19T05:14:35.720 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-19T05:14:35.721 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-19T05:14:35.721 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-19T05:14:35.737 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-19T05:14:35.739 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-19T05:14:35.739 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-19T05:14:35.739 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-19T05:14:35.739 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-19T05:14:35.740 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-19T05:14:35.758 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-19T05:14:35.758 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-19T05:14:35.761 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-19T05:14:35.761 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-19T05:14:35.778 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-19T05:14:35.779 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-19T05:14:35.780 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-19T05:14:35.780 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-19T05:14:35.781 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-19T05:14:35.782 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-19T05:14:35.800 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-19T05:14:35.800 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-19T05:14:35.807 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-19T05:14:35.807 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-19T05:14:35.813 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-19T05:14:35.820 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-19T05:14:35.821 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-19T05:14:35.822 INFO:teuthology.orchestra.run.smithi099.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-19T05:14:35.824 INFO:teuthology.orchestra.run.smithi099.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-19T05:14:35.824 INFO:teuthology.orchestra.run.smithi099.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-19T05:14:35.826 INFO:teuthology.orchestra.run.smithi099.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-19T05:14:35.841 INFO:teuthology.orchestra.run.smithi099.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-19T05:14:35.843 INFO:teuthology.orchestra.run.smithi099.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-19T05:14:35.843 INFO:teuthology.orchestra.run.smithi099.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-19T05:14:35.844 INFO:teuthology.orchestra.run.smithi099.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-19T05:14:35.861 INFO:teuthology.orchestra.run.smithi099.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-19T05:14:35.908 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-19T05:14:35.919 INFO:teuthology.orchestra.run.smithi099.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-19T05:14:35.920 INFO:teuthology.orchestra.run.smithi099.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-19T05:14:35.921 INFO:teuthology.orchestra.run.smithi099.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-19T05:14:35.922 INFO:teuthology.orchestra.run.smithi099.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-19T05:14:35.922 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-19T05:14:35.923 INFO:teuthology.orchestra.run.smithi099.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-19T05:14:35.951 INFO:teuthology.orchestra.run.smithi099.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-19T05:14:35.953 INFO:teuthology.orchestra.run.smithi099.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-19T05:14:35.953 INFO:teuthology.orchestra.run.smithi099.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-19T05:14:35.973 INFO:teuthology.orchestra.run.smithi099.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-19T05:14:35.973 INFO:teuthology.orchestra.run.smithi099.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-19T05:14:35.974 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-19T05:14:35.983 INFO:teuthology.orchestra.run.smithi099.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-19T05:14:35.984 INFO:teuthology.orchestra.run.smithi099.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-19T05:14:35.985 INFO:teuthology.orchestra.run.smithi099.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-19T05:14:35.985 INFO:teuthology.orchestra.run.smithi099.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-19T05:14:35.985 INFO:teuthology.orchestra.run.smithi099.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-19T05:14:35.986 INFO:teuthology.orchestra.run.smithi099.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-19T05:14:35.989 INFO:teuthology.orchestra.run.smithi099.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-19T05:14:36.003 INFO:teuthology.orchestra.run.smithi099.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-19T05:14:36.005 INFO:teuthology.orchestra.run.smithi099.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-19T05:14:36.005 INFO:teuthology.orchestra.run.smithi099.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-19T05:14:36.024 INFO:teuthology.orchestra.run.smithi099.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-19T05:14:36.026 INFO:teuthology.orchestra.run.smithi099.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-19T05:14:36.027 INFO:teuthology.orchestra.run.smithi099.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-19T05:14:36.028 INFO:teuthology.orchestra.run.smithi099.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-19T05:14:36.028 INFO:teuthology.orchestra.run.smithi099.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-19T05:14:36.036 INFO:teuthology.orchestra.run.smithi099.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-19T05:14:36.036 INFO:teuthology.orchestra.run.smithi099.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-19T05:14:36.044 INFO:teuthology.orchestra.run.smithi099.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-19T05:14:36.044 INFO:teuthology.orchestra.run.smithi099.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-19T05:14:36.045 INFO:teuthology.orchestra.run.smithi099.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-19T05:14:36.059 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-766-g0edf41a6-1jammy [3,206 kB] 2024-01-19T05:14:36.065 INFO:teuthology.orchestra.run.smithi099.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-19T05:14:36.066 INFO:teuthology.orchestra.run.smithi099.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-19T05:14:36.067 INFO:teuthology.orchestra.run.smithi099.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-19T05:14:36.075 INFO:teuthology.orchestra.run.smithi099.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-19T05:14:36.075 INFO:teuthology.orchestra.run.smithi099.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-19T05:14:36.076 INFO:teuthology.orchestra.run.smithi099.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-19T05:14:36.079 INFO:teuthology.orchestra.run.smithi099.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-19T05:14:36.085 INFO:teuthology.orchestra.run.smithi099.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-19T05:14:36.148 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-19T05:14:36.156 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-19T05:14:36.174 INFO:teuthology.orchestra.run.smithi099.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-766-g0edf41a6-1jammy [3,206 kB] 2024-01-19T05:14:36.184 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-19T05:14:36.192 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-19T05:14:36.224 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-766-g0edf41a6-1jammy [708 kB] 2024-01-19T05:14:36.347 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-766-g0edf41a6-1jammy [356 kB] 2024-01-19T05:14:36.354 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-766-g0edf41a6-1jammy [32.8 kB] 2024-01-19T05:14:36.355 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-766-g0edf41a6-1jammy [180 kB] 2024-01-19T05:14:36.357 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-19T05:14:36.359 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-766-g0edf41a6-1jammy [64.1 kB] 2024-01-19T05:14:36.360 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-766-g0edf41a6-1jammy [330 kB] 2024-01-19T05:14:36.384 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-766-g0edf41a6-1jammy [6,228 kB] 2024-01-19T05:14:36.404 INFO:teuthology.orchestra.run.smithi099.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-766-g0edf41a6-1jammy [708 kB] 2024-01-19T05:14:36.418 INFO:teuthology.orchestra.run.smithi099.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-766-g0edf41a6-1jammy [356 kB] 2024-01-19T05:14:36.425 INFO:teuthology.orchestra.run.smithi099.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-766-g0edf41a6-1jammy [32.8 kB] 2024-01-19T05:14:36.426 INFO:teuthology.orchestra.run.smithi099.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-766-g0edf41a6-1jammy [180 kB] 2024-01-19T05:14:36.433 INFO:teuthology.orchestra.run.smithi099.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-766-g0edf41a6-1jammy [64.1 kB] 2024-01-19T05:14:36.435 INFO:teuthology.orchestra.run.smithi099.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-766-g0edf41a6-1jammy [330 kB] 2024-01-19T05:14:36.473 INFO:teuthology.orchestra.run.smithi099.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-766-g0edf41a6-1jammy [6,228 kB] 2024-01-19T05:14:36.751 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-766-g0edf41a6-1jammy [112 kB] 2024-01-19T05:14:36.771 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-766-g0edf41a6-1jammy [465 kB] 2024-01-19T05:14:36.796 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-766-g0edf41a6-1jammy [23.0 MB] 2024-01-19T05:14:36.874 INFO:teuthology.orchestra.run.smithi099.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-766-g0edf41a6-1jammy [112 kB] 2024-01-19T05:14:36.882 INFO:teuthology.orchestra.run.smithi099.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-766-g0edf41a6-1jammy [465 kB] 2024-01-19T05:14:36.901 INFO:teuthology.orchestra.run.smithi099.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-766-g0edf41a6-1jammy [23.0 MB] 2024-01-19T05:14:36.931 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-19T05:14:36.946 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-19T05:14:36.961 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-19T05:14:36.970 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-19T05:14:36.970 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-19T05:14:36.987 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-19T05:14:37.025 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-19T05:14:37.038 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-19T05:14:37.042 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-19T05:14:37.042 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-19T05:14:37.212 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-19T05:14:37.296 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-19T05:14:37.314 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-19T05:14:37.377 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-19T05:14:37.410 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-19T05:14:37.430 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-19T05:14:37.455 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-19T05:14:37.639 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-19T05:14:37.654 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-19T05:14:37.661 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-19T05:14:37.666 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-19T05:14:37.851 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-19T05:14:37.935 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-19T05:14:37.951 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-19T05:14:38.136 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-19T05:14:38.187 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-19T05:14:38.201 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-19T05:14:38.365 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-19T05:14:38.366 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-19T05:14:38.367 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-19T05:14:38.400 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-19T05:14:38.402 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-766-g0edf41a6-1jammy [5,056 kB] 2024-01-19T05:14:38.402 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-19T05:14:38.485 INFO:teuthology.orchestra.run.smithi099.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-766-g0edf41a6-1jammy [5,056 kB] 2024-01-19T05:14:38.569 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-19T05:14:38.703 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-766-g0edf41a6-1jammy [240 kB] 2024-01-19T05:14:38.708 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-766-g0edf41a6-1jammy [124 kB] 2024-01-19T05:14:38.711 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-766-g0edf41a6-1jammy [1,517 kB] 2024-01-19T05:14:38.760 INFO:teuthology.orchestra.run.smithi099.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-766-g0edf41a6-1jammy [240 kB] 2024-01-19T05:14:38.768 INFO:teuthology.orchestra.run.smithi099.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-766-g0edf41a6-1jammy [124 kB] 2024-01-19T05:14:38.774 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-766-g0edf41a6-1jammy [6,238 kB] 2024-01-19T05:14:38.784 INFO:teuthology.orchestra.run.smithi099.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-766-g0edf41a6-1jammy [1,517 kB] 2024-01-19T05:14:38.832 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-19T05:14:38.880 INFO:teuthology.orchestra.run.smithi099.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-766-g0edf41a6-1jammy [6,238 kB] 2024-01-19T05:14:38.947 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-19T05:14:38.990 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-19T05:14:39.073 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-19T05:14:39.085 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-19T05:14:39.098 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-19T05:14:39.138 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-19T05:14:39.187 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-766-g0edf41a6-1jammy [22.7 MB] 2024-01-19T05:14:39.294 INFO:teuthology.orchestra.run.smithi099.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-766-g0edf41a6-1jammy [22.7 MB] 2024-01-19T05:14:39.398 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-19T05:14:39.400 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-19T05:14:39.403 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-19T05:14:39.568 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-19T05:14:39.903 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-19T05:14:40.316 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-19T05:14:40.326 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-19T05:14:40.327 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-19T05:14:40.396 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-19T05:14:40.397 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-19T05:14:40.398 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-19T05:14:40.399 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-19T05:14:40.400 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-19T05:14:40.402 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-19T05:14:40.566 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-19T05:14:40.779 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-19T05:14:40.797 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-766-g0edf41a6-1jammy [14.0 kB] 2024-01-19T05:14:40.798 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-766-g0edf41a6-1jammy [865 kB] 2024-01-19T05:14:40.815 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-766-g0edf41a6-1jammy [2,183 kB] 2024-01-19T05:14:40.903 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-766-g0edf41a6-1jammy [770 kB] 2024-01-19T05:14:40.928 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-766-g0edf41a6-1jammy [139 kB] 2024-01-19T05:14:40.952 INFO:teuthology.orchestra.run.smithi099.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-766-g0edf41a6-1jammy [14.0 kB] 2024-01-19T05:14:40.952 INFO:teuthology.orchestra.run.smithi099.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-766-g0edf41a6-1jammy [865 kB] 2024-01-19T05:14:40.954 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-766-g0edf41a6-1jammy [1,876 kB] 2024-01-19T05:14:40.969 INFO:teuthology.orchestra.run.smithi099.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-766-g0edf41a6-1jammy [2,183 kB] 2024-01-19T05:14:41.008 INFO:teuthology.orchestra.run.smithi099.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-766-g0edf41a6-1jammy [770 kB] 2024-01-19T05:14:41.050 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-766-g0edf41a6-1jammy [8,625 kB] 2024-01-19T05:14:41.054 INFO:teuthology.orchestra.run.smithi099.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-766-g0edf41a6-1jammy [139 kB] 2024-01-19T05:14:41.058 INFO:teuthology.orchestra.run.smithi099.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-766-g0edf41a6-1jammy [1,876 kB] 2024-01-19T05:14:41.094 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-19T05:14:41.138 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-19T05:14:41.167 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-19T05:14:41.174 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-19T05:14:41.187 INFO:teuthology.orchestra.run.smithi099.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-766-g0edf41a6-1jammy [8,625 kB] 2024-01-19T05:14:41.221 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-19T05:14:41.246 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-19T05:14:41.248 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-19T05:14:41.255 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-19T05:14:41.258 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-19T05:14:41.467 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-19T05:14:41.633 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-766-g0edf41a6-1jammy [14.2 kB] 2024-01-19T05:14:41.635 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-766-g0edf41a6-1jammy [48.8 MB] 2024-01-19T05:14:41.726 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-19T05:14:41.740 INFO:teuthology.orchestra.run.smithi099.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-766-g0edf41a6-1jammy [14.2 kB] 2024-01-19T05:14:41.741 INFO:teuthology.orchestra.run.smithi099.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-766-g0edf41a6-1jammy [48.8 MB] 2024-01-19T05:14:41.966 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-19T05:14:41.969 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-19T05:14:41.988 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-19T05:14:41.993 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-19T05:14:42.028 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-19T05:14:42.041 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-19T05:14:42.132 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-19T05:14:42.134 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-19T05:14:42.135 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-19T05:14:42.315 INFO:teuthology.orchestra.run.smithi157.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-19T05:14:42.587 INFO:teuthology.orchestra.run.smithi157.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-19T05:14:45.112 INFO:teuthology.orchestra.run.smithi157.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-766-g0edf41a6-1jammy [121 kB] 2024-01-19T05:14:45.114 INFO:teuthology.orchestra.run.smithi157.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-766-g0edf41a6-1jammy [226 kB] 2024-01-19T05:14:45.119 INFO:teuthology.orchestra.run.smithi157.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-766-g0edf41a6-1jammy [34.0 kB] 2024-01-19T05:14:45.120 INFO:teuthology.orchestra.run.smithi157.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-766-g0edf41a6-1jammy [23.4 kB] 2024-01-19T05:14:45.121 INFO:teuthology.orchestra.run.smithi157.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-766-g0edf41a6-1jammy [38.4 kB] 2024-01-19T05:14:45.122 INFO:teuthology.orchestra.run.smithi157.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-766-g0edf41a6-1jammy [12.3 MB] 2024-01-19T05:14:45.254 INFO:teuthology.orchestra.run.smithi099.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-766-g0edf41a6-1jammy [121 kB] 2024-01-19T05:14:45.256 INFO:teuthology.orchestra.run.smithi099.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-766-g0edf41a6-1jammy [226 kB] 2024-01-19T05:14:45.261 INFO:teuthology.orchestra.run.smithi099.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-766-g0edf41a6-1jammy [34.0 kB] 2024-01-19T05:14:45.262 INFO:teuthology.orchestra.run.smithi099.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-766-g0edf41a6-1jammy [23.4 kB] 2024-01-19T05:14:45.263 INFO:teuthology.orchestra.run.smithi099.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-766-g0edf41a6-1jammy [38.4 kB] 2024-01-19T05:14:45.264 INFO:teuthology.orchestra.run.smithi099.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-766-g0edf41a6-1jammy [12.3 MB] 2024-01-19T05:14:45.589 INFO:teuthology.orchestra.run.smithi157.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-766-g0edf41a6-1jammy [91.4 kB] 2024-01-19T05:14:45.725 INFO:teuthology.orchestra.run.smithi099.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-766-g0edf41a6-1jammy [91.4 kB] 2024-01-19T05:14:46.202 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 173 MB in 10s (16.8 MB/s) 2024-01-19T05:14:46.327 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 173 MB in 10s (16.8 MB/s) 2024-01-19T05:14:46.341 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-19T05:14:46.435 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2024-01-19T05:14:46.440 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-19T05:14:46.472 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-19T05:14:46.481 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-19T05:14:46.571 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2024-01-19T05:14:46.576 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-19T05:14:46.620 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-19T05:14:46.776 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-19T05:14:46.802 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-19T05:14:46.842 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T05:14:46.923 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-19T05:14:46.949 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-19T05:14:46.989 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T05:14:47.137 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cmd2. 2024-01-19T05:14:47.163 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-19T05:14:47.220 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-19T05:14:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cmd2. 2024-01-19T05:14:47.319 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-19T05:14:47.359 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-19T05:14:47.573 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-19T05:14:47.599 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-19T05:14:47.662 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-19T05:14:47.682 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T05:14:47.688 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-19T05:14:47.787 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T05:14:48.027 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-19T05:14:48.053 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-19T05:14:48.093 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T05:14:48.124 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-19T05:14:48.150 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-19T05:14:48.191 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T05:14:48.397 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-19T05:14:48.423 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-19T05:14:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T05:14:48.527 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-19T05:14:48.553 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-19T05:14:48.594 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T05:14:49.092 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-19T05:14:49.118 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T05:14:49.135 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-19T05:14:49.161 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T05:14:49.166 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:14:49.290 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:14:49.561 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-19T05:14:49.587 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T05:14:49.628 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:14:49.693 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-19T05:14:49.719 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T05:14:49.759 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:14:49.931 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-19T05:14:49.957 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T05:14:49.989 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:14:50.088 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-19T05:14:50.113 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-19T05:14:50.146 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:14:50.343 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-19T05:14:50.371 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-19T05:14:50.409 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T05:14:50.474 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-19T05:14:50.500 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-19T05:14:50.541 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T05:14:50.729 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librados2. 2024-01-19T05:14:50.755 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-librados2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:50.795 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:50.861 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librados2. 2024-01-19T05:14:50.887 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../010-librados2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:50.927 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:51.232 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librbd1. 2024-01-19T05:14:51.258 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-librbd1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:51.290 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:51.405 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librbd1. 2024-01-19T05:14:51.431 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../011-librbd1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:51.472 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:51.768 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2024-01-19T05:14:51.794 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:51.834 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:51.875 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs2. 2024-01-19T05:14:51.889 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:51.933 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:52.112 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2024-01-19T05:14:52.127 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-python3-rados_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:52.170 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:52.210 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rados. 2024-01-19T05:14:52.237 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../013-python3-rados_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:52.277 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:52.498 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-19T05:14:52.524 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:14:52.564 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:52.605 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-19T05:14:52.631 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:14:52.672 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:52.800 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2024-01-19T05:14:52.827 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:52.858 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cephfs. 2024-01-19T05:14:52.931 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:52.966 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:53.145 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-19T05:14:53.171 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:14:53.211 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:53.253 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-19T05:14:53.278 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:14:53.319 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:53.489 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2024-01-19T05:14:53.505 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-19T05:14:53.548 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-19T05:14:53.639 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-prettytable. 2024-01-19T05:14:53.665 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-19T05:14:53.705 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-19T05:14:53.783 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2024-01-19T05:14:53.799 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:53.847 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:53.966 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rbd. 2024-01-19T05:14:53.981 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:54.025 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:54.287 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-19T05:14:54.313 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-19T05:14:54.353 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T05:14:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-19T05:14:54.554 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-19T05:14:54.586 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T05:14:54.631 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-19T05:14:54.657 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-19T05:14:54.697 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T05:14:54.831 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-19T05:14:54.846 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-19T05:14:54.889 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T05:14:54.984 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-19T05:14:55.010 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-19T05:14:55.042 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T05:14:55.192 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-19T05:14:55.207 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-19T05:14:55.250 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T05:14:55.362 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua5.1. 2024-01-19T05:14:55.388 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-19T05:14:55.428 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-19T05:14:55.596 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua5.1. 2024-01-19T05:14:55.622 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-19T05:14:55.662 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-19T05:14:55.748 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-any. 2024-01-19T05:14:55.764 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-19T05:14:55.806 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-19T05:14:55.957 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-any. 2024-01-19T05:14:55.972 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-19T05:14:56.015 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-19T05:14:56.059 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package zip. 2024-01-19T05:14:56.086 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-19T05:14:56.126 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking zip (3.0-12build2) ... 2024-01-19T05:14:56.260 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package zip. 2024-01-19T05:14:56.286 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-19T05:14:56.326 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking zip (3.0-12build2) ... 2024-01-19T05:14:56.424 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package unzip. 2024-01-19T05:14:56.451 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-19T05:14:56.487 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-19T05:14:56.671 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package unzip. 2024-01-19T05:14:56.697 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-19T05:14:56.738 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-19T05:14:56.858 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package luarocks. 2024-01-19T05:14:56.884 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-19T05:14:56.924 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-19T05:14:57.084 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package luarocks. 2024-01-19T05:14:57.110 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-19T05:14:57.150 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-19T05:14:57.282 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2024-01-19T05:14:57.309 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-librgw2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:57.349 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:57.525 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librgw2. 2024-01-19T05:14:57.552 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../027-librgw2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:57.592 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:57.868 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2024-01-19T05:14:57.883 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:57.926 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:58.119 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rgw. 2024-01-19T05:14:58.147 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:58.186 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:58.254 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-19T05:14:58.280 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-19T05:14:58.321 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T05:14:58.506 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-19T05:14:58.532 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-19T05:14:58.564 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T05:14:58.624 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2024-01-19T05:14:58.650 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:58.690 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:58.859 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libradosstriper1. 2024-01-19T05:14:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:58.925 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:59.044 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2024-01-19T05:14:59.070 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-ceph-common_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:59.110 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:14:59.354 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-common. 2024-01-19T05:14:59.380 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../031-ceph-common_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:14:59.420 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:00.374 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2024-01-19T05:15:00.400 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-ceph-base_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:00.450 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:00.668 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-base. 2024-01-19T05:15:00.694 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../032-ceph-base_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:00.735 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:01.011 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-19T05:15:01.038 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-19T05:15:01.078 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-19T05:15:01.289 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-19T05:15:01.315 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-19T05:15:01.339 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cheroot. 2024-01-19T05:15:01.355 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-19T05:15:01.355 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-19T05:15:01.389 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T05:15:01.675 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cheroot. 2024-01-19T05:15:01.701 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-19T05:15:01.702 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-19T05:15:01.727 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-19T05:15:01.741 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T05:15:01.767 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-19T05:15:02.070 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-19T05:15:02.095 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-19T05:15:02.096 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-19T05:15:02.122 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-19T05:15:02.136 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-19T05:15:02.161 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-19T05:15:02.440 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-19T05:15:02.466 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-19T05:15:02.473 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-19T05:15:02.500 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-19T05:15:02.506 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-19T05:15:02.539 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-19T05:15:02.809 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempora. 2024-01-19T05:15:02.809 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-19T05:15:02.835 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-19T05:15:02.836 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-19T05:15:02.867 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-19T05:15:02.876 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-19T05:15:03.145 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempora. 2024-01-19T05:15:03.170 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-portend. 2024-01-19T05:15:03.171 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-19T05:15:03.197 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-19T05:15:03.212 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-19T05:15:03.237 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-19T05:15:03.524 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-portend. 2024-01-19T05:15:03.550 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-19T05:15:03.556 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-19T05:15:03.583 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-19T05:15:03.590 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-19T05:15:03.623 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-19T05:15:03.893 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-19T05:15:03.901 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-19T05:15:03.919 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-19T05:15:03.928 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-19T05:15:03.960 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-19T05:15:03.967 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-19T05:15:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-19T05:15:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-19T05:15:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-19T05:15:04.521 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2024-01-19T05:15:04.548 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-19T05:15:04.588 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-19T05:15:04.633 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-natsort. 2024-01-19T05:15:04.660 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-19T05:15:04.700 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-19T05:15:04.891 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2024-01-19T05:15:04.918 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-19T05:15:04.958 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-19T05:15:05.228 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-logutils. 2024-01-19T05:15:05.244 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-19T05:15:05.254 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-19T05:15:05.271 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-19T05:15:05.294 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-19T05:15:05.310 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-19T05:15:05.573 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-19T05:15:05.599 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-19T05:15:05.613 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2024-01-19T05:15:05.631 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-19T05:15:05.640 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-19T05:15:05.688 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T05:15:05.900 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-mako. 2024-01-19T05:15:05.927 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-19T05:15:05.967 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T05:15:06.017 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-19T05:15:06.043 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-19T05:15:06.083 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-19T05:15:06.287 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-19T05:15:06.313 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-19T05:15:06.354 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-19T05:15:06.361 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-19T05:15:06.388 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-19T05:15:06.427 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-19T05:15:06.722 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2024-01-19T05:15:06.723 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-19T05:15:06.749 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-19T05:15:06.750 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-19T05:15:06.788 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-19T05:15:06.790 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-19T05:15:07.068 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webob. 2024-01-19T05:15:07.094 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-19T05:15:07.133 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2024-01-19T05:15:07.134 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-19T05:15:07.160 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-19T05:15:07.253 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T05:15:07.429 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-waitress. 2024-01-19T05:15:07.455 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-19T05:15:07.491 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T05:15:07.561 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2024-01-19T05:15:07.588 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-19T05:15:07.628 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T05:15:07.807 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempita. 2024-01-19T05:15:07.834 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-19T05:15:07.874 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T05:15:07.939 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2024-01-19T05:15:07.966 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-19T05:15:08.006 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T05:15:08.177 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-paste. 2024-01-19T05:15:08.204 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-19T05:15:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T05:15:08.326 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-19T05:15:08.341 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-19T05:15:08.384 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T05:15:08.597 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-19T05:15:08.623 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-19T05:15:08.663 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T05:15:08.686 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-19T05:15:08.714 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-19T05:15:09.095 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-19T05:15:09.717 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-19T05:15:09.740 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2024-01-19T05:15:09.743 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-19T05:15:09.766 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-19T05:15:09.775 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-19T05:15:09.807 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-19T05:15:10.045 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webtest. 2024-01-19T05:15:10.071 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-19T05:15:10.111 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-19T05:15:10.118 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2024-01-19T05:15:10.145 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-19T05:15:10.184 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T05:15:10.431 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pecan. 2024-01-19T05:15:10.458 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-19T05:15:10.498 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T05:15:10.539 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-certifi. 2024-01-19T05:15:10.566 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-19T05:15:10.606 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-19T05:15:10.853 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-certifi. 2024-01-19T05:15:10.879 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-19T05:15:10.919 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-19T05:15:10.925 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-idna. 2024-01-19T05:15:10.952 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-19T05:15:10.992 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-19T05:15:11.248 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-idna. 2024-01-19T05:15:11.274 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-19T05:15:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-urllib3. 2024-01-19T05:15:11.305 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-19T05:15:11.314 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-19T05:15:11.345 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T05:15:11.575 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-urllib3. 2024-01-19T05:15:11.591 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-19T05:15:11.625 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T05:15:11.656 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests. 2024-01-19T05:15:11.672 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-19T05:15:11.706 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T05:15:11.895 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests. 2024-01-19T05:15:11.911 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-19T05:15:11.953 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T05:15:11.976 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-19T05:15:11.991 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-19T05:15:12.026 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T05:15:12.257 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-19T05:15:12.283 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-19T05:15:12.295 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-19T05:15:12.311 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:12.323 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T05:15:12.345 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:12.568 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-19T05:15:12.583 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:12.618 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:12.700 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-19T05:15:12.716 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:12.759 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:12.965 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-19T05:15:12.992 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:13.031 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:13.061 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-19T05:15:13.088 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-19T05:15:13.128 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-19T05:15:13.276 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-19T05:15:13.291 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-19T05:15:13.326 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-19T05:15:13.439 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2024-01-19T05:15:13.466 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-19T05:15:13.506 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-19T05:15:13.604 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-openssl. 2024-01-19T05:15:13.630 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-19T05:15:13.670 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-19T05:15:13.826 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2024-01-19T05:15:13.852 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:13.892 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:14.034 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr. 2024-01-19T05:15:14.061 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:14.100 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:14.287 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2024-01-19T05:15:14.313 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:14.353 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:14.504 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mon. 2024-01-19T05:15:14.530 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:14.570 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:15.082 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2024-01-19T05:15:15.107 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-osd. 2024-01-19T05:15:15.109 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:15.134 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:15.140 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:15.165 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:16.160 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2024-01-19T05:15:16.187 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:16.219 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph. 2024-01-19T05:15:16.226 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:16.245 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../068-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:16.302 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:16.546 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2024-01-19T05:15:16.572 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:16.612 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:16.621 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-fuse. 2024-01-19T05:15:16.648 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:16.688 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:16.959 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2024-01-19T05:15:16.986 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:17.016 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mds. 2024-01-19T05:15:17.026 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:17.043 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:17.074 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:17.420 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2024-01-19T05:15:17.444 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephadm. 2024-01-19T05:15:17.447 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-cephadm_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:17.471 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../071-cephadm_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:17.486 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:17.510 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:17.823 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-19T05:15:17.830 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-19T05:15:17.849 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-19T05:15:17.853 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-19T05:15:17.889 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-19T05:15:17.896 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-19T05:15:18.200 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-19T05:15:18.216 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T05:15:18.233 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-19T05:15:18.258 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T05:15:18.259 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T05:15:18.299 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T05:15:19.230 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-babel. 2024-01-19T05:15:19.255 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-babel. 2024-01-19T05:15:19.258 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T05:15:19.282 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-19T05:15:19.296 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T05:15:19.321 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T05:15:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jinja2. 2024-01-19T05:15:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-19T05:15:19.641 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2024-01-19T05:15:19.668 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-19T05:15:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-19T05:15:19.757 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-19T05:15:20.003 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-19T05:15:20.029 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:20.069 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:20.103 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-19T05:15:20.130 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:20.169 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:20.364 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-19T05:15:20.379 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-19T05:15:20.414 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-19T05:15:20.522 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-19T05:15:20.549 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-19T05:15:20.589 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-19T05:15:20.692 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-routes. 2024-01-19T05:15:20.718 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-19T05:15:20.758 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T05:15:20.850 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2024-01-19T05:15:20.877 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-19T05:15:20.908 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T05:15:21.028 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-19T05:15:21.055 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:21.086 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:21.194 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-19T05:15:21.210 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:21.244 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:21.506 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-19T05:15:21.522 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-19T05:15:21.564 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T05:15:21.639 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-19T05:15:21.666 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-19T05:15:21.706 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T05:15:22.060 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-joblib. 2024-01-19T05:15:22.087 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-19T05:15:22.126 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T05:15:22.193 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2024-01-19T05:15:22.220 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-19T05:15:22.259 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T05:15:22.497 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-19T05:15:22.524 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-19T05:15:22.646 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-19T05:15:22.657 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-19T05:15:22.673 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-19T05:15:22.798 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-19T05:15:22.936 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn. 2024-01-19T05:15:22.963 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-19T05:15:22.994 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T05:15:23.084 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2024-01-19T05:15:23.112 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-19T05:15:23.151 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T05:15:23.720 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-19T05:15:23.749 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:23.777 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-19T05:15:23.787 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:23.805 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:23.835 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:24.773 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cachetools. 2024-01-19T05:15:24.800 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-19T05:15:24.821 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2024-01-19T05:15:24.840 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-19T05:15:24.852 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-19T05:15:25.046 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-19T05:15:25.102 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-19T05:15:25.129 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-19T05:15:25.159 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-19T05:15:25.349 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-19T05:15:25.377 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-19T05:15:25.416 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-19T05:15:25.505 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-19T05:15:25.532 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-19T05:15:25.571 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T05:15:25.745 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-19T05:15:25.772 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-19T05:15:25.811 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T05:15:25.883 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rsa. 2024-01-19T05:15:25.910 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-19T05:15:25.949 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-19T05:15:26.097 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2024-01-19T05:15:26.125 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-19T05:15:26.163 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-19T05:15:26.270 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-google-auth. 2024-01-19T05:15:26.297 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-19T05:15:26.336 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-19T05:15:26.493 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2024-01-19T05:15:26.520 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-19T05:15:26.559 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-19T05:15:26.657 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-19T05:15:26.684 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-19T05:15:26.723 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T05:15:26.862 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-19T05:15:26.889 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-19T05:15:26.920 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T05:15:27.060 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-websocket. 2024-01-19T05:15:27.087 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-19T05:15:27.126 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-19T05:15:27.198 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2024-01-19T05:15:27.227 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-19T05:15:27.265 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-19T05:15:27.438 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-19T05:15:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-19T05:15:27.505 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T05:15:27.585 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-19T05:15:27.612 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-19T05:15:27.652 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T05:15:28.127 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-19T05:15:28.144 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:28.185 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:28.324 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-19T05:15:28.352 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:28.382 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:28.505 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-19T05:15:28.533 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-19T05:15:28.571 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T05:15:28.685 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-19T05:15:28.713 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-19T05:15:28.751 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T05:15:28.908 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-19T05:15:28.935 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T05:15:28.975 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T05:15:29.079 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-19T05:15:29.107 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T05:15:29.146 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T05:15:29.202 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package jq. 2024-01-19T05:15:29.218 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T05:15:29.252 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-19T05:15:29.407 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2024-01-19T05:15:29.434 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-19T05:15:29.473 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-19T05:15:29.496 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package socat. 2024-01-19T05:15:29.524 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-19T05:15:29.563 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-19T05:15:29.710 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2024-01-19T05:15:29.737 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-19T05:15:29.776 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-19T05:15:29.858 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package xmlstarlet. 2024-01-19T05:15:29.875 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-19T05:15:29.917 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-19T05:15:30.088 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2024-01-19T05:15:30.116 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-19T05:15:30.154 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-19T05:15:30.263 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-test. 2024-01-19T05:15:30.279 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../099-ceph-test_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:30.321 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:30.633 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2024-01-19T05:15:30.657 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-ceph-test_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:30.708 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:32.634 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-volume. 2024-01-19T05:15:32.661 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:32.700 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:32.837 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2024-01-19T05:15:32.865 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:32.903 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:33.046 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-19T05:15:33.074 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:33.113 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:33.275 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-19T05:15:33.302 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:33.341 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:33.433 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-colorama. 2024-01-19T05:15:33.460 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-19T05:15:33.499 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-19T05:15:33.652 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-colorama. 2024-01-19T05:15:33.680 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-19T05:15:33.719 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-19T05:15:33.760 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephfs-shell. 2024-01-19T05:15:33.787 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:33.826 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:33.980 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-shell. 2024-01-19T05:15:34.007 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:34.046 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:34.079 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephfs-top. 2024-01-19T05:15:34.106 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:34.137 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:34.299 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-top. 2024-01-19T05:15:34.326 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-19T05:15:34.340 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-19T05:15:34.356 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:34.365 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:34.398 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:34.626 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-19T05:15:34.654 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:34.693 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:34.719 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-19T05:15:34.746 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-19T05:15:34.784 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T05:15:35.004 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-19T05:15:35.031 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-19T05:15:35.092 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T05:15:35.106 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-19T05:15:35.133 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-19T05:15:35.172 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-19T05:15:35.400 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-19T05:15:35.428 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-19T05:15:35.458 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-19T05:15:35.494 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package nvme-cli. 2024-01-19T05:15:35.522 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-19T05:15:35.579 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T05:15:35.838 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2024-01-19T05:15:35.865 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-19T05:15:35.904 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T05:15:35.999 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package pkg-config. 2024-01-19T05:15:36.026 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-19T05:15:36.066 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T05:15:36.302 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-19T05:15:36.317 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-19T05:15:36.318 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pkg-config. 2024-01-19T05:15:36.345 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-19T05:15:36.351 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-19T05:15:36.384 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T05:15:36.645 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-19T05:15:36.671 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-19T05:15:36.711 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-19T05:15:36.747 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-19T05:15:36.774 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-19T05:15:36.804 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-19T05:15:37.083 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastescript. 2024-01-19T05:15:37.110 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-19T05:15:37.131 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-19T05:15:37.149 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-19T05:15:37.159 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-19T05:15:37.198 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-19T05:15:37.453 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pluggy. 2024-01-19T05:15:37.480 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-19T05:15:37.493 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2024-01-19T05:15:37.519 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-19T05:15:37.520 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-19T05:15:37.559 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-19T05:15:37.831 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-psutil. 2024-01-19T05:15:37.858 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-19T05:15:37.887 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2024-01-19T05:15:37.897 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-19T05:15:37.915 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-19T05:15:37.954 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-19T05:15:38.217 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-py. 2024-01-19T05:15:38.232 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2024-01-19T05:15:38.244 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-19T05:15:38.259 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-19T05:15:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-19T05:15:38.290 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-19T05:15:38.595 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pygments. 2024-01-19T05:15:38.610 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2024-01-19T05:15:38.623 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-19T05:15:38.637 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-19T05:15:38.661 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T05:15:38.676 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-19T05:15:39.005 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pygments. 2024-01-19T05:15:39.032 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-19T05:15:39.071 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T05:15:39.100 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-19T05:15:39.127 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-19T05:15:39.166 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-19T05:15:39.477 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-toml. 2024-01-19T05:15:39.505 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-19T05:15:39.544 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-19T05:15:39.617 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-19T05:15:39.644 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-19T05:15:39.683 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pytest. 2024-01-19T05:15:39.874 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-19T05:15:39.930 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T05:15:39.994 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-toml. 2024-01-19T05:15:40.022 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-19T05:15:40.061 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-19T05:15:40.284 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplejson. 2024-01-19T05:15:40.311 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-19T05:15:40.350 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-19T05:15:40.620 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-19T05:15:40.647 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-19T05:15:40.655 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2024-01-19T05:15:40.683 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-19T05:15:40.686 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-19T05:15:40.721 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T05:15:41.009 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2024-01-19T05:15:41.024 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-19T05:15:41.075 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-19T05:15:41.328 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-19T05:15:41.356 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-19T05:15:41.390 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package radosgw. 2024-01-19T05:15:41.394 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-19T05:15:41.418 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../122-radosgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:41.465 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:42.182 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2024-01-19T05:15:42.210 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../122-radosgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:42.218 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package rbd-fuse. 2024-01-19T05:15:42.234 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:42.248 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:42.276 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:42.565 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-19T05:15:42.824 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T05:15:42.950 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T05:15:43.018 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2024-01-19T05:15:43.046 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-19T05:15:43.085 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:43.211 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-19T05:15:43.347 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-19T05:15:43.540 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-19T05:15:43.598 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-19T05:15:43.699 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-19T05:15:43.955 INFO:teuthology.orchestra.run.smithi099.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-19T05:15:44.005 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-19T05:15:44.026 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:44.323 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-19T05:15:44.586 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user cephadm....done 2024-01-19T05:15:44.708 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T05:15:44.732 INFO:teuthology.orchestra.run.smithi157.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-19T05:15:44.801 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:44.976 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-19T05:15:45.227 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-19T05:15:45.312 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2024-01-19T05:15:45.353 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-19T05:15:45.457 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-19T05:15:45.613 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-19T05:15:45.742 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-19T05:15:45.856 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T05:15:45.982 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-19T05:15:46.010 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-19T05:15:46.136 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-19T05:15:46.284 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T05:15:46.379 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-19T05:15:46.622 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-19T05:15:46.635 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-19T05:15:46.739 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-19T05:15:47.033 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-19T05:15:47.129 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-19T05:15:47.388 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-19T05:15:47.443 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-19T05:15:47.648 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-19T05:15:47.661 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-19T05:15:47.903 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-19T05:15:47.916 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-19T05:15:48.168 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-19T05:15:48.171 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-19T05:15:48.418 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-19T05:15:48.423 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-19T05:15:48.678 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:48.682 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-19T05:15:48.942 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-19T05:15:48.946 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T05:15:49.047 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T05:15:49.148 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-19T05:15:49.285 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:49.391 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T05:15:49.508 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-19T05:15:49.552 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-19T05:15:49.670 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-19T05:15:49.760 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-19T05:15:49.787 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-19T05:15:50.030 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-19T05:15:50.148 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-19T05:15:50.228 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-19T05:15:50.256 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-19T05:15:50.321 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T05:15:50.382 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-19T05:15:50.422 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-19T05:15:50.765 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T05:15:50.847 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-19T05:15:50.883 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-19T05:15:51.064 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-19T05:15:51.127 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-19T05:15:51.142 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T05:15:51.262 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-19T05:15:51.402 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-19T05:15:51.613 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-19T05:15:51.703 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up zip (3.0-12build2) ... 2024-01-19T05:15:51.730 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-19T05:15:51.829 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T05:15:51.998 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-19T05:15:52.266 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-19T05:15:52.498 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T05:15:52.576 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up zip (3.0-12build2) ... 2024-01-19T05:15:52.702 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-19T05:15:52.749 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T05:15:52.875 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-19T05:15:53.035 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T05:15:53.344 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-19T05:15:53.412 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-19T05:15:53.671 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-19T05:15:53.729 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-19T05:15:53.781 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-19T05:15:53.891 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-19T05:15:53.971 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T05:15:54.182 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-19T05:15:54.348 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T05:15:54.585 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-19T05:15:54.608 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-19T05:15:54.860 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-19T05:15:54.909 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T05:15:55.237 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-19T05:15:55.260 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-19T05:15:55.528 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-19T05:15:55.539 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-19T05:15:55.654 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:55.831 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-19T05:15:55.956 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-idna (3.3-1) ... 2024-01-19T05:15:56.174 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-19T05:15:56.275 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T05:15:56.425 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-19T05:15:56.551 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:15:56.869 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-idna (3.3-1) ... 2024-01-19T05:15:57.187 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-19T05:15:57.573 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T05:15:57.833 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:15:57.968 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-19T05:15:58.236 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T05:15:58.342 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-19T05:15:58.361 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-19T05:15:58.479 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T05:15:58.586 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:15:58.720 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-19T05:15:58.772 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-19T05:15:58.988 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-19T05:15:59.023 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-19T05:15:59.114 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-19T05:15:59.240 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-19T05:15:59.274 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:15:59.401 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-19T05:15:59.533 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-19T05:15:59.702 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-19T05:15:59.777 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-19T05:15:59.961 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-19T05:16:00.020 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:16:00.146 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-19T05:16:00.212 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-19T05:16:00.431 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-19T05:16:00.455 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-19T05:16:00.690 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-19T05:16:00.698 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-19T05:16:00.950 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-19T05:16:00.957 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T05:16:01.083 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-19T05:16:01.360 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T05:16:01.406 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-19T05:16:01.486 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T05:16:01.710 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-19T05:16:01.778 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-19T05:16:01.970 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-19T05:16:02.088 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-19T05:16:02.095 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-19T05:16:02.330 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T05:16:02.380 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-19T05:16:02.456 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-19T05:16:02.506 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-19T05:16:02.591 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T05:16:02.680 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-19T05:16:02.799 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-19T05:16:02.901 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T05:16:03.027 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T05:16:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-19T05:16:03.368 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-19T05:16:03.395 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-19T05:16:03.502 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-19T05:16:03.620 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-19T05:16:03.630 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-19T05:16:03.692 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-19T05:16:03.739 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-19T05:16:03.921 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-19T05:16:03.990 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:16:04.031 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-19T05:16:04.116 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-19T05:16:04.424 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-19T05:16:04.425 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T05:16:04.692 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-19T05:16:04.710 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T05:16:04.818 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-19T05:16:05.003 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-19T05:16:05.085 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-19T05:16:05.198 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-19T05:16:05.211 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-19T05:16:05.483 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-19T05:16:05.563 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-19T05:16:05.750 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T05:16:05.855 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-19T05:16:06.010 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-19T05:16:06.123 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-19T05:16:06.335 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-19T05:16:06.412 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-19T05:16:06.594 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-19T05:16:06.680 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T05:16:06.845 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-19T05:16:06.991 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T05:16:07.105 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-19T05:16:07.117 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:07.243 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:07.369 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-19T05:16:07.490 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-19T05:16:07.664 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:07.775 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-19T05:16:07.790 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:07.924 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-19T05:16:08.127 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-19T05:16:08.218 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:08.254 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:08.371 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:08.470 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:08.472 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-19T05:16:08.673 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T05:16:08.673 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T05:16:08.783 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:08.909 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:09.044 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-19T05:16:09.104 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:09.205 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:09.321 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:09.331 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:09.447 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:09.457 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:09.573 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:09.583 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T05:16:09.785 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T05:16:09.785 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-19T05:16:10.291 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:10.417 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:10.542 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:10.677 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:10.729 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:10.786 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-19T05:16:10.830 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:10.939 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:11.065 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:11.200 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:11.326 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:11.860 INFO:teuthology.orchestra.run.smithi099.stdout:Adding group ceph....done 2024-01-19T05:16:11.923 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:12.049 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:12.175 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:12.204 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user ceph....done 2024-01-19T05:16:12.301 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:12.380 INFO:teuthology.orchestra.run.smithi099.stdout:Setting system user ceph properties....done 2024-01-19T05:16:12.395 INFO:teuthology.orchestra.run.smithi099.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-19T05:16:12.427 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:12.530 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-19T05:16:12.553 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:12.824 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-19T05:16:13.046 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2024-01-19T05:16:13.294 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:13.381 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2024-01-19T05:16:13.499 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T05:16:13.499 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T05:16:13.550 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2024-01-19T05:16:13.565 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-19T05:16:13.704 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-19T05:16:13.953 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:14.063 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:14.081 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-19T05:16:14.519 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T05:16:14.519 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T05:16:14.538 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:14.727 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T05:16:14.727 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-19T05:16:14.981 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:15.222 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:15.330 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-19T05:16:15.382 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:15.800 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:15.853 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T05:16:15.853 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-19T05:16:16.031 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T05:16:16.031 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T05:16:16.334 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:16.510 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:16.707 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-19T05:16:16.730 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T05:16:16.730 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T05:16:17.219 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:17.383 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:17.495 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T05:16:17.495 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T05:16:17.640 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T05:16:17.641 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-19T05:16:17.989 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:18.114 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:18.124 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:18.274 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:18.399 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T05:16:18.399 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-19T05:16:18.476 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T05:16:18.476 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T05:16:18.877 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:18.917 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:19.068 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:19.153 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T05:16:19.153 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-19T05:16:19.219 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:19.362 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:19.654 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-19T05:16:19.754 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:19.816 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T05:16:19.889 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:19.968 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T05:16:20.085 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T05:16:20.085 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-19T05:16:20.565 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:20.716 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:20.842 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:20.993 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-19T05:16:21.094 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T05:16:21.347 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-19T05:16:21.455 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T05:16:21.599 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T05:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T05:16:21.752 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-19T05:16:21.852 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-01-19T05:16:22.040 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-01-19T05:16:22.041 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T05:16:22.210 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T05:16:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T05:16:22.211 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T05:16:22.212 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T05:16:22.212 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-01-19T05:16:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-19T05:16:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-19T05:16:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-19T05:16:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-19T05:16:22.212 INFO:teuthology.orchestra.run.smithi099.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T05:16:22.213 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-01-19T05:16:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-19T05:16:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-19T05:16:22.213 INFO:teuthology.orchestra.run.smithi099.stdout: libengine-pkcs11-openssl 2024-01-19T05:16:22.252 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-01-19T05:16:22.252 INFO:teuthology.orchestra.run.smithi099.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-19T05:16:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-19T05:16:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-19T05:16:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-19T05:16:22.253 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-19T05:16:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-19T05:16:22.254 INFO:teuthology.orchestra.run.smithi099.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T05:16:22.254 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-01-19T05:16:22.255 INFO:teuthology.orchestra.run.smithi099.stdout: libssl3 2024-01-19T05:16:22.314 INFO:teuthology.orchestra.run.smithi099.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2024-01-19T05:16:22.314 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 54.6 MB of archives. 2024-01-19T05:16:22.314 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-19T05:16:22.314 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-19T05:16:22.437 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-19T05:16:22.442 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T05:16:22.505 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-19T05:16:22.521 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-19T05:16:22.523 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-19T05:16:22.525 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-19T05:16:22.527 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-19T05:16:22.528 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-19T05:16:22.530 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-19T05:16:22.531 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-19T05:16:22.532 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-19T05:16:22.532 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-19T05:16:22.552 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-19T05:16:22.893 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-19T05:16:22.895 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-19T05:16:22.895 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-19T05:16:22.898 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-19T05:16:22.898 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-19T05:16:22.902 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-19T05:16:22.903 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-19T05:16:22.935 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-19T05:16:22.935 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-19T05:16:22.960 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-19T05:16:22.960 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-19T05:16:22.971 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-19T05:16:22.991 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-19T05:16:22.994 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-19T05:16:22.995 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-19T05:16:22.995 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-19T05:16:22.996 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-19T05:16:23.006 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-19T05:16:23.008 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-19T05:16:23.083 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T05:16:23.086 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-19T05:16:23.184 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-01-19T05:16:23.231 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-19T05:16:23.231 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-19T05:16:23.231 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-19T05:16:23.231 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-19T05:16:23.231 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-19T05:16:23.231 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-19T05:16:23.242 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-19T05:16:23.243 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-19T05:16:23.381 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-01-19T05:16:23.382 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-01-19T05:16:23.554 INFO:teuthology.orchestra.run.smithi157.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-19T05:16:23.555 INFO:teuthology.orchestra.run.smithi157.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-19T05:16:23.555 INFO:teuthology.orchestra.run.smithi157.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-19T05:16:23.555 INFO:teuthology.orchestra.run.smithi157.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-19T05:16:23.555 INFO:teuthology.orchestra.run.smithi157.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-19T05:16:23.555 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-01-19T05:16:23.555 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-19T05:16:23.555 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-19T05:16:23.555 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-19T05:16:23.556 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-19T05:16:23.556 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-19T05:16:23.556 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-19T05:16:23.557 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-01-19T05:16:23.557 INFO:teuthology.orchestra.run.smithi157.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-19T05:16:23.557 INFO:teuthology.orchestra.run.smithi157.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-19T05:16:23.557 INFO:teuthology.orchestra.run.smithi157.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-19T05:16:23.557 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-19T05:16:23.557 INFO:teuthology.orchestra.run.smithi157.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T05:16:23.558 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-01-19T05:16:23.558 INFO:teuthology.orchestra.run.smithi157.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-19T05:16:23.558 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-19T05:16:23.558 INFO:teuthology.orchestra.run.smithi157.stdout: libengine-pkcs11-openssl 2024-01-19T05:16:23.595 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-01-19T05:16:23.596 INFO:teuthology.orchestra.run.smithi157.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-19T05:16:23.596 INFO:teuthology.orchestra.run.smithi157.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-19T05:16:23.597 INFO:teuthology.orchestra.run.smithi157.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-19T05:16:23.597 INFO:teuthology.orchestra.run.smithi157.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-19T05:16:23.597 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-19T05:16:23.597 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-19T05:16:23.597 INFO:teuthology.orchestra.run.smithi157.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-19T05:16:23.598 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-01-19T05:16:23.598 INFO:teuthology.orchestra.run.smithi157.stdout: libssl3 2024-01-19T05:16:23.647 INFO:teuthology.orchestra.run.smithi099.stdout:Preconfiguring packages ... 2024-01-19T05:16:23.656 INFO:teuthology.orchestra.run.smithi157.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2024-01-19T05:16:23.656 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 54.6 MB of archives. 2024-01-19T05:16:23.656 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-19T05:16:23.656 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-19T05:16:23.781 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-19T05:16:23.787 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 54.6 MB in 1s (55.7 MB/s) 2024-01-19T05:16:23.874 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-19T05:16:23.889 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-19T05:16:23.890 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-19T05:16:23.893 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-19T05:16:23.894 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-19T05:16:23.895 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-19T05:16:23.896 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-19T05:16:23.898 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-19T05:16:23.898 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-19T05:16:23.899 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-19T05:16:23.919 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-19T05:16:23.926 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package flex. 2024-01-19T05:16:24.026 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173637 files and directories currently installed.) 2024-01-19T05:16:24.032 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-19T05:16:24.083 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-19T05:16:24.250 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-19T05:16:24.252 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-19T05:16:24.252 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-19T05:16:24.256 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-19T05:16:24.256 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-19T05:16:24.263 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-19T05:16:24.263 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-19T05:16:24.270 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-19T05:16:24.271 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-19T05:16:24.295 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-19T05:16:24.296 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-19T05:16:24.307 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-19T05:16:24.330 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-19T05:16:24.334 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-19T05:16:24.334 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-19T05:16:24.335 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-19T05:16:24.336 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-19T05:16:24.347 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-19T05:16:24.349 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-19T05:16:24.576 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-19T05:16:24.577 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-19T05:16:24.577 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-19T05:16:24.577 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-19T05:16:24.577 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-19T05:16:24.577 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-19T05:16:24.588 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-19T05:16:24.589 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-19T05:16:24.641 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T05:16:24.805 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-19T05:16:24.994 INFO:teuthology.orchestra.run.smithi157.stdout:Preconfiguring packages ... 2024-01-19T05:16:25.127 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 54.6 MB in 1s (55.5 MB/s) 2024-01-19T05:16:25.200 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T05:16:25.231 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package flex. 2024-01-19T05:16:25.294 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173637 files and directories currently installed.) 2024-01-19T05:16:25.300 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-19T05:16:25.339 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-19T05:16:25.732 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package bison. 2024-01-19T05:16:25.836 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173710 files and directories currently installed.) 2024-01-19T05:16:25.841 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-19T05:16:25.884 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T05:16:25.905 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T05:16:26.078 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-19T05:16:26.285 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-19T05:16:26.313 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-19T05:16:26.352 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T05:16:26.489 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T05:16:26.688 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package dump. 2024-01-19T05:16:26.715 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-19T05:16:26.755 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking dump (0.4b47-3) ... 2024-01-19T05:16:26.954 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package bison. 2024-01-19T05:16:27.033 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package indent. 2024-01-19T05:16:27.052 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173710 files and directories currently installed.) 2024-01-19T05:16:27.057 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-19T05:16:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:27.091 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T05:16:27.097 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T05:16:27.336 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-19T05:16:27.363 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-19T05:16:27.402 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T05:16:27.540 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-19T05:16:27.568 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-19T05:16:27.606 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T05:16:27.731 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-19T05:16:27.759 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-19T05:16:27.814 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T05:16:27.935 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package dump. 2024-01-19T05:16:27.962 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-19T05:16:28.001 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking dump (0.4b47-3) ... 2024-01-19T05:16:28.227 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-19T05:16:28.255 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-19T05:16:28.285 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T05:16:28.288 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package indent. 2024-01-19T05:16:28.316 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:28.346 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T05:16:28.565 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-19T05:16:28.581 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-19T05:16:28.622 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-19T05:16:28.623 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T05:16:28.650 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-19T05:16:28.688 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T05:16:28.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-19T05:16:28.952 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-19T05:16:28.968 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-19T05:16:28.980 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-19T05:16:29.008 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T05:16:29.019 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T05:16:29.244 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjson-perl. 2024-01-19T05:16:29.259 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-19T05:16:29.263 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-19T05:16:29.279 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-19T05:16:29.302 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-19T05:16:29.321 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T05:16:29.580 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-19T05:16:29.607 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-19T05:16:29.624 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-19T05:16:29.646 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T05:16:29.653 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-19T05:16:29.691 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T05:16:29.944 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-19T05:16:29.960 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-19T05:16:30.002 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T05:16:30.255 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjson-perl. 2024-01-19T05:16:30.283 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-19T05:16:30.321 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-19T05:16:30.632 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-19T05:16:30.657 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-19T05:16:30.699 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T05:16:31.341 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-19T05:16:31.369 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T05:16:31.407 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T05:16:31.677 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-19T05:16:31.692 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T05:16:31.735 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T05:16:32.021 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-19T05:16:32.048 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T05:16:32.079 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T05:16:32.352 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-19T05:16:32.380 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T05:16:32.418 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T05:16:32.457 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-19T05:16:32.485 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-19T05:16:32.523 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T05:16:32.679 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-19T05:16:32.696 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-19T05:16:32.738 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T05:16:32.843 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-19T05:16:32.871 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T05:16:32.910 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T05:16:33.057 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-19T05:16:33.085 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T05:16:33.123 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T05:16:33.255 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-19T05:16:33.283 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:33.313 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:33.443 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-19T05:16:33.471 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-19T05:16:33.501 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T05:16:33.658 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-19T05:16:33.686 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:33.724 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T05:16:33.821 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-19T05:16:33.849 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T05:16:33.887 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T05:16:34.052 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-19T05:16:34.080 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:34.118 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T05:16:34.232 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-19T05:16:34.260 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:34.298 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:34.371 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-19T05:16:34.389 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T05:16:34.429 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T05:16:34.618 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-19T05:16:34.645 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:34.684 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T05:16:34.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-19T05:16:34.962 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-19T05:16:34.969 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-19T05:16:34.978 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:35.007 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T05:16:35.020 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T05:16:35.247 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-19T05:16:35.275 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-19T05:16:35.314 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T05:16:35.344 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package modemmanager. 2024-01-19T05:16:35.372 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T05:16:35.410 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T05:16:35.776 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-19T05:16:35.804 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-19T05:16:35.842 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T05:16:35.992 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package network-manager. 2024-01-19T05:16:36.019 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T05:16:36.058 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-19T05:16:36.204 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package modemmanager. 2024-01-19T05:16:36.231 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-19T05:16:36.270 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T05:16:36.666 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ppp. 2024-01-19T05:16:36.686 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-19T05:16:36.884 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package network-manager. 2024-01-19T05:16:36.912 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-19T05:16:36.959 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-19T05:16:36.964 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T05:16:37.262 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package pptp-linux. 2024-01-19T05:16:37.290 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-19T05:16:37.328 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-19T05:16:37.542 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ppp. 2024-01-19T05:16:37.570 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-19T05:16:37.581 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-19T05:16:37.609 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-19T05:16:37.656 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-19T05:16:37.809 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T05:16:37.959 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-19T05:16:37.987 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-19T05:16:38.026 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-client-common (238) ... 2024-01-19T05:16:38.113 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pptp-linux. 2024-01-19T05:16:38.141 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-19T05:16:38.180 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-19T05:16:38.321 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-19T05:16:38.349 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:38.397 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:38.416 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-19T05:16:38.432 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-19T05:16:38.474 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-19T05:16:38.777 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-19T05:16:38.804 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-19T05:16:38.843 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client-common (238) ... 2024-01-19T05:16:39.003 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-common. 2024-01-19T05:16:39.030 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-19T05:16:39.087 INFO:teuthology.orchestra.run.smithi099.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-19T05:16:39.117 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-common (238) ... 2024-01-19T05:16:39.147 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-19T05:16:39.175 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:39.214 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:39.693 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-14. 2024-01-19T05:16:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:39.763 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:39.794 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-common. 2024-01-19T05:16:39.823 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-19T05:16:39.879 INFO:teuthology.orchestra.run.smithi157.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-19T05:16:39.909 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-common (238) ... 2024-01-19T05:16:40.384 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-14. 2024-01-19T05:16:40.412 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-19T05:16:40.454 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:41.063 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql. 2024-01-19T05:16:41.080 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-19T05:16:41.121 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql (14+238) ... 2024-01-19T05:16:41.359 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-client. 2024-01-19T05:16:41.375 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-19T05:16:41.409 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-client (14+238) ... 2024-01-19T05:16:41.603 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-19T05:16:41.619 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-19T05:16:41.653 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-19T05:16:41.812 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql. 2024-01-19T05:16:41.829 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-19T05:16:41.871 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql (14+238) ... 2024-01-19T05:16:41.972 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package tcl8.6. 2024-01-19T05:16:42.000 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-19T05:16:42.038 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T05:16:42.114 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client. 2024-01-19T05:16:42.131 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-19T05:16:42.173 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client (14+238) ... 2024-01-19T05:16:42.333 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package tcl. 2024-01-19T05:16:42.360 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-19T05:16:42.404 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-19T05:16:42.416 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-19T05:16:42.433 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-19T05:16:42.475 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-19T05:16:42.743 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package wpasupplicant. 2024-01-19T05:16:42.772 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-19T05:16:42.794 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package tcl8.6. 2024-01-19T05:16:42.810 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T05:16:42.822 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-19T05:16:42.852 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T05:16:43.147 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package tcl. 2024-01-19T05:16:43.147 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-19T05:16:43.164 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-19T05:16:43.175 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-19T05:16:43.197 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-19T05:16:43.218 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-19T05:16:43.566 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package wpasupplicant. 2024-01-19T05:16:43.595 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-19T05:16:43.633 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T05:16:43.981 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-19T05:16:43.997 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-19T05:16:44.039 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-19T05:16:44.102 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-19T05:16:44.130 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-19T05:16:44.202 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T05:16:44.401 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-19T05:16:44.428 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-19T05:16:44.475 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T05:16:44.480 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-client-common (238) ... 2024-01-19T05:16:44.707 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-19T05:16:44.780 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client-common (238) ... 2024-01-19T05:16:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T05:16:44.967 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:44.998 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-19T05:16:45.093 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T05:16:45.124 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-19T05:16:45.236 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T05:16:45.267 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:45.362 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:45.393 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-19T05:16:45.511 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-19T05:16:45.620 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:45.892 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-19T05:16:45.976 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T05:16:46.088 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-19T05:16:46.169 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-19T05:16:46.344 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T05:16:46.344 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T05:16:46.533 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T05:16:46.534 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-19T05:16:46.861 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T05:16:46.988 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T05:16:47.055 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-19T05:16:47.097 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-19T05:16:47.181 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-19T05:16:47.206 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T05:16:47.307 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-19T05:16:47.315 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T05:16:47.433 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-19T05:16:47.441 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T05:16:47.559 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-19T05:16:47.575 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T05:16:47.677 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-19T05:16:47.953 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-19T05:16:48.172 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T05:16:48.298 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up dump (0.4b47-3) ... 2024-01-19T05:16:48.391 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-19T05:16:48.449 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T05:16:48.584 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T05:16:48.710 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-19T05:16:48.836 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-19T05:16:48.933 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-19T05:16:48.953 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T05:16:49.044 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-19T05:16:49.101 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up dump (0.4b47-3) ... 2024-01-19T05:16:49.105 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T05:16:49.195 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-19T05:16:49.223 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T05:16:49.252 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T05:16:49.353 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-19T05:16:49.407 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T05:16:49.479 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-19T05:16:49.570 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T05:16:49.614 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-19T05:16:49.701 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-19T05:16:49.740 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-19T05:16:49.830 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-19T05:16:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-client (14+238) ... 2024-01-19T05:16:49.899 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-19T05:16:50.003 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-19T05:16:50.026 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-19T05:16:50.202 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-19T05:16:50.311 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T05:16:50.412 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-19T05:16:50.466 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:16:50.467 INFO:teuthology.orchestra.run.smithi099.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-19T05:16:50.467 INFO:teuthology.orchestra.run.smithi099.stdout:which means they are currently configured by ifupdown: 2024-01-19T05:16:50.467 INFO:teuthology.orchestra.run.smithi099.stdout:- enp3s0f1 2024-01-19T05:16:50.467 INFO:teuthology.orchestra.run.smithi099.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-19T05:16:50.467 INFO:teuthology.orchestra.run.smithi099.stdout:remove their configuration from /etc/network/interfaces. 2024-01-19T05:16:50.467 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:16:50.589 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client (14+238) ... 2024-01-19T05:16:50.595 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-19T05:16:50.715 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-19T05:16:50.920 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-19T05:16:51.193 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:16:51.193 INFO:teuthology.orchestra.run.smithi157.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-19T05:16:51.193 INFO:teuthology.orchestra.run.smithi157.stdout:which means they are currently configured by ifupdown: 2024-01-19T05:16:51.193 INFO:teuthology.orchestra.run.smithi157.stdout:- enp3s0f1 2024-01-19T05:16:51.194 INFO:teuthology.orchestra.run.smithi157.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-19T05:16:51.194 INFO:teuthology.orchestra.run.smithi157.stdout:remove their configuration from /etc/network/interfaces. 2024-01-19T05:16:51.194 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:16:51.245 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-19T05:16:51.311 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-19T05:16:51.610 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-19T05:16:51.713 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T05:16:51.865 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T05:16:51.924 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-19T05:16:51.974 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-19T05:16:52.092 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-common (238) ... 2024-01-19T05:16:52.425 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-19T05:16:52.552 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-19T05:16:52.653 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-19T05:16:52.754 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-common (238) ... 2024-01-19T05:16:52.990 INFO:teuthology.orchestra.run.smithi099.stdout:Adding user postgres to group ssl-cert 2024-01-19T05:16:53.187 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:16:53.187 INFO:teuthology.orchestra.run.smithi099.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-19T05:16:53.379 INFO:teuthology.orchestra.run.smithi099.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-19T05:16:53.379 INFO:teuthology.orchestra.run.smithi099.stdout:Removing obsolete dictionary files: 2024-01-19T05:16:53.926 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-19T05:16:54.009 INFO:teuthology.orchestra.run.smithi157.stdout:Adding user postgres to group ssl-cert 2024-01-19T05:16:54.216 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:16:54.217 INFO:teuthology.orchestra.run.smithi157.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-19T05:16:54.301 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:54.416 INFO:teuthology.orchestra.run.smithi157.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-19T05:16:54.416 INFO:teuthology.orchestra.run.smithi157.stdout:Removing obsolete dictionary files: 2024-01-19T05:16:54.624 INFO:teuthology.orchestra.run.smithi099.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-19T05:16:54.636 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout:This user must also own the server process. 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout:The database cluster will be initialized with locale "en_US". 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout:The default text search configuration will be set to "english". 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout:Data page checksums are disabled. 2024-01-19T05:16:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:16:54.684 INFO:teuthology.orchestra.run.smithi099.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-19T05:16:54.684 INFO:teuthology.orchestra.run.smithi099.stdout:creating subdirectories ... ok 2024-01-19T05:16:54.684 INFO:teuthology.orchestra.run.smithi099.stdout:selecting dynamic shared memory implementation ... posix 2024-01-19T05:16:54.700 INFO:teuthology.orchestra.run.smithi099.stdout:selecting default max_connections ... 100 2024-01-19T05:16:54.719 INFO:teuthology.orchestra.run.smithi099.stdout:selecting default shared_buffers ... 128MB 2024-01-19T05:16:54.726 INFO:teuthology.orchestra.run.smithi099.stdout:selecting default time zone ... Etc/UTC 2024-01-19T05:16:54.727 INFO:teuthology.orchestra.run.smithi099.stdout:creating configuration files ... ok 2024-01-19T05:16:54.841 INFO:teuthology.orchestra.run.smithi099.stdout:running bootstrap script ... ok 2024-01-19T05:16:54.916 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-19T05:16:55.298 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-19T05:16:55.499 INFO:teuthology.orchestra.run.smithi099.stdout:performing post-bootstrap initialization ... ok 2024-01-19T05:16:55.632 INFO:teuthology.orchestra.run.smithi157.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-19T05:16:55.648 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-19T05:16:55.697 INFO:teuthology.orchestra.run.smithi157.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout:This user must also own the server process. 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout:The database cluster will be initialized with locale "en_US". 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout:The default text search configuration will be set to "english". 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout:Data page checksums are disabled. 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout:creating subdirectories ... ok 2024-01-19T05:16:55.698 INFO:teuthology.orchestra.run.smithi157.stdout:selecting dynamic shared memory implementation ... posix 2024-01-19T05:16:55.711 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default max_connections ... 100 2024-01-19T05:16:55.729 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default shared_buffers ... 128MB 2024-01-19T05:16:55.738 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default time zone ... Etc/UTC 2024-01-19T05:16:55.739 INFO:teuthology.orchestra.run.smithi157.stdout:creating configuration files ... ok 2024-01-19T05:16:55.854 INFO:teuthology.orchestra.run.smithi157.stdout:running bootstrap script ... ok 2024-01-19T05:16:56.163 INFO:teuthology.orchestra.run.smithi099.stdout:syncing data to disk ... ok 2024-01-19T05:16:56.532 INFO:teuthology.orchestra.run.smithi157.stdout:performing post-bootstrap initialization ... ok 2024-01-19T05:16:56.578 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-19T05:16:57.193 INFO:teuthology.orchestra.run.smithi157.stdout:syncing data to disk ... ok 2024-01-19T05:16:57.578 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-19T05:16:59.374 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T05:16:59.500 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-19T05:16:59.626 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up postgresql (14+238) ... 2024-01-19T05:16:59.751 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T05:16:59.877 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T05:17:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T05:17:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T05:17:00.321 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T05:17:00.447 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-19T05:17:00.573 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql (14+238) ... 2024-01-19T05:17:00.697 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-19T05:17:00.699 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-19T05:17:00.816 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-19T05:17:01.015 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T05:17:01.051 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T05:17:01.052 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-19T05:17:01.167 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T05:17:01.569 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-19T05:17:01.871 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-19T05:17:02.014 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-19T05:17:02.536 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-19T05:17:02.644 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T05:17:03.098 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T05:17:03.103 DEBUG:teuthology.parallel:result is None 2024-01-19T05:17:03.377 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-19T05:17:03.477 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-19T05:17:03.910 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-19T05:17:03.914 DEBUG:teuthology.parallel:result is None 2024-01-19T05:17:03.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T05:17:04.060 DEBUG:teuthology.orchestra.run.smithi099:> dpkg-query -W -f '${Version}' ceph 2024-01-19T05:17:04.080 INFO:teuthology.orchestra.run.smithi099.stdout:19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:17:04.080 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:17:04.080 INFO:teuthology.task.install:The correct ceph version 19.0.0-766-g0edf41a6-1jammy is installed. 2024-01-19T05:17:04.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-19T05:17:04.262 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2024-01-19T05:17:04.281 INFO:teuthology.orchestra.run.smithi157.stdout:19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:17:04.281 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-766-g0edf41a6-1jammy 2024-01-19T05:17:04.281 INFO:teuthology.task.install:The correct ceph version 19.0.0-766-g0edf41a6-1jammy is installed. 2024-01-19T05:17:04.283 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-19T05:17:04.283 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:04.284 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-19T05:17:04.298 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:04.298 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-19T05:17:04.336 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-19T05:17:04.336 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:04.336 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-01-19T05:17:04.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-19T05:17:04.409 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:04.409 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-01-19T05:17:04.421 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-19T05:17:04.475 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-19T05:17:04.475 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:04.475 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-19T05:17:04.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-19T05:17:04.545 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:04.545 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-19T05:17:04.558 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-19T05:17:04.614 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-19T05:17:04.615 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:04.615 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-01-19T05:17:04.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-19T05:17:04.685 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:04.685 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-01-19T05:17:04.698 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-19T05:17:04.751 INFO:teuthology.run_tasks:Running task ceph... 2024-01-19T05:17:04.834 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-19T05:17:04.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-01-19T05:17:04.837 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-01-19T05:17:04.849 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-19T05:17:04.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-19T05:17:04.891 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-19T05:17:04.902 INFO:tasks.ceph:Creating extra log directories... 2024-01-19T05:17:04.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-19T05:17:04.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-19T05:17:04.965 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-19T05:17:04.965 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-19T05:17:04.966 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-19T05:17:04.966 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:04.966 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-19T05:17:05.006 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-19T05:17:05.079 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:05.079 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-19T05:17:05.084 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-19T05:17:05.164 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-19T05:17:05.164 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-19T05:17:05.164 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057', 'branch': 'wip-yuri8-testing-2024-01-18-0823', 'description': 'fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7521057', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2024-01-18-0823'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2024-01-18-0823', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6631, 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri8-testing-2024-01-18-0823', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfiVunQDKfNx9LTfRCAwSrrm0/hhiCKt9BVOdnWdCr+m3+AQmo7Qfa4JdQ/a9ztO0tgJNRmDGbgYir37pDdL6c=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfUEUddYhwqVdeto7MfqW7MZKsicO6ghR9JkflmRp7mkJV8r3Tf9pxoUhFdbWyrPG3i7g65u+ME2L/1VUFxKM4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cephfs_shell']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-18_21:19:14', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-19T05:17:05.165 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-19T05:17:05.167 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-19T05:17:05.207 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-01-19T05:17:05.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-01-19T05:17:05.264 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:05.264 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-01-19T05:17:05.274 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-19T05:17:05.274 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-01-19T05:17:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-19T05:17:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T05:17:05.326 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-01-19T05:17:05.326 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T05:17:05.326 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-19 05:11:09.002676787 +0000 2024-01-19T05:17:05.326 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-19 05:11:08.742679111 +0000 2024-01-19T05:17:05.326 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-19 05:11:08.742679111 +0000 2024-01-19T05:17:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-01-19T05:17:05.326 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-19T05:17:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-19T05:17:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-19T05:17:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000438647 s, 1.2 MB/s 2024-01-19T05:17:05.381 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-19T05:17:05.431 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-01-19T05:17:05.481 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-19T05:17:05.482 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T05:17:05.482 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-01-19T05:17:05.482 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T05:17:05.482 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-19 05:11:09.230674751 +0000 2024-01-19T05:17:05.482 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-19 05:11:09.226674787 +0000 2024-01-19T05:17:05.482 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-19 05:11:09.226674787 +0000 2024-01-19T05:17:05.482 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-01-19T05:17:05.482 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-19T05:17:05.540 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-19T05:17:05.540 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-19T05:17:05.540 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000416786 s, 1.2 MB/s 2024-01-19T05:17:05.541 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-19T05:17:05.591 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-01-19T05:17:05.638 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-19T05:17:05.638 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T05:17:05.638 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-01-19T05:17:05.638 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T05:17:05.638 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-19 05:11:09.982668033 +0000 2024-01-19T05:17:05.638 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-19 05:11:09.718670392 +0000 2024-01-19T05:17:05.638 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-19 05:11:09.718670392 +0000 2024-01-19T05:17:05.639 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-01-19T05:17:05.639 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-19T05:17:05.692 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-19T05:17:05.692 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-19T05:17:05.692 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000351692 s, 1.5 MB/s 2024-01-19T05:17:05.693 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-19T05:17:05.743 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-01-19T05:17:05.790 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-19T05:17:05.790 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T05:17:05.790 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-01-19T05:17:05.790 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T05:17:05.790 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-19 05:11:10.522663211 +0000 2024-01-19T05:17:05.790 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-19 05:11:10.226665855 +0000 2024-01-19T05:17:05.790 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-19 05:11:10.226665855 +0000 2024-01-19T05:17:05.790 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-01-19T05:17:05.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-19T05:17:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-19T05:17:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-19T05:17:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00031048 s, 1.6 MB/s 2024-01-19T05:17:05.849 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-19T05:17:05.899 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:05.899 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:05.899 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-01-19T05:17:05.905 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-19T05:17:05.905 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-01-19T05:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-19T05:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T05:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-01-19T05:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T05:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-01-19 05:11:08.478425566 +0000 2024-01-19T05:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-01-19 05:11:08.206467151 +0000 2024-01-19T05:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-01-19 05:11:08.206467151 +0000 2024-01-19T05:17:05.952 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-01-19T05:17:05.952 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-19T05:17:06.006 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-01-19T05:17:06.006 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-01-19T05:17:06.006 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000308291 s, 1.7 MB/s 2024-01-19T05:17:06.007 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-19T05:17:06.057 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-01-19T05:17:06.103 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-19T05:17:06.104 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T05:17:06.104 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-01-19T05:17:06.104 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T05:17:06.104 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-01-19 05:11:08.930356460 +0000 2024-01-19T05:17:06.104 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-01-19 05:11:08.690393153 +0000 2024-01-19T05:17:06.104 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-01-19 05:11:08.690393153 +0000 2024-01-19T05:17:06.104 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-01-19T05:17:06.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-19T05:17:06.158 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-01-19T05:17:06.158 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-01-19T05:17:06.158 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000286842 s, 1.8 MB/s 2024-01-19T05:17:06.159 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-19T05:17:06.209 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-01-19T05:17:06.255 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-19T05:17:06.255 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T05:17:06.255 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-01-19T05:17:06.255 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T05:17:06.255 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-01-19 05:11:09.402286295 +0000 2024-01-19T05:17:06.255 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-01-19 05:11:09.150323563 +0000 2024-01-19T05:17:06.256 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-01-19 05:11:09.150323563 +0000 2024-01-19T05:17:06.256 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-01-19T05:17:06.256 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-19T05:17:06.309 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-01-19T05:17:06.309 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-01-19T05:17:06.309 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000315678 s, 1.6 MB/s 2024-01-19T05:17:06.311 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-19T05:17:06.361 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-01-19T05:17:06.407 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-19T05:17:06.407 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-19T05:17:06.407 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-01-19T05:17:06.407 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-19T05:17:06.408 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-01-19 05:11:09.942206435 +0000 2024-01-19T05:17:06.408 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-01-19 05:11:09.678245477 +0000 2024-01-19T05:17:06.408 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-01-19 05:11:09.678245477 +0000 2024-01-19T05:17:06.408 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-01-19T05:17:06.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-19T05:17:06.462 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-01-19T05:17:06.462 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-01-19T05:17:06.462 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000310291 s, 1.7 MB/s 2024-01-19T05:17:06.463 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-19T05:17:06.512 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:06.512 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-19T05:17:06.513 INFO:tasks.ceph:Generating config... 2024-01-19T05:17:06.514 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-19T05:17:06.514 INFO:tasks.ceph:[client] debug client = 20 2024-01-19T05:17:06.514 INFO:tasks.ceph:[client] debug ms = 1 2024-01-19T05:17:06.514 INFO:tasks.ceph:[client] pid file = 2024-01-19T05:17:06.514 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-19T05:17:06.514 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-19T05:17:06.514 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-19T05:17:06.514 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-19T05:17:06.514 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-19T05:17:06.514 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-19T05:17:06.514 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-19T05:17:06.514 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-19T05:17:06.514 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-19T05:17:06.515 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-19T05:17:06.515 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-19T05:17:06.515 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-19T05:17:06.515 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-19T05:17:06.515 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-19T05:17:06.515 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-19T05:17:06.515 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-19T05:17:06.516 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-19T05:17:06.517 INFO:tasks.ceph:Setting up mon.a... 2024-01-19T05:17:06.517 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-19T05:17:06.551 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.keyring 2024-01-19T05:17:06.571 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-19T05:17:06.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T05:17:06.704 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.99'), ('mon.b', '172.21.15.157'), ('mon.c', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]')] 2024-01-19T05:17:06.705 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.99,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-19T05:17:06.706 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:06.706 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-19T05:17:06.754 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.99 --add b 172.21.15.157 --addv c '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:06.840 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:06.840 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: generated fsid 7f059d9d-1406-48ae-9584-fdafb673a966 2024-01-19T05:17:06.840 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = quincy 2024-01-19T05:17:06.840 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 0 2024-01-19T05:17:06.840 INFO:teuthology.orchestra.run.smithi099.stdout:fsid 7f059d9d-1406-48ae-9584-fdafb673a966 2024-01-19T05:17:06.840 INFO:teuthology.orchestra.run.smithi099.stdout:last_changed 2024-01-19T05:17:06.844242+0000 2024-01-19T05:17:06.840 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-01-19T05:17:06.844242+0000 2024-01-19T05:17:06.840 INFO:teuthology.orchestra.run.smithi099.stdout:min_mon_release 17 (quincy) 2024-01-19T05:17:06.841 INFO:teuthology.orchestra.run.smithi099.stdout:election_strategy: 1 2024-01-19T05:17:06.841 INFO:teuthology.orchestra.run.smithi099.stdout:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-01-19T05:17:06.841 INFO:teuthology.orchestra.run.smithi099.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-01-19T05:17:06.841 INFO:teuthology.orchestra.run.smithi099.stdout:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-01-19T05:17:06.841 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-19T05:17:06.842 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-19T05:17:06.890 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7f059d9d-1406-48ae-9584-fdafb673a966... 2024-01-19T05:17:06.891 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-19T05:17:06.934 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-19T05:17:06.963 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-01-19T05:17:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-01-19T05:17:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-01-19T05:17:06.964 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-19T05:17:06.965 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.99,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 7f059d9d-1406-48ae-9584-fdafb673a966 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.966 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.967 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = bitmap 2024-01-19T05:17:06.968 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-01-19T05:17:06.969 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-01-19T05:17:06.970 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.971 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2024-01-19T05:17:06.972 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = "" 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds balancer = 20 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-01-19T05:17:06.973 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2024-01-19T05:17:06.974 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2024-01-19T05:17:06.974 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2024-01-19T05:17:06.974 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2024-01-19T05:17:06.974 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-01-19T05:17:06.974 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-01-19T05:17:06.974 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-01-19T05:17:06.975 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-01-19T05:17:06.975 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-01-19T05:17:06.975 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-19T05:17:06.975 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-01-19T05:17:06.975 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-19T05:17:06.976 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.977 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.99,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 7f059d9d-1406-48ae-9584-fdafb673a966 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.978 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-01-19T05:17:06.979 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: bdev async discard = True 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: bdev enable discard = True 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore allocator = bitmap 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 1/20 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 1/20 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 4/10 2024-01-19T05:17:06.980 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.981 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.982 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-19T05:17:06.983 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = "" 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2024-01-19T05:17:06.984 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2024-01-19T05:17:06.985 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2024-01-19T05:17:06.985 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2024-01-19T05:17:06.985 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-01-19T05:17:06.985 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-01-19T05:17:06.985 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-01-19T05:17:06.985 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-19T05:17:06.985 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-19T05:17:07.065 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-19T05:17:07.066 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:07.066 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-19T05:17:07.070 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:07.070 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-19T05:17:07.117 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:17:07.117 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:07.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-19T05:17:07.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T05:17:07.181 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:07.181 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:07.230 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:17:07.230 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:07.230 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-19T05:17:07.230 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-19T05:17:07.251 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:07.251 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:07.299 INFO:tasks.ceph:Setting up mon nodes... 2024-01-19T05:17:07.299 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-19T05:17:07.300 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-19T05:17:07.342 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-19T05:17:07.345 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-19T05:17:07.386 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-19T05:17:07.400 INFO:tasks.ceph:Setting up mds nodes... 2024-01-19T05:17:07.400 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-19T05:17:07.439 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-19T05:17:07.442 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-19T05:17:07.496 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-19T05:17:07.540 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-19T05:17:07.543 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-19T05:17:07.599 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-19T05:17:07.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-19T05:17:07.635 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-19T05:17:07.646 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-19T05:17:07.646 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-19T05:17:07.646 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-19T05:17:07.701 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:07.701 INFO:tasks.ceph:role: osd.0 2024-01-19T05:17:07.701 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:17:07.701 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-19T05:17:07.764 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T05:17:07.764 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T05:17:07.764 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T05:17:07.764 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T05:17:07.764 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T05:17:07.764 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-01-19T05:17:07.765 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T05:17:07.765 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T05:17:07.765 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T05:17:07.765 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T05:17:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-01-19T05:17:08.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-01-19T05:17:08.242 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-19T05:17:08.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-19T05:17:08.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:17:08.356 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T05:17:08.356 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-19T05:17:08.407 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:08.407 INFO:tasks.ceph:role: osd.1 2024-01-19T05:17:08.407 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:17:08.407 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T05:17:08.472 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T05:17:08.473 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T05:17:08.938 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-01-19T05:17:08.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-01-19T05:17:08.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-19T05:17:09.092 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-19T05:17:09.102 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T05:17:09.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:17:09.103 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-19T05:17:09.155 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:09.155 INFO:tasks.ceph:role: osd.2 2024-01-19T05:17:09.155 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:17:09.155 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-19T05:17:09.217 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T05:17:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T05:17:09.217 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T05:17:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T05:17:09.218 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T05:17:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-01-19T05:17:09.218 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T05:17:09.218 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T05:17:09.218 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T05:17:09.218 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T05:17:09.699 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-01-19T05:17:09.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-01-19T05:17:09.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-19T05:17:09.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-19T05:17:09.853 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T05:17:09.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:17:09.854 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-19T05:17:09.908 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:09.908 INFO:tasks.ceph:role: osd.3 2024-01-19T05:17:09.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:17:09.908 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-19T05:17:09.970 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T05:17:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T05:17:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T05:17:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T05:17:09.970 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T05:17:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-01-19T05:17:09.970 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T05:17:09.971 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T05:17:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T05:17:09.971 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T05:17:10.388 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-01-19T05:17:10.390 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-01-19T05:17:10.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-19T05:17:10.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-19T05:17:10.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:17:10.494 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T05:17:10.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:10.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:10.603+0000 7f6783d36640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-19T05:17:10.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:10.607+0000 7f6783d36640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-19T05:17:10.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:10.607+0000 7f6783d36640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T05:17:10.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:10.607+0000 7f6783d36640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T05:17:10.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:10.607+0000 7f6783d36640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-19T05:17:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:10.611+0000 7f6783d36640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-19T05:17:13.575 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-19T05:17:13.589 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:13.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:13.671+0000 7ffb78e94640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-19T05:17:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:13.671+0000 7ffb78e94640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-19T05:17:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:13.671+0000 7ffb78e94640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T05:17:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:13.671+0000 7ffb78e94640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T05:17:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:13.671+0000 7ffb78e94640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-19T05:17:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:13.671+0000 7ffb78e94640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-19T05:17:16.637 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-19T05:17:16.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:16.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:16.775+0000 7f7ec3196640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-19T05:17:16.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:16.775+0000 7f7ec3196640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-19T05:17:16.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:16.775+0000 7f7ec3196640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T05:17:16.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:16.775+0000 7f7ec3196640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T05:17:16.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:16.775+0000 7f7ec3196640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-19T05:17:16.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:16.775+0000 7f7ec3196640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-19T05:17:19.761 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-19T05:17:19.818 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:19.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:19.899+0000 7f18af4e4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-19T05:17:19.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:19.903+0000 7f18af4e4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-19T05:17:19.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:19.903+0000 7f18af4e4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T05:17:19.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:19.903+0000 7f18af4e4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T05:17:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:19.903+0000 7f18af4e4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-19T05:17:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:19.903+0000 7f18af4e4640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-19T05:17:22.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-19T05:17:22.934 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-19T05:17:22.949 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:22.949 INFO:tasks.ceph:role: osd.4 2024-01-19T05:17:22.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:17:22.949 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-19T05:17:23.003 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T05:17:23.003 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T05:17:23.003 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T05:17:23.003 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T05:17:23.003 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T05:17:23.003 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-01-19T05:17:23.003 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T05:17:23.004 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T05:17:23.004 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T05:17:23.004 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T05:17:23.026 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-01-19T05:17:23.028 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-01-19T05:17:23.028 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-19T05:17:23.087 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-19T05:17:23.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:17:23.140 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T05:17:23.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-19T05:17:23.193 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:23.193 INFO:tasks.ceph:role: osd.5 2024-01-19T05:17:23.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:17:23.193 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-19T05:17:23.247 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T05:17:23.248 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T05:17:23.272 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-01-19T05:17:23.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-01-19T05:17:23.274 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-19T05:17:23.330 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-19T05:17:23.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:17:23.381 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T05:17:23.381 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-19T05:17:23.432 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:23.432 INFO:tasks.ceph:role: osd.6 2024-01-19T05:17:23.433 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:17:23.433 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-19T05:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T05:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T05:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T05:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T05:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T05:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-01-19T05:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T05:17:23.486 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T05:17:23.487 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T05:17:23.487 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T05:17:23.510 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-01-19T05:17:23.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-01-19T05:17:23.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-19T05:17:23.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-19T05:17:23.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:17:23.625 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T05:17:23.625 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-19T05:17:23.678 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-19T05:17:23.678 INFO:tasks.ceph:role: osd.7 2024-01-19T05:17:23.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:17:23.678 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-19T05:17:23.735 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-19T05:17:23.758 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-01-19T05:17:23.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-01-19T05:17:23.760 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-19T05:17:23.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-19T05:17:23.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:17:23.873 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-01-19T05:17:23.873 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:23.976+0000 7f777e51c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-19T05:17:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:23.976+0000 7f777e51c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-19T05:17:23.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:23.976+0000 7f777e51c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T05:17:23.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:23.976+0000 7f777e51c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T05:17:23.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:23.976+0000 7f777e51c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-19T05:17:23.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:23.976+0000 7f777e51c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-19T05:17:26.938 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-19T05:17:26.952 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:27.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:27.032+0000 7f658a11b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-19T05:17:27.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:27.032+0000 7f658a11b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-19T05:17:27.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:27.032+0000 7f658a11b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T05:17:27.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:27.032+0000 7f658a11b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T05:17:27.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:27.032+0000 7f658a11b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-19T05:17:27.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:27.032+0000 7f658a11b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-19T05:17:29.998 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-19T05:17:30.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:30.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:30.132+0000 7f1a02211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-19T05:17:30.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:30.132+0000 7f1a02211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-19T05:17:30.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:30.132+0000 7f1a02211640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T05:17:30.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:30.132+0000 7f1a02211640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T05:17:30.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:30.132+0000 7f1a02211640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-19T05:17:30.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:30.132+0000 7f1a02211640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-19T05:17:33.100 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-19T05:17:33.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:33.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:33.236+0000 7f8c9d99d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-19T05:17:33.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:33.236+0000 7f8c9d99d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-19T05:17:33.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:33.236+0000 7f8c9d99d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T05:17:33.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:33.236+0000 7f8c9d99d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T05:17:33.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:33.236+0000 7f8c9d99d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-19T05:17:33.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:33.236+0000 7f8c9d99d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-19T05:17:35.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:17:35.169 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:17:36.222 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-19T05:17:36.235 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-19T05:17:36.235 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:36.235 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-19T05:17:36.249 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:36.250 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-19T05:17:36.305 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:36.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-19T05:17:36.360 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:36.360 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-19T05:17:36.416 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:36.416 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-19T05:17:36.469 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:36.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-19T05:17:36.523 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:36.524 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-19T05:17:36.537 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:36.537 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-19T05:17:36.590 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:36.590 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-19T05:17:36.646 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:36.647 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-19T05:17:36.702 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:36.702 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-19T05:17:36.753 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:36.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-19T05:17:36.806 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:36.806 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-19T05:17:36.814 INFO:tasks.ceph:Adding keys to all mons... 2024-01-19T05:17:36.814 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-19T05:17:36.858 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-19T05:17:36.868 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2024-01-19T05:17:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDTBaplDl6rFBAAll1qnW8tuARQ/SJGd1f5zw== 2024-01-19T05:17:36.868 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-01-19T05:17:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDTBaplI1Z6GhAAjE1qrFtYKxlAWBZWDIGvhQ== 2024-01-19T05:17:36.868 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2024-01-19T05:17:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDWBapl09otJBAABLiFKXjUqdxU/jTPAI+2/A== 2024-01-19T05:17:36.868 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDZBaplpF84KBAA6Ktwr0nLv5cchz/DSdNg7w== 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDcBaplokOALhAAhr0Z/I21azQtlSdnNhLtog== 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDfBapl+E3zNRAA+KBnm0jPtQr5XrWTcGAAhg== 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDTBaplVZQ8FxAA/EfnirPNB1ooVl9fjdHieg== 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDTBapl139qIBAAv46OAf1fqp6NHUL1G5lJpw== 2024-01-19T05:17:36.869 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDjBapl2B11OhAAhPfxLl7BQbZkfT3eVWYP+A== 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDnBaplQsozAhAAF+MoyV3OQOfOYIcOO0DtFg== 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDqBapl/80YCBAAKvmh1mLQHl2HzK95MKC8aA== 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDtBapljl5bDhAAPlVtPR3FBwsulKIl5g3lfA== 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-01-19T05:17:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDTBaplWVQgJhAAFrZruGldx9x7uUC0VUJzcg== 2024-01-19T05:17:36.871 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDTBaplDl6rFBAAll1qnW8tuARQ/SJGd1f5zw== 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDTBaplI1Z6GhAAjE1qrFtYKxlAWBZWDIGvhQ== 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDWBapl09otJBAABLiFKXjUqdxU/jTPAI+2/A== 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDZBaplpF84KBAA6Ktwr0nLv5cchz/DSdNg7w== 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDcBaplokOALhAAhr0Z/I21azQtlSdnNhLtog== 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-01-19T05:17:36.872 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDfBapl+E3zNRAA+KBnm0jPtQr5XrWTcGAAhg== 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDTBaplVZQ8FxAA/EfnirPNB1ooVl9fjdHieg== 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDTBapl139qIBAAv46OAf1fqp6NHUL1G5lJpw== 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDjBapl2B11OhAAhPfxLl7BQbZkfT3eVWYP+A== 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDnBaplQsozAhAAF+MoyV3OQOfOYIcOO0DtFg== 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDqBapl/80YCBAAKvmh1mLQHl2HzK95MKC8aA== 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDtBapljl5bDhAAPlVtPR3FBwsulKIl5g3lfA== 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-01-19T05:17:36.873 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDTBaplWVQgJhAAFrZruGldx9x7uUC0VUJzcg== 2024-01-19T05:17:36.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T05:17:36.914 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T05:17:36.961 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T05:17:37.003 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T05:17:37.050 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.091 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.134 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.177 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.302 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.341 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T05:17:37.382 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-19T05:17:37.423 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T05:17:37.466 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-19T05:17:37.509 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.554 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.638 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.680 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.726 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.768 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.810 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-19T05:17:37.854 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-19T05:17:37.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-19T05:17:37.930 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-19T05:17:37.930 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-19T05:17:37.950 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T05:17:38.039 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-19T05:17:38.091 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-19T05:17:38.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T05:17:38.195 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-19T05:17:38.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-19T05:17:38.256 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-19T05:17:38.346 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-19T05:17:38.356 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:38.359 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-19T05:17:38.402 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-19T05:17:38.402 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-19T05:17:38.402 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-19T05:17:38.406 INFO:tasks.ceph.mon.a:Started 2024-01-19T05:17:38.406 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-19T05:17:38.406 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-19T05:17:38.444 INFO:tasks.ceph.mon.b:Started 2024-01-19T05:17:38.444 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-19T05:17:38.444 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-19T05:17:38.446 INFO:tasks.ceph.mon.c:Started 2024-01-19T05:17:38.446 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-19T05:17:38.446 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-19T05:17:38.447 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-19T05:17:38.449 INFO:tasks.ceph.mgr.y:Started 2024-01-19T05:17:38.449 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-19T05:17:38.449 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-19T05:17:38.452 INFO:tasks.ceph.mgr.x:Started 2024-01-19T05:17:38.452 INFO:tasks.ceph:Setting crush tunables to default 2024-01-19T05:17:38.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd crush tunables default 2024-01-19T05:17:38.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4eca1e4640 1 Processor -- start 2024-01-19T05:17:38.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4eca1e4640 1 -- start start 2024-01-19T05:17:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4eca1e4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 0x7f4ec4144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4eca1e4640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec4143dc0 con 0x7f4ec40b3a10 2024-01-19T05:17:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4eca1e4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec40b3ea0 con 0x7f4ec40aec10 2024-01-19T05:17:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4eca1e4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec406d0d0 con 0x7f4ec406ccf0 2024-01-19T05:17:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4ec2ffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4ec40b3a10 0x7f4ec40ae500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53878/0 (socket says 172.21.15.99:53878) 2024-01-19T05:17:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4ec2ffd640 1 -- 172.21.15.99:0/1940582465 learned_addr learned my addr 172.21.15.99:0/1940582465 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:17:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 0x7f4ec4144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4ec37fe640 1 -- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 msgr2=0x7f4ec4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T05:17:38.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4ec37fe640 1 -- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 msgr2=0x7f4ec4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T05:17:38.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 0x7f4ec4144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T05:17:38.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.567+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 0x7f4ec4144250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-19T05:17:38.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.771+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 0x7f4ec4144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.771+0000 7f4ec37fe640 1 -- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 msgr2=0x7f4ec4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-19T05:17:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.771+0000 7f4ec37fe640 1 -- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 msgr2=0x7f4ec4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-19T05:17:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.771+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 0x7f4ec4144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-19T05:17:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.771+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 0x7f4ec4144250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-19T05:17:38.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763287055 0 0) 0x7f4ec4143dc0 con 0x7f4ec40b3a10 2024-01-19T05:17:38.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eac005740 con 0x7f4ec40b3a10 2024-01-19T05:17:38.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540396114 0 0) 0x7f4ec40b3ea0 con 0x7f4ec40aec10 2024-01-19T05:17:38.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec4143dc0 con 0x7f4ec40aec10 2024-01-19T05:17:38.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2942462855 0 0) 0x7f4ec4143dc0 con 0x7f4ec40aec10 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 msgr2=0x7f4ec4144250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 --2- 172.21.15.99:0/1940582465 >> v2:172.21.15.157:3300/0 conn(0x7f4ec406ccf0 0x7f4ec4144250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 >> v1:172.21.15.99:6789/0 conn(0x7f4ec40b3a10 legacy=0x7f4ec40ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4143770 con 0x7f4ec40aec10 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f4ebc001680 con 0x7f4ec40aec10 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 >> v1:172.21.15.157:6789/0 conn(0x7f4ec40aec10 legacy=0x7f4ec413cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac005d70 0x7f4eac006170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0069e0 0x7f4eac006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac007470 0x7f4eac00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec406d0d0 con 0x7f4eac007470 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac00e3c0 con 0x7f4eac0069e0 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac00e580 con 0x7f4eac005d70 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac005d70 0x7f4eac006170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:38.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec3fff640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac007470 0x7f4eac00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:38.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.819+0000 7f4ec2ffd640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0069e0 0x7f4eac006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:38.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.823+0000 7f4ec37fe640 1 -- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0069e0 msgr2=0x7f4eac006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:38.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.823+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0069e0 0x7f4eac006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.823+0000 7f4ec37fe640 1 -- 172.21.15.99:0/1940582465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac007470 msgr2=0x7f4eac00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:38.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.823+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac007470 0x7f4eac00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.823+0000 7f4ec37fe640 1 -- 172.21.15.99:0/1940582465 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4143dc0 con 0x7f4eac005d70 2024-01-19T05:17:38.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.823+0000 7f4ec3fff640 1 -- 172.21.15.99:0/1940582465 reap_dead start 2024-01-19T05:17:38.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.827+0000 7f4ec37fe640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac005d70 0x7f4eac006170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009a40 tx=0x7f4eb401cfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ca74772e1eadf49 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:38.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.827+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40a5db0 con 0x7f4eac005d70 2024-01-19T05:17:38.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.827+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb40ad440 con 0x7f4eac005d70 2024-01-19T05:17:38.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.827+0000 7f4ec27fc640 1 -- 172.21.15.99:0/1940582465 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40ad830 con 0x7f4eac005d70 2024-01-19T05:17:38.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.827+0000 7f4eca1e4640 1 -- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac005d70 msgr2=0x7f4eac006170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:38.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.827+0000 7f4eca1e4640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac005d70 0x7f4eac006170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009a40 tx=0x7f4eb401cfb0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.831+0000 7f4eca1e4640 1 -- 172.21.15.99:0/1940582465 shutdown_connections 2024-01-19T05:17:38.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.831+0000 7f4eca1e4640 1 --2- 172.21.15.99:0/1940582465 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac005d70 0x7f4eac006170 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.831+0000 7f4eca1e4640 1 -- 172.21.15.99:0/1940582465 >> 172.21.15.99:0/1940582465 conn(0x7f4ec4066ef0 msgr2=0x7f4ec40b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:38.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.831+0000 7f4eca1e4640 1 -- 172.21.15.99:0/1940582465 shutdown_connections 2024-01-19T05:17:38.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.831+0000 7f4eca1e4640 1 -- 172.21.15.99:0/1940582465 wait complete. 2024-01-19T05:17:38.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 Processor -- start 2024-01-19T05:17:38.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 -- start start 2024-01-19T05:17:38.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac005d70 0x7f4ec4140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ec41dede0 0x7f4ec4070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec409aa40 0x7f4ec413a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4070670 con 0x7f4eac005d70 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41df260 con 0x7f4ec409aa40 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4140400 con 0x7f4ec41dede0 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ec41dede0 0x7f4ec4070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac005d70 0x7f4ec4140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ec41dede0 0x7f4ec4070130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:38560/0 (socket says 172.21.15.99:38560) 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 -- 172.21.15.99:0/2531292366 learned_addr learned my addr 172.21.15.99:0/2531292366 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:38.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec3fff640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec409aa40 0x7f4ec413a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:38.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 -- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec409aa40 msgr2=0x7f4ec413a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:38.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec409aa40 0x7f4ec413a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 -- 172.21.15.99:0/2531292366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac005d70 msgr2=0x7f4ec4140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac005d70 0x7f4ec4140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 -- 172.21.15.99:0/2531292366 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4070880 con 0x7f4ec41dede0 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec3fff640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec409aa40 0x7f4ec413a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4ec2ffd640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ec41dede0 0x7f4ec4070130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80017c0 tx=0x7f4eb8001c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eabfff640 1 -- 172.21.15.99:0/2531292366 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8004e10 con 0x7f4ec41dede0 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eabfff640 1 -- 172.21.15.99:0/2531292366 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb8007740 con 0x7f4ec41dede0 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eabfff640 1 -- 172.21.15.99:0/2531292366 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800fbe0 con 0x7f4ec41dede0 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec40b34b0 con 0x7f4ec41dede0 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec409b800 con 0x7f4ec41dede0 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.835+0000 7f4eabfff640 1 -- 172.21.15.99:0/2531292366 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f4eb800fd40 con 0x7f4ec41dede0 2024-01-19T05:17:38.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.839+0000 7f4eabfff640 1 -- 172.21.15.99:0/2531292366 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4eb8013580 con 0x7f4ec41dede0 2024-01-19T05:17:38.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.839+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec40696e0 con 0x7f4ec41dede0 2024-01-19T05:17:38.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.851+0000 7f4eabfff640 1 -- 172.21.15.99:0/2531292366 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f4eb80137f0 con 0x7f4ec41dede0 2024-01-19T05:17:38.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.915+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4ec406c3c0 con 0x7f4ec41dede0 2024-01-19T05:17:38.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.919+0000 7f4eabfff640 1 -- 172.21.15.99:0/2531292366 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4eb8013990 con 0x7f4ec41dede0 2024-01-19T05:17:38.920 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ec41dede0 msgr2=0x7f4ec4070130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ec41dede0 0x7f4ec4070130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80017c0 tx=0x7f4eb8001c80 comp rx=0 tx=0).stop 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 shutdown_connections 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec409aa40 0x7f4ec413a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4ec41dede0 0x7f4ec4070130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 --2- 172.21.15.99:0/2531292366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac005d70 0x7f4ec4140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 >> 172.21.15.99:0/2531292366 conn(0x7f4ec4066ef0 msgr2=0x7f4ec413d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 shutdown_connections 2024-01-19T05:17:38.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:38.923+0000 7f4eca1e4640 1 -- 172.21.15.99:0/2531292366 wait complete. 2024-01-19T05:17:38.939 INFO:tasks.ceph:check_enable_crimson: False 2024-01-19T05:17:38.939 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-19T05:17:38.940 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:38.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-19T05:17:38.951 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:38.951 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-19T05:17:39.007 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:39.007 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-19T05:17:39.026 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:39.027+0000 7faac9cb8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-19T05:17:39.036 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:17:39.037 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-19T05:17:39.092 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:39.092 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-19T05:17:39.102 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:39.100+0000 7f5bcd779180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-19T05:17:39.105 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:39.105 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-19T05:17:39.158 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:39.158 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-19T05:17:39.213 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-01-19T05:17:39.213 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-19T05:17:39.267 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 3e1137c2-1d10-46da-b03b-9f0131b4079d 0 2024-01-19T05:17:39.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2e517640 1 Processor -- start 2024-01-19T05:17:39.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2e517640 1 -- start start 2024-01-19T05:17:39.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2e517640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6d280b2870 0x7f6d28143af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2e517640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6d28144030 0x7f6d28151260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2e517640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d280b2cf0 con 0x7f6d280b9170 2024-01-19T05:17:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2e517640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280afd00 con 0x7f6d280b2870 2024-01-19T05:17:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2e517640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d281444a0 con 0x7f6d28144030 2024-01-19T05:17:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2cab4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6d28144030 0x7f6d28151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d27fff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6d280b9170 0x7f6d280b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:53178/0 (socket says 172.21.15.157:53178) 2024-01-19T05:17:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d27fff640 1 -- 172.21.15.157:0/2303835373 learned_addr learned my addr 172.21.15.157:0/2303835373 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-01-19T05:17:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2cab4640 1 -- 172.21.15.157:0/2303835373 >> v2:172.21.15.99:3300/0 conn(0x7f6d280b2870 msgr2=0x7f6d28143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d277fe640 1 --2- 172.21.15.157:0/2303835373 >> v2:172.21.15.99:3300/0 conn(0x7f6d280b2870 0x7f6d28143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2cab4640 1 --2- 172.21.15.157:0/2303835373 >> v2:172.21.15.99:3300/0 conn(0x7f6d280b2870 0x7f6d28143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2cab4640 1 -- 172.21.15.157:0/2303835373 >> v1:172.21.15.157:6789/0 conn(0x7f6d280b9170 legacy=0x7f6d280b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d26ffd640 1 -- 172.21.15.157:0/2303835373 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380539198 0 0) 0x7f6d280b2cf0 con 0x7f6d280b9170 2024-01-19T05:17:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d2cab4640 1 -- 172.21.15.157:0/2303835373 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280b9550 con 0x7f6d28144030 2024-01-19T05:17:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.428+0000 7f6d277fe640 1 --2- 172.21.15.157:0/2303835373 >> v2:172.21.15.99:3300/0 conn(0x7f6d280b2870 0x7f6d28143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2cab4640 1 --2- 172.21.15.157:0/2303835373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d28144030 0x7f6d28151260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d28067a80 tx=0x7f6d2001c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c3e2da67b57d170 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:39.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d26ffd640 1 -- 172.21.15.157:0/2303835373 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200a5940 con 0x7f6d28144030 2024-01-19T05:17:39.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d26ffd640 1 -- 172.21.15.157:0/2303835373 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d200a5aa0 con 0x7f6d28144030 2024-01-19T05:17:39.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d26ffd640 1 -- 172.21.15.157:0/2303835373 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200a5e30 con 0x7f6d28144030 2024-01-19T05:17:39.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 -- 172.21.15.157:0/2303835373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d28144030 msgr2=0x7f6d28151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 --2- 172.21.15.157:0/2303835373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d28144030 0x7f6d28151260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d28067a80 tx=0x7f6d2001c880 comp rx=0 tx=0).stop 2024-01-19T05:17:39.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 -- 172.21.15.157:0/2303835373 shutdown_connections 2024-01-19T05:17:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 --2- 172.21.15.157:0/2303835373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d28144030 0x7f6d28151260 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 --2- 172.21.15.157:0/2303835373 >> v2:172.21.15.99:3300/0 conn(0x7f6d280b2870 0x7f6d28143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 -- 172.21.15.157:0/2303835373 >> 172.21.15.157:0/2303835373 conn(0x7f6d2806adf0 msgr2=0x7f6d280b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 -- 172.21.15.157:0/2303835373 shutdown_connections 2024-01-19T05:17:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 -- 172.21.15.157:0/2303835373 wait complete. 2024-01-19T05:17:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 Processor -- start 2024-01-19T05:17:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.432+0000 7f6d2e517640 1 -- start start 2024-01-19T05:17:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d280b2870 0x7f6d2813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d280b9170 0x7f6d28141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d28144030 0x7f6d280b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2813ba80 con 0x7f6d280b2870 2024-01-19T05:17:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2813bd00 con 0x7f6d280b9170 2024-01-19T05:17:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280b6730 con 0x7f6d28144030 2024-01-19T05:17:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d277fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d280b9170 0x7f6d28141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2cab4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d28144030 0x7f6d280b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2cab4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d28144030 0x7f6d280b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:37884/0 (socket says 172.21.15.157:37884) 2024-01-19T05:17:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d277fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d280b9170 0x7f6d28141bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37572/0 (socket says 172.21.15.157:37572) 2024-01-19T05:17:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2cab4640 1 -- 172.21.15.157:0/850991441 learned_addr learned my addr 172.21.15.157:0/850991441 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:39.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d27fff640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d280b2870 0x7f6d2813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d277fe640 1 -- 172.21.15.157:0/850991441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d28144030 msgr2=0x7f6d280b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d277fe640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d28144030 0x7f6d280b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d277fe640 1 -- 172.21.15.157:0/850991441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d280b2870 msgr2=0x7f6d2813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d277fe640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d280b2870 0x7f6d2813fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d277fe640 1 -- 172.21.15.157:0/850991441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20009a70 con 0x7f6d280b9170 2024-01-19T05:17:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d27fff640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d280b2870 0x7f6d2813fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:17:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2cab4640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d28144030 0x7f6d280b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:17:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d277fe640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d280b9170 0x7f6d28141bb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c7c0 tx=0x7f6d1c00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d24ff9640 1 -- 172.21.15.157:0/850991441 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c007820 con 0x7f6d280b9170 2024-01-19T05:17:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d24ff9640 1 -- 172.21.15.157:0/850991441 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c007980 con 0x7f6d280b9170 2024-01-19T05:17:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d280b69d0 con 0x7f6d280b9170 2024-01-19T05:17:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d24ff9640 1 -- 172.21.15.157:0/850991441 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c007d10 con 0x7f6d280b9170 2024-01-19T05:17:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d280b8400 con 0x7f6d280b9170 2024-01-19T05:17:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d24ff9640 1 -- 172.21.15.157:0/850991441 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f6d1c01a450 con 0x7f6d280b9170 2024-01-19T05:17:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d24ff9640 1 -- 172.21.15.157:0/850991441 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6d1c011a80 con 0x7f6d280b9170 2024-01-19T05:17:39.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.436+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d280b6b60 con 0x7f6d280b9170 2024-01-19T05:17:39.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.440+0000 7f6d24ff9640 1 -- 172.21.15.157:0/850991441 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f6d1c01f060 con 0x7f6d280b9170 2024-01-19T05:17:39.461 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:39.463+0000 7faac9cb8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-19T05:17:39.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.504+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3e1137c2-1d10-46da-b03b-9f0131b4079d", "id": 0} v 0) v1 -- 0x7f6d280696e0 con 0x7f6d280b9170 2024-01-19T05:17:39.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d24ff9640 1 -- 172.21.15.157:0/850991441 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e1137c2-1d10-46da-b03b-9f0131b4079d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d1c015070 con 0x7f6d280b9170 2024-01-19T05:17:39.511 INFO:teuthology.orchestra.run.smithi157.stdout:0 2024-01-19T05:17:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d280b9170 msgr2=0x7f6d28141bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d280b9170 0x7f6d28141bb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c7c0 tx=0x7f6d1c00cc80 comp rx=0 tx=0).stop 2024-01-19T05:17:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 shutdown_connections 2024-01-19T05:17:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d28144030 0x7f6d280b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d280b9170 0x7f6d28141bb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 --2- 172.21.15.157:0/850991441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d280b2870 0x7f6d2813fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 >> 172.21.15.157:0/850991441 conn(0x7f6d2806adf0 msgr2=0x7f6d280b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 shutdown_connections 2024-01-19T05:17:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.512+0000 7f6d2e517640 1 -- 172.21.15.157:0/850991441 wait complete. 2024-01-19T05:17:39.529 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 5473ae2a-79d7-411e-8551-0896d5e2aefe 1 2024-01-19T05:17:39.597 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:39.596+0000 7f5bcd779180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-19T05:17:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde47577640 1 Processor -- start 2024-01-19T05:17:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde47577640 1 -- start start 2024-01-19T05:17:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde47577640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde40146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde47577640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fde40149ea0 0x7fde40146e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde47577640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4006e4a0 con 0x7fde40070dd0 2024-01-19T05:17:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde47577640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4014a410 con 0x7fde40149ea0 2024-01-19T05:17:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde47577640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4014a6f0 con 0x7fde4006e0c0 2024-01-19T05:17:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde45313640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde40146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde45313640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde40146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:37896/0 (socket says 172.21.15.157:37896) 2024-01-19T05:17:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde45313640 1 -- 172.21.15.157:0/1891935847 learned_addr learned my addr 172.21.15.157:0/1891935847 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde44b12640 1 --2- 172.21.15.157:0/1891935847 >> v2:172.21.15.99:3300/0 conn(0x7fde40149ea0 0x7fde40146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde45313640 1 -- 172.21.15.157:0/1891935847 >> v2:172.21.15.99:3300/0 conn(0x7fde40149ea0 msgr2=0x7fde40146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde45313640 1 --2- 172.21.15.157:0/1891935847 >> v2:172.21.15.99:3300/0 conn(0x7fde40149ea0 0x7fde40146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde45313640 1 -- 172.21.15.157:0/1891935847 >> v1:172.21.15.99:6789/0 conn(0x7fde40070dd0 legacy=0x7fde40071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde45313640 1 -- 172.21.15.157:0/1891935847 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4014a9d0 con 0x7fde4006e0c0 2024-01-19T05:17:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.648+0000 7fde44b12640 1 --2- 172.21.15.157:0/1891935847 >> v2:172.21.15.99:3300/0 conn(0x7fde40149ea0 0x7fde40146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 --2- 172.21.15.157:0/1891935847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde40146930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f5f522f58d938c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde37fff640 1 -- 172.21.15.157:0/1891935847 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0a57e0 con 0x7fde4006e0c0 2024-01-19T05:17:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde37fff640 1 -- 172.21.15.157:0/1891935847 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c0a5940 con 0x7fde4006e0c0 2024-01-19T05:17:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde37fff640 1 -- 172.21.15.157:0/1891935847 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0a5cd0 con 0x7fde4006e0c0 2024-01-19T05:17:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- 172.21.15.157:0/1891935847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 msgr2=0x7fde40146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 --2- 172.21.15.157:0/1891935847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde40146930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c01c940 comp rx=0 tx=0).stop 2024-01-19T05:17:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- 172.21.15.157:0/1891935847 shutdown_connections 2024-01-19T05:17:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 --2- 172.21.15.157:0/1891935847 >> v2:172.21.15.99:3300/0 conn(0x7fde40149ea0 0x7fde40146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 --2- 172.21.15.157:0/1891935847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde40146930 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- 172.21.15.157:0/1891935847 >> 172.21.15.157:0/1891935847 conn(0x7fde400ba500 msgr2=0x7fde400ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- 172.21.15.157:0/1891935847 shutdown_connections 2024-01-19T05:17:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- 172.21.15.157:0/1891935847 wait complete. 2024-01-19T05:17:39.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 Processor -- start 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- start start 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde401407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde40070dd0 0x7fde401e2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde40149ea0 0x7fde4009bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4009af40 con 0x7fde40149ea0 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4009c410 con 0x7fde40070dd0 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde47577640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4009a8f0 con 0x7fde4006e0c0 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde401407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde401407b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:37908/0 (socket says 172.21.15.157:37908) 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde44b12640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde40070dd0 0x7fde401e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 -- 172.21.15.157:0/3383862788 learned_addr learned my addr 172.21.15.157:0/3383862788 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45b14640 1 --2- 172.21.15.157:0/3383862788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde40149ea0 0x7fde4009bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 -- 172.21.15.157:0/3383862788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde40070dd0 msgr2=0x7fde401e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 --2- 172.21.15.157:0/3383862788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde40070dd0 0x7fde401e2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 -- 172.21.15.157:0/3383862788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde40149ea0 msgr2=0x7fde4009bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 --2- 172.21.15.157:0/3383862788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde40149ea0 0x7fde4009bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 -- 172.21.15.157:0/3383862788 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c009b30 con 0x7fde4006e0c0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde45313640 1 --2- 172.21.15.157:0/3383862788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde401407b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde3c01aff0 tx=0x7fde3c0196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde35ffb640 1 -- 172.21.15.157:0/3383862788 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0b8670 con 0x7fde4006e0c0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde35ffb640 1 -- 172.21.15.157:0/3383862788 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c0b87d0 con 0x7fde4006e0c0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.652+0000 7fde35ffb640 1 -- 172.21.15.157:0/3383862788 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0b8b60 con 0x7fde4006e0c0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.656+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4009abd0 con 0x7fde4006e0c0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.656+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4009c120 con 0x7fde4006e0c0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.656+0000 7fde35ffb640 1 -- 172.21.15.157:0/3383862788 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fde3c0b8cc0 con 0x7fde4006e0c0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.656+0000 7fde35ffb640 1 -- 172.21.15.157:0/3383862788 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fde3c0b6920 con 0x7fde4006e0c0 2024-01-19T05:17:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.656+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4009a750 con 0x7fde4006e0c0 2024-01-19T05:17:39.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.660+0000 7fde35ffb640 1 -- 172.21.15.157:0/3383862788 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fde3c0dfcf0 con 0x7fde4006e0c0 2024-01-19T05:17:39.668 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:39.667+0000 7faac9cb8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-19T05:17:39.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.728+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5473ae2a-79d7-411e-8551-0896d5e2aefe", "id": 1} v 0) v1 -- 0x7fde400696e0 con 0x7fde4006e0c0 2024-01-19T05:17:39.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.732+0000 7fde35ffb640 1 -- 172.21.15.157:0/3383862788 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5473ae2a-79d7-411e-8551-0896d5e2aefe", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde3c0ce030 con 0x7fde4006e0c0 2024-01-19T05:17:39.734 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-01-19T05:17:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 msgr2=0x7fde401407b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 --2- 172.21.15.157:0/3383862788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde401407b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde3c01aff0 tx=0x7fde3c0196e0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 shutdown_connections 2024-01-19T05:17:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 --2- 172.21.15.157:0/3383862788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde40149ea0 0x7fde4009bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 --2- 172.21.15.157:0/3383862788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde40070dd0 0x7fde401e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 --2- 172.21.15.157:0/3383862788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde4006e0c0 0x7fde401407b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 >> 172.21.15.157:0/3383862788 conn(0x7fde400ba500 msgr2=0x7fde401410f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 shutdown_connections 2024-01-19T05:17:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.736+0000 7fde47577640 1 -- 172.21.15.157:0/3383862788 wait complete. 2024-01-19T05:17:39.751 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new ebfdc59e-70db-4653-95a4-346861bfc163 2 2024-01-19T05:17:39.821 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:39.820+0000 7f5bcd779180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-19T05:17:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff235395640 1 Processor -- start 2024-01-19T05:17:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff235395640 1 -- start start 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff235395640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2300b8f10 0x7ff23013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff235395640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff23013eb00 0x7ff230147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff235395640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2300afa00 con 0x7ff2300b92f0 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff235395640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23006f3f0 con 0x7ff23013eb00 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff235395640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff230072c50 con 0x7ff2300b8f10 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22effd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2300b8f10 0x7ff23013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22effd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff2300b8f10 0x7ff23013e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37596/0 (socket says 172.21.15.157:37596) 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22effd640 1 -- 172.21.15.157:0/1648714117 learned_addr learned my addr 172.21.15.157:0/1648714117 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22f7fe640 1 --1- 172.21.15.157:0/1648714117 >> v1:172.21.15.157:6789/0 conn(0x7ff2300b92f0 0x7ff2300b3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:53190/0 (socket says 172.21.15.157:53190) 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22e7fc640 1 --2- 172.21.15.157:0/1648714117 >> v2:172.21.15.99:3300/0 conn(0x7ff23013eb00 0x7ff230147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22effd640 1 -- 172.21.15.157:0/1648714117 >> v2:172.21.15.99:3300/0 conn(0x7ff23013eb00 msgr2=0x7ff230147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22effd640 1 --2- 172.21.15.157:0/1648714117 >> v2:172.21.15.99:3300/0 conn(0x7ff23013eb00 0x7ff230147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22effd640 1 -- 172.21.15.157:0/1648714117 >> v1:172.21.15.157:6789/0 conn(0x7ff2300b92f0 legacy=0x7ff2300b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.868+0000 7ff22effd640 1 -- 172.21.15.157:0/1648714117 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2300b4c40 con 0x7ff2300b8f10 2024-01-19T05:17:39.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff22e7fc640 1 --2- 172.21.15.157:0/1648714117 >> v2:172.21.15.99:3300/0 conn(0x7ff23013eb00 0x7ff230147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff22effd640 1 --2- 172.21.15.157:0/1648714117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff23013e5c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff228009e50 tx=0x7ff22801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5b7156016e00b84 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff22dffb640 1 -- 172.21.15.157:0/1648714117 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280a56e0 con 0x7ff2300b8f10 2024-01-19T05:17:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff22dffb640 1 -- 172.21.15.157:0/1648714117 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280a5840 con 0x7ff2300b8f10 2024-01-19T05:17:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff22dffb640 1 -- 172.21.15.157:0/1648714117 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280a5bd0 con 0x7ff2300b8f10 2024-01-19T05:17:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff235395640 1 -- 172.21.15.157:0/1648714117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 msgr2=0x7ff23013e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff235395640 1 --2- 172.21.15.157:0/1648714117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff23013e5c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff228009e50 tx=0x7ff22801c910 comp rx=0 tx=0).stop 2024-01-19T05:17:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff235395640 1 -- 172.21.15.157:0/1648714117 shutdown_connections 2024-01-19T05:17:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff235395640 1 --2- 172.21.15.157:0/1648714117 >> v2:172.21.15.99:3300/0 conn(0x7ff23013eb00 0x7ff230147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff235395640 1 --2- 172.21.15.157:0/1648714117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff23013e5c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff235395640 1 -- 172.21.15.157:0/1648714117 >> 172.21.15.157:0/1648714117 conn(0x7ff23006adf0 msgr2=0x7ff2300b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff235395640 1 -- 172.21.15.157:0/1648714117 shutdown_connections 2024-01-19T05:17:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.872+0000 7ff235395640 1 -- 172.21.15.157:0/1648714117 wait complete. 2024-01-19T05:17:39.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 Processor -- start 2024-01-19T05:17:39.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 -- start start 2024-01-19T05:17:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff2301df230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2300b92f0 0x7ff230137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2301382e0 0x7ff23014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230138760 con 0x7ff2300b92f0 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300b0bf0 con 0x7ff2300b8f10 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301391c0 con 0x7ff2301382e0 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff2301df230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff2301df230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37606/0 (socket says 172.21.15.157:37606) 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 -- 172.21.15.157:0/106628529 learned_addr learned my addr 172.21.15.157:0/106628529 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22f7fe640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2301382e0 0x7ff23014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22e7fc640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2300b92f0 0x7ff230137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 -- 172.21.15.157:0/106628529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2301382e0 msgr2=0x7ff23014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2301382e0 0x7ff23014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 -- 172.21.15.157:0/106628529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2300b92f0 msgr2=0x7ff230137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2300b92f0 0x7ff230137da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 -- 172.21.15.157:0/106628529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009b30 con 0x7ff2300b8f10 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff22effd640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff2301df230 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff228019520 tx=0x7ff2280196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff2177fe640 1 -- 172.21.15.157:0/106628529 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280b8670 con 0x7ff2300b8f10 2024-01-19T05:17:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff2177fe640 1 -- 172.21.15.157:0/106628529 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280b87d0 con 0x7ff2300b8f10 2024-01-19T05:17:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff230139710 con 0x7ff2300b8f10 2024-01-19T05:17:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff2177fe640 1 -- 172.21.15.157:0/106628529 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280b8b80 con 0x7ff2300b8f10 2024-01-19T05:17:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23013e380 con 0x7ff2300b8f10 2024-01-19T05:17:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23013e570 con 0x7ff2300b8f10 2024-01-19T05:17:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff2177fe640 1 -- 172.21.15.157:0/106628529 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7ff2280b8ce0 con 0x7ff2300b8f10 2024-01-19T05:17:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.876+0000 7ff2177fe640 1 -- 172.21.15.157:0/106628529 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff2280b6950 con 0x7ff2300b8f10 2024-01-19T05:17:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.880+0000 7ff2177fe640 1 -- 172.21.15.157:0/106628529 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7ff2280dfcf0 con 0x7ff2300b8f10 2024-01-19T05:17:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.948+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ebfdc59e-70db-4653-95a4-346861bfc163", "id": 2} v 0) v1 -- 0x7ff2300696e0 con 0x7ff2300b8f10 2024-01-19T05:17:39.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff2177fe640 1 -- 172.21.15.157:0/106628529 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ebfdc59e-70db-4653-95a4-346861bfc163", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff2280ce030 con 0x7ff2300b8f10 2024-01-19T05:17:39.956 INFO:teuthology.orchestra.run.smithi157.stdout:2 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 msgr2=0x7ff2301df230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff2301df230 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff228019520 tx=0x7ff2280196b0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 shutdown_connections 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2301382e0 0x7ff23014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2300b92f0 0x7ff230137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 --2- 172.21.15.157:0/106628529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2300b8f10 0x7ff2301df230 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 >> 172.21.15.157:0/106628529 conn(0x7ff23006adf0 msgr2=0x7ff230142570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 shutdown_connections 2024-01-19T05:17:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:39.956+0000 7ff235395640 1 -- 172.21.15.157:0/106628529 wait complete. 2024-01-19T05:17:39.973 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 774fc446-ece5-4d47-999b-c9fa2944406d 3 2024-01-19T05:17:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcfaceb640 1 Processor -- start 2024-01-19T05:17:40.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcfaceb640 1 -- start start 2024-01-19T05:17:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcfaceb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf409e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcfaceb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdcf409d9f0 0x7fdcf413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcfaceb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40b4c10 con 0x7fdcf409d590 2024-01-19T05:17:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcfaceb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf409de40 con 0x7fdcf409d9f0 2024-01-19T05:17:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcfaceb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40b4900 con 0x7fdcf406a940 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf9288640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdcf409d9f0 0x7fdcf413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf3fff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdcf409d590 0x7fdcf413e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:53202/0 (socket says 172.21.15.157:53202) 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf8a87640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf409e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf3fff640 1 -- 172.21.15.157:0/2963998416 learned_addr learned my addr 172.21.15.157:0/2963998416 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf9288640 1 -- 172.21.15.157:0/2963998416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 msgr2=0x7fdcf409e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf9288640 1 --2- 172.21.15.157:0/2963998416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf409e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf9288640 1 -- 172.21.15.157:0/2963998416 >> v1:172.21.15.157:6789/0 conn(0x7fdcf409d590 legacy=0x7fdcf413e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf9288640 1 -- 172.21.15.157:0/2963998416 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf409cbe0 con 0x7fdcf409d9f0 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf37fe640 1 -- 172.21.15.157:0/2963998416 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877982192 0 0) 0x7fdcf40b4c10 con 0x7fdcf409d590 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.088+0000 7fdcf8a87640 1 --2- 172.21.15.157:0/2963998416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf409e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcf9288640 1 --2- 172.21.15.157:0/2963998416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf413ea00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdcf409cd70 tx=0x7fdce401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f18acfd55a7e1e1d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcf37fe640 1 -- 172.21.15.157:0/2963998416 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ad660 con 0x7fdcf409d9f0 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcf37fe640 1 -- 172.21.15.157:0/2963998416 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce40ad7c0 con 0x7fdcf409d9f0 2024-01-19T05:17:40.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcf37fe640 1 -- 172.21.15.157:0/2963998416 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40adb50 con 0x7fdcf409d9f0 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcfaceb640 1 -- 172.21.15.157:0/2963998416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 msgr2=0x7fdcf413ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcfaceb640 1 --2- 172.21.15.157:0/2963998416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf413ea00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdcf409cd70 tx=0x7fdce401c360 comp rx=0 tx=0).stop 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcfaceb640 1 -- 172.21.15.157:0/2963998416 shutdown_connections 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcfaceb640 1 --2- 172.21.15.157:0/2963998416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf413ea00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcfaceb640 1 --2- 172.21.15.157:0/2963998416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf409e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcfaceb640 1 -- 172.21.15.157:0/2963998416 >> 172.21.15.157:0/2963998416 conn(0x7fdcf4066ef0 msgr2=0x7fdcf40b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcfaceb640 1 -- 172.21.15.157:0/2963998416 shutdown_connections 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.092+0000 7fdcfaceb640 1 -- 172.21.15.157:0/2963998416 wait complete. 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 Processor -- start 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 -- start start 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf40af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcf409d590 0x7fdcf41deca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf41df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf41de850 con 0x7fdcf409d590 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40b1330 con 0x7fdcf409d9f0 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40b0580 con 0x7fdcf406a940 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf41df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf8a87640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf40af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf41df1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37632/0 (socket says 172.21.15.157:37632) 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 -- 172.21.15.157:0/3807849922 learned_addr learned my addr 172.21.15.157:0/3807849922 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 -- 172.21.15.157:0/3807849922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 msgr2=0x7fdcf40af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf3fff640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcf409d590 0x7fdcf41deca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf40af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 -- 172.21.15.157:0/3807849922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcf409d590 msgr2=0x7fdcf41deca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcf409d590 0x7fdcf41deca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 -- 172.21.15.157:0/3807849922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec009a70 con 0x7fdcf409d9f0 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf8a87640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf40af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf9288640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf41df1e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdce401aa10 tx=0x7fdce401aba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf17fa640 1 -- 172.21.15.157:0/3807849922 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4004230 con 0x7fdcf409d9f0 2024-01-19T05:17:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf17fa640 1 -- 172.21.15.157:0/3807849922 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4004390 con 0x7fdcf409d9f0 2024-01-19T05:17:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf17fa640 1 -- 172.21.15.157:0/3807849922 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40b9860 con 0x7fdcf409d9f0 2024-01-19T05:17:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce4009420 con 0x7fdcf409d9f0 2024-01-19T05:17:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf40b1610 con 0x7fdcf409d9f0 2024-01-19T05:17:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf17fa640 1 -- 172.21.15.157:0/3807849922 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fdce40b99c0 con 0x7fdcf409d9f0 2024-01-19T05:17:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcf17fa640 1 -- 172.21.15.157:0/3807849922 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdce4003bc0 con 0x7fdcf409d9f0 2024-01-19T05:17:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.096+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf41de9c0 con 0x7fdcf409d9f0 2024-01-19T05:17:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.100+0000 7fdcf17fa640 1 -- 172.21.15.157:0/3807849922 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fdce40b2070 con 0x7fdcf409d9f0 2024-01-19T05:17:40.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.164+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "774fc446-ece5-4d47-999b-c9fa2944406d", "id": 3} v 0) v1 -- 0x7fdcf40696e0 con 0x7fdcf409d9f0 2024-01-19T05:17:40.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.172+0000 7fdcf17fa640 1 -- 172.21.15.157:0/3807849922 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "774fc446-ece5-4d47-999b-c9fa2944406d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdce40ade30 con 0x7fdcf409d9f0 2024-01-19T05:17:40.174 INFO:teuthology.orchestra.run.smithi157.stdout:3 2024-01-19T05:17:40.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 msgr2=0x7fdcf41df1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf41df1e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdce401aa10 tx=0x7fdce401aba0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 shutdown_connections 2024-01-19T05:17:40.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcf409d9f0 0x7fdcf41df1e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcf409d590 0x7fdcf41deca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 --2- 172.21.15.157:0/3807849922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcf406a940 0x7fdcf40af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 >> 172.21.15.157:0/3807849922 conn(0x7fdcf4066ef0 msgr2=0x7fdcf41378f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:40.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 shutdown_connections 2024-01-19T05:17:40.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.176+0000 7fdcfaceb640 1 -- 172.21.15.157:0/3807849922 wait complete. 2024-01-19T05:17:40.190 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 833e0894-f106-4e5f-8155-3f87d376049e 4 2024-01-19T05:17:40.200 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.203+0000 7faac9cb8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-19T05:17:40.282 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.283+0000 7faac9cb8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-19T05:17:40.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.300+0000 7f0a9acd9640 1 Processor -- start 2024-01-19T05:17:40.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.300+0000 7f0a9acd9640 1 -- start start 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a9acd9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0a940aec10 0x7f0a94144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a9acd9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a940b3a10 0x7f0a9413cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a9acd9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a94143dc0 con 0x7f0a9406ccf0 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a9acd9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a940b3e60 con 0x7f0a940b3a10 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a9acd9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9406d0d0 con 0x7f0a940aec10 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a93fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0a940aec10 0x7f0a94144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a98a75640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0a9406ccf0 0x7f0a940ae500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:53204/0 (socket says 172.21.15.157:53204) 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a98a75640 1 -- 172.21.15.157:0/3408071615 learned_addr learned my addr 172.21.15.157:0/3408071615 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a99276640 1 --2- 172.21.15.157:0/3408071615 >> v2:172.21.15.99:3300/0 conn(0x7f0a940b3a10 0x7f0a9413cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a93fff640 1 -- 172.21.15.157:0/3408071615 >> v2:172.21.15.99:3300/0 conn(0x7f0a940b3a10 msgr2=0x7f0a9413cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a93fff640 1 --2- 172.21.15.157:0/3408071615 >> v2:172.21.15.99:3300/0 conn(0x7f0a940b3a10 0x7f0a9413cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a93fff640 1 -- 172.21.15.157:0/3408071615 >> v1:172.21.15.157:6789/0 conn(0x7f0a9406ccf0 legacy=0x7f0a940ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a937fe640 1 -- 172.21.15.157:0/3408071615 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776544306 0 0) 0x7f0a94143dc0 con 0x7f0a9406ccf0 2024-01-19T05:17:40.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a93fff640 1 -- 172.21.15.157:0/3408071615 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94143770 con 0x7f0a940aec10 2024-01-19T05:17:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.304+0000 7f0a93fff640 1 --2- 172.21.15.157:0/3408071615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a940aec10 0x7f0a94144250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0a9406ddd0 tx=0x7f0a8801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4902e3599561614 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a937fe640 1 -- 172.21.15.157:0/3408071615 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a880ac620 con 0x7f0a940aec10 2024-01-19T05:17:40.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a937fe640 1 -- 172.21.15.157:0/3408071615 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a880ac780 con 0x7f0a940aec10 2024-01-19T05:17:40.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a937fe640 1 -- 172.21.15.157:0/3408071615 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a880acb10 con 0x7f0a940aec10 2024-01-19T05:17:40.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- 172.21.15.157:0/3408071615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a940aec10 msgr2=0x7f0a94144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 --2- 172.21.15.157:0/3408071615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a940aec10 0x7f0a94144250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0a9406ddd0 tx=0x7f0a8801c3a0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- 172.21.15.157:0/3408071615 shutdown_connections 2024-01-19T05:17:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 --2- 172.21.15.157:0/3408071615 >> v2:172.21.15.99:3300/0 conn(0x7f0a940b3a10 0x7f0a9413cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 --2- 172.21.15.157:0/3408071615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a940aec10 0x7f0a94144250 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- 172.21.15.157:0/3408071615 >> 172.21.15.157:0/3408071615 conn(0x7f0a94066ef0 msgr2=0x7f0a940b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- 172.21.15.157:0/3408071615 shutdown_connections 2024-01-19T05:17:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- 172.21.15.157:0/3408071615 wait complete. 2024-01-19T05:17:40.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 Processor -- start 2024-01-19T05:17:40.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- start start 2024-01-19T05:17:40.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a9406ccf0 0x7f0a94137fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a940aec10 0x7f0a9406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a940b3a10 0x7f0a940703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94138ab0 con 0x7f0a940b3a10 2024-01-19T05:17:40.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9409de30 con 0x7f0a9406ccf0 2024-01-19T05:17:40.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94071bd0 con 0x7f0a940aec10 2024-01-19T05:17:40.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a9406ccf0 0x7f0a94137fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a9406ccf0 0x7f0a94137fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37648/0 (socket says 172.21.15.157:37648) 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a93fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a940aec10 0x7f0a9406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 -- 172.21.15.157:0/1782082027 learned_addr learned my addr 172.21.15.157:0/1782082027 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a99276640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a940b3a10 0x7f0a940703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 -- 172.21.15.157:0/1782082027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a940aec10 msgr2=0x7f0a9406fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a940aec10 0x7f0a9406fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 -- 172.21.15.157:0/1782082027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a940b3a10 msgr2=0x7f0a940703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a940b3a10 0x7f0a940703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 -- 172.21.15.157:0/1782082027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009420 con 0x7f0a9406ccf0 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a99276640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a940b3a10 0x7f0a940703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a98a75640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a9406ccf0 0x7f0a94137fb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0a800011f0 tx=0x7f0a8000c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a917fa640 1 -- 172.21.15.157:0/1782082027 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a800074e0 con 0x7f0a9406ccf0 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a917fa640 1 -- 172.21.15.157:0/1782082027 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80007640 con 0x7f0a9406ccf0 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94071eb0 con 0x7f0a9406ccf0 2024-01-19T05:17:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a917fa640 1 -- 172.21.15.157:0/1782082027 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80004a10 con 0x7f0a9406ccf0 2024-01-19T05:17:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.308+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a94072aa0 con 0x7f0a9406ccf0 2024-01-19T05:17:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.312+0000 7f0a917fa640 1 -- 172.21.15.157:0/1782082027 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f0a8001d440 con 0x7f0a9406ccf0 2024-01-19T05:17:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.312+0000 7f0a917fa640 1 -- 172.21.15.157:0/1782082027 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0a80012c30 con 0x7f0a9406ccf0 2024-01-19T05:17:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.312+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a940696e0 con 0x7f0a9406ccf0 2024-01-19T05:17:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.312+0000 7f0a917fa640 1 -- 172.21.15.157:0/1782082027 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f0a80018070 con 0x7f0a9406ccf0 2024-01-19T05:17:40.334 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.335+0000 7faac9cb8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-19T05:17:40.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.380+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "833e0894-f106-4e5f-8155-3f87d376049e", "id": 4} v 0) v1 -- 0x7f0a9409e140 con 0x7f0a9406ccf0 2024-01-19T05:17:40.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a917fa640 1 -- 172.21.15.157:0/1782082027 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "833e0894-f106-4e5f-8155-3f87d376049e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0a80012720 con 0x7f0a9406ccf0 2024-01-19T05:17:40.389 INFO:teuthology.orchestra.run.smithi157.stdout:4 2024-01-19T05:17:40.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a9406ccf0 msgr2=0x7f0a94137fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a9406ccf0 0x7f0a94137fb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0a800011f0 tx=0x7f0a8000c9b0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 shutdown_connections 2024-01-19T05:17:40.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a940b3a10 0x7f0a940703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0a940aec10 0x7f0a9406fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 --2- 172.21.15.157:0/1782082027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a9406ccf0 0x7f0a94137fb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 >> 172.21.15.157:0/1782082027 conn(0x7f0a94066ef0 msgr2=0x7f0a941415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:40.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 shutdown_connections 2024-01-19T05:17:40.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.388+0000 7f0a9acd9640 1 -- 172.21.15.157:0/1782082027 wait complete. 2024-01-19T05:17:40.396 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.396+0000 7f5bcd779180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-19T05:17:40.406 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new f6a00115-e637-45a7-9d24-5f5bb30e51d1 5 2024-01-19T05:17:40.411 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.411+0000 7faac9cb8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-19T05:17:40.452 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.452+0000 7f5bcd779180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-19T05:17:40.463 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.463+0000 7faac9cb8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-19T05:17:40.506 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.504+0000 7f5bcd779180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-19T05:17:40.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee918b640 1 Processor -- start 2024-01-19T05:17:40.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee918b640 1 -- start start 2024-01-19T05:17:40.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee918b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6ee4140c60 0x7f6ee41521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee918b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee40b7a40 con 0x7f6ee40b75b0 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee918b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee4149e20 con 0x7f6ee406ab40 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee918b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee406bfd0 con 0x7f6ee4140c60 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee359e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6ee4140c60 0x7f6ee41521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee2d9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6ee406ab40 0x7f6ee414a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:53216/0 (socket says 172.21.15.157:53216) 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee2d9d640 1 -- 172.21.15.157:0/3419045766 learned_addr learned my addr 172.21.15.157:0/3419045766 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee359e640 1 -- 172.21.15.157:0/3419045766 >> v1:172.21.15.157:6789/0 conn(0x7f6ee406ab40 legacy=0x7f6ee414a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee359e640 1 -- 172.21.15.157:0/3419045766 >> v1:172.21.15.99:6789/0 conn(0x7f6ee40b75b0 legacy=0x7f6ee4140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.520+0000 7f6ee359e640 1 -- 172.21.15.157:0/3419045766 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40ba020 con 0x7f6ee4140c60 2024-01-19T05:17:40.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee359e640 1 --2- 172.21.15.157:0/3419045766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee4140c60 0x7f6ee41521a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009d90 tx=0x7f6edc01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b35b560195b269 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:40.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee259c640 1 -- 172.21.15.157:0/3419045766 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0a5900 con 0x7f6ee4140c60 2024-01-19T05:17:40.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee259c640 1 -- 172.21.15.157:0/3419045766 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc0a5a60 con 0x7f6ee4140c60 2024-01-19T05:17:40.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee259c640 1 -- 172.21.15.157:0/3419045766 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0a5df0 con 0x7f6ee4140c60 2024-01-19T05:17:40.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- 172.21.15.157:0/3419045766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee4140c60 msgr2=0x7f6ee41521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 --2- 172.21.15.157:0/3419045766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee4140c60 0x7f6ee41521a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009d90 tx=0x7f6edc01c950 comp rx=0 tx=0).stop 2024-01-19T05:17:40.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- 172.21.15.157:0/3419045766 shutdown_connections 2024-01-19T05:17:40.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 --2- 172.21.15.157:0/3419045766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee4140c60 0x7f6ee41521a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- 172.21.15.157:0/3419045766 >> 172.21.15.157:0/3419045766 conn(0x7f6ee409e1a0 msgr2=0x7f6ee409e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:40.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- 172.21.15.157:0/3419045766 shutdown_connections 2024-01-19T05:17:40.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- 172.21.15.157:0/3419045766 wait complete. 2024-01-19T05:17:40.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 Processor -- start 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- start start 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee406ab40 0x7f6ee40a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ee40b75b0 0x7f6ee41399f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee4140c60 0x7f6ee4139f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee413cfe0 con 0x7f6ee4140c60 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee413b1e0 con 0x7f6ee406ab40 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee918b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40b64a0 con 0x7f6ee40b75b0 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee406ab40 0x7f6ee40a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6edbfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ee40b75b0 0x7f6ee41399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee406ab40 0x7f6ee40a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37666/0 (socket says 172.21.15.157:37666) 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.524+0000 7f6ee2d9d640 1 -- 172.21.15.157:0/754149480 learned_addr learned my addr 172.21.15.157:0/754149480 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:40.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee359e640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee4140c60 0x7f6ee4139f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee2d9d640 1 -- 172.21.15.157:0/754149480 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ee40b75b0 msgr2=0x7f6ee41399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee2d9d640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ee40b75b0 0x7f6ee41399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee2d9d640 1 -- 172.21.15.157:0/754149480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee4140c60 msgr2=0x7f6ee4139f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee2d9d640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee4140c60 0x7f6ee4139f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee2d9d640 1 -- 172.21.15.157:0/754149480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc009a70 con 0x7f6ee406ab40 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee359e640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee4140c60 0x7f6ee4139f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6edbfff640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ee40b75b0 0x7f6ee41399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee2d9d640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee406ab40 0x7f6ee40a0da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c500 tx=0x7f6ed400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6edb7fe640 1 -- 172.21.15.157:0/754149480 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4005cf0 con 0x7f6ee406ab40 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6edb7fe640 1 -- 172.21.15.157:0/754149480 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed4005e50 con 0x7f6ee406ab40 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee41443c0 con 0x7f6ee406ab40 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6edb7fe640 1 -- 172.21.15.157:0/754149480 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40072f0 con 0x7f6ee406ab40 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee413d4c0 con 0x7f6ee406ab40 2024-01-19T05:17:40.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6edb7fe640 1 -- 172.21.15.157:0/754149480 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f6ed401c440 con 0x7f6ee406ab40 2024-01-19T05:17:40.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6edb7fe640 1 -- 172.21.15.157:0/754149480 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6ed4012cf0 con 0x7f6ee406ab40 2024-01-19T05:17:40.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee40696e0 con 0x7f6ee406ab40 2024-01-19T05:17:40.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.528+0000 7f6edb7fe640 1 -- 172.21.15.157:0/754149480 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f6ed4021060 con 0x7f6ee406ab40 2024-01-19T05:17:40.539 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.539+0000 7faac9cb8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-19T05:17:40.585 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.584+0000 7f5bcd779180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-19T05:17:40.590 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.591+0000 7faac9cb8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-19T05:17:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.596+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f6a00115-e637-45a7-9d24-5f5bb30e51d1", "id": 5} v 0) v1 -- 0x7f6ee409fc30 con 0x7f6ee406ab40 2024-01-19T05:17:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6edb7fe640 1 -- 172.21.15.157:0/754149480 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f6a00115-e637-45a7-9d24-5f5bb30e51d1", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ed4017070 con 0x7f6ee406ab40 2024-01-19T05:17:40.603 INFO:teuthology.orchestra.run.smithi157.stdout:5 2024-01-19T05:17:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee406ab40 msgr2=0x7f6ee40a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee406ab40 0x7f6ee40a0da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c500 tx=0x7f6ed400c9c0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 shutdown_connections 2024-01-19T05:17:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee4140c60 0x7f6ee4139f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ee40b75b0 0x7f6ee41399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 --2- 172.21.15.157:0/754149480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ee406ab40 0x7f6ee40a0da0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 >> 172.21.15.157:0/754149480 conn(0x7f6ee409e1a0 msgr2=0x7f6ee40ba1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 shutdown_connections 2024-01-19T05:17:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.604+0000 7f6ee918b640 1 -- 172.21.15.157:0/754149480 wait complete. 2024-01-19T05:17:40.620 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 27988014-20fd-4bd0-86c1-41f6d45f2e13 6 2024-01-19T05:17:40.640 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.640+0000 7f5bcd779180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-19T05:17:40.719 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.720+0000 7f5bcd779180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-19T05:17:40.730 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.731+0000 7faac9cb8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-19T05:17:40.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0768b63640 1 Processor -- start 2024-01-19T05:17:40.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0768b63640 1 -- start start 2024-01-19T05:17:40.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0768b63640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f07640b9220 0x7f07640b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0768b63640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f07641464c0 0x7f0764146950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0768b63640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f07641400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0768b63640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640b29b0 con 0x7f07641464c0 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0768b63640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640afda0 con 0x7f07640b9220 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0768b63640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0764146e90 con 0x7f076413fcc0 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0762d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f07641400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f076259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f07640b9220 0x7f07640b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f076259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f07640b9220 0x7f07640b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37682/0 (socket says 172.21.15.157:37682) 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0762d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f07641400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:37948/0 (socket says 172.21.15.157:37948) 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f076259c640 1 -- 172.21.15.157:0/658767331 learned_addr learned my addr 172.21.15.157:0/658767331 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0761d9b640 1 --2- 172.21.15.157:0/658767331 >> v2:172.21.15.99:3300/0 conn(0x7f07641464c0 0x7f0764146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0762d9d640 1 -- 172.21.15.157:0/658767331 >> v2:172.21.15.157:3300/0 conn(0x7f07640b9220 msgr2=0x7f07640b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:40.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.736+0000 7f0762d9d640 1 --2- 172.21.15.157:0/658767331 >> v2:172.21.15.157:3300/0 conn(0x7f07640b9220 0x7f07640b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0762d9d640 1 -- 172.21.15.157:0/658767331 >> v2:172.21.15.99:3300/0 conn(0x7f07641464c0 msgr2=0x7f0764146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:40.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0762d9d640 1 --2- 172.21.15.157:0/658767331 >> v2:172.21.15.99:3300/0 conn(0x7f07641464c0 0x7f0764146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0762d9d640 1 -- 172.21.15.157:0/658767331 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640b9600 con 0x7f076413fcc0 2024-01-19T05:17:40.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f076259c640 1 --2- 172.21.15.157:0/658767331 >> v2:172.21.15.157:3300/0 conn(0x7f07640b9220 0x7f07640b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:17:40.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0762d9d640 1 --2- 172.21.15.157:0/658767331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f07641400f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07640b4b10 tx=0x7f075401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a835d857ad480986 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:40.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f076159a640 1 -- 172.21.15.157:0/658767331 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540ab600 con 0x7f076413fcc0 2024-01-19T05:17:40.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f076159a640 1 -- 172.21.15.157:0/658767331 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07540a7050 con 0x7f076413fcc0 2024-01-19T05:17:40.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f076159a640 1 -- 172.21.15.157:0/658767331 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540ab980 con 0x7f076413fcc0 2024-01-19T05:17:40.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 -- 172.21.15.157:0/658767331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 msgr2=0x7f07641400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 --2- 172.21.15.157:0/658767331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f07641400f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07640b4b10 tx=0x7f075401c3a0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 -- 172.21.15.157:0/658767331 shutdown_connections 2024-01-19T05:17:40.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 --2- 172.21.15.157:0/658767331 >> v2:172.21.15.99:3300/0 conn(0x7f07641464c0 0x7f0764146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 --2- 172.21.15.157:0/658767331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f07641400f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 --2- 172.21.15.157:0/658767331 >> v2:172.21.15.157:3300/0 conn(0x7f07640b9220 0x7f07640b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 -- 172.21.15.157:0/658767331 >> 172.21.15.157:0/658767331 conn(0x7f076406adf0 msgr2=0x7f07640b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:40.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 -- 172.21.15.157:0/658767331 shutdown_connections 2024-01-19T05:17:40.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.740+0000 7f0768b63640 1 -- 172.21.15.157:0/658767331 wait complete. 2024-01-19T05:17:40.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 Processor -- start 2024-01-19T05:17:40.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 -- start start 2024-01-19T05:17:40.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640b9220 0x7f0764136e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f076413d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07641464c0 0x7f07640b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076413d020 con 0x7f07640b9220 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0764146090 con 0x7f07641464c0 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076413da10 con 0x7f076413fcc0 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07641464c0 0x7f07640b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0761d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f076413d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07641464c0 0x7f07640b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37686/0 (socket says 172.21.15.157:37686) 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 -- 172.21.15.157:0/3894123562 learned_addr learned my addr 172.21.15.157:0/3894123562 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f076259c640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640b9220 0x7f0764136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 -- 172.21.15.157:0/3894123562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 msgr2=0x7f076413d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f076413d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 -- 172.21.15.157:0/3894123562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640b9220 msgr2=0x7f0764136e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640b9220 0x7f0764136e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 -- 172.21.15.157:0/3894123562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c00ac40 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f076259c640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640b9220 0x7f0764136e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0762d9d640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07641464c0 0x7f07640b6600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f07540ae040 tx=0x7f0754019140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0752ffd640 1 -- 172.21.15.157:0/3894123562 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540abe30 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0752ffd640 1 -- 172.21.15.157:0/3894123562 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07540b4430 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0754009420 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0752ffd640 1 -- 172.21.15.157:0/3894123562 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540b47c0 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07640b80d0 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0752ffd640 1 -- 172.21.15.157:0/3894123562 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f07540b2040 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0752ffd640 1 -- 172.21.15.157:0/3894123562 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f07540bedc0 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.744+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076413d1f0 con 0x7f07641464c0 2024-01-19T05:17:40.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.748+0000 7f0752ffd640 1 -- 172.21.15.157:0/3894123562 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f076413d1f0 con 0x7f07641464c0 2024-01-19T05:17:40.773 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.772+0000 7f5bcd779180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-19T05:17:40.790 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:40.791+0000 7faac9cb8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-19T05:17:40.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.816+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "27988014-20fd-4bd0-86c1-41f6d45f2e13", "id": 6} v 0) v1 -- 0x7f07640696e0 con 0x7f07641464c0 2024-01-19T05:17:40.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0752ffd640 1 -- 172.21.15.157:0/3894123562 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27988014-20fd-4bd0-86c1-41f6d45f2e13", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f07540b0070 con 0x7f07641464c0 2024-01-19T05:17:40.827 INFO:teuthology.orchestra.run.smithi157.stdout:6 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07641464c0 msgr2=0x7f07640b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07641464c0 0x7f07640b6600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f07540ae040 tx=0x7f0754019140 comp rx=0 tx=0).stop 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 shutdown_connections 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07641464c0 0x7f07640b6600 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f076413fcc0 0x7f076413d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 --2- 172.21.15.157:0/3894123562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640b9220 0x7f0764136e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 >> 172.21.15.157:0/3894123562 conn(0x7f076406adf0 msgr2=0x7f07640b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 shutdown_connections 2024-01-19T05:17:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:40.828+0000 7f0768b63640 1 -- 172.21.15.157:0/3894123562 wait complete. 2024-01-19T05:17:40.843 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new b421bd1f-4b28-447a-ac33-926bd9c2dca0 7 2024-01-19T05:17:40.918 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.916+0000 7f5bcd779180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-19T05:17:40.979 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:40.980+0000 7f5bcd779180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-19T05:17:41.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9cb20d640 1 Processor -- start 2024-01-19T05:17:41.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9cb20d640 1 -- start start 2024-01-19T05:17:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9cb20d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c406cc70 0x7fe9c4146b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9cb20d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe9c409bc20 0x7fe9c413d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9cb20d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c40ae6b0 con 0x7fe9c40b4a60 2024-01-19T05:17:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9cb20d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c40ae990 con 0x7fe9c409bc20 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9cb20d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c406d050 con 0x7fe9c406cc70 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c8fa9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c406cc70 0x7fe9c4146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c8fa9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c406cc70 0x7fe9c4146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:37966/0 (socket says 172.21.15.157:37966) 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c8fa9640 1 -- 172.21.15.157:0/59951923 learned_addr learned my addr 172.21.15.157:0/59951923 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c8fa9640 1 -- 172.21.15.157:0/59951923 >> v2:172.21.15.99:3300/0 conn(0x7fe9c409bc20 msgr2=0x7fe9c413d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c3fff640 1 --2- 172.21.15.157:0/59951923 >> v2:172.21.15.99:3300/0 conn(0x7fe9c409bc20 0x7fe9c413d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c8fa9640 1 --2- 172.21.15.157:0/59951923 >> v2:172.21.15.99:3300/0 conn(0x7fe9c409bc20 0x7fe9c413d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c8fa9640 1 -- 172.21.15.157:0/59951923 >> v1:172.21.15.99:6789/0 conn(0x7fe9c40b4a60 legacy=0x7fe9c40b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c8fa9640 1 -- 172.21.15.157:0/59951923 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c40afd40 con 0x7fe9c406cc70 2024-01-19T05:17:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.000+0000 7fe9c3fff640 1 --2- 172.21.15.157:0/59951923 >> v2:172.21.15.99:3300/0 conn(0x7fe9c409bc20 0x7fe9c413d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9c8fa9640 1 --2- 172.21.15.157:0/59951923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c406cc70 0x7fe9c4146b60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a843c7075272d6cf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9c37fe640 1 -- 172.21.15.157:0/59951923 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b00ac600 con 0x7fe9c406cc70 2024-01-19T05:17:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9c37fe640 1 -- 172.21.15.157:0/59951923 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b00a8050 con 0x7fe9c406cc70 2024-01-19T05:17:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9c37fe640 1 -- 172.21.15.157:0/59951923 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b00ac980 con 0x7fe9c406cc70 2024-01-19T05:17:41.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 -- 172.21.15.157:0/59951923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c406cc70 msgr2=0x7fe9c4146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 --2- 172.21.15.157:0/59951923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c406cc70 0x7fe9c4146b60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b001c4d0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 -- 172.21.15.157:0/59951923 shutdown_connections 2024-01-19T05:17:41.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 --2- 172.21.15.157:0/59951923 >> v2:172.21.15.99:3300/0 conn(0x7fe9c409bc20 0x7fe9c413d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 --2- 172.21.15.157:0/59951923 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c406cc70 0x7fe9c4146b60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 -- 172.21.15.157:0/59951923 >> 172.21.15.157:0/59951923 conn(0x7fe9c4066f90 msgr2=0x7fe9c40b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:41.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 -- 172.21.15.157:0/59951923 shutdown_connections 2024-01-19T05:17:41.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 -- 172.21.15.157:0/59951923 wait complete. 2024-01-19T05:17:41.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 Processor -- start 2024-01-19T05:17:41.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.004+0000 7fe9cb20d640 1 -- start start 2024-01-19T05:17:41.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9c406cc70 0x7fe9c40b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c409bc20 0x7fe9c409dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c40b4a60 0x7fe9c40b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40b1f00 con 0x7fe9c40b4a60 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40b0790 con 0x7fe9c406cc70 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40b1bd0 con 0x7fe9c409bc20 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c409bc20 0x7fe9c409dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c8fa9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9c406cc70 0x7fe9c40b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c409bc20 0x7fe9c409dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:37968/0 (socket says 172.21.15.157:37968) 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 -- 172.21.15.157:0/1108428665 learned_addr learned my addr 172.21.15.157:0/1108428665 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 -- 172.21.15.157:0/1108428665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9c406cc70 msgr2=0x7fe9c40b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9c406cc70 0x7fe9c40b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 -- 172.21.15.157:0/1108428665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c40b4a60 msgr2=0x7fe9c40b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c97aa640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c40b4a60 0x7fe9c40b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c40b4a60 0x7fe9c40b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 -- 172.21.15.157:0/1108428665 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00094d0 con 0x7fe9c409bc20 2024-01-19T05:17:41.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c8fa9640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9c406cc70 0x7fe9c40b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c97aa640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c40b4a60 0x7fe9c40b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c3fff640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c409bc20 0x7fe9c409dd10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c7f0 tx=0x7fe9b800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c17fa640 1 -- 172.21.15.157:0/1108428665 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800cea0 con 0x7fe9c409bc20 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c17fa640 1 -- 172.21.15.157:0/1108428665 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b8007a30 con 0x7fe9c409bc20 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c40af030 con 0x7fe9c409bc20 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c17fa640 1 -- 172.21.15.157:0/1108428665 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8007de0 con 0x7fe9c409bc20 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c40b04b0 con 0x7fe9c409bc20 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c17fa640 1 -- 172.21.15.157:0/1108428665 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fe9b80193f0 con 0x7fe9c409bc20 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9c17fa640 1 -- 172.21.15.157:0/1108428665 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe9b8011e10 con 0x7fe9c409bc20 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.008+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c4067850 con 0x7fe9c409bc20 2024-01-19T05:17:41.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.012+0000 7fe9c17fa640 1 -- 172.21.15.157:0/1108428665 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fe9b801e060 con 0x7fe9c409bc20 2024-01-19T05:17:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.076+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b421bd1f-4b28-447a-ac33-926bd9c2dca0", "id": 7} v 0) v1 -- 0x7fe9c406dc90 con 0x7fe9c409bc20 2024-01-19T05:17:41.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9c17fa640 1 -- 172.21.15.157:0/1108428665 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b421bd1f-4b28-447a-ac33-926bd9c2dca0", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe9b80117b0 con 0x7fe9c409bc20 2024-01-19T05:17:41.085 INFO:teuthology.orchestra.run.smithi157.stdout:7 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c409bc20 msgr2=0x7fe9c409dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c409bc20 0x7fe9c409dd10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c7f0 tx=0x7fe9b800ccb0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 shutdown_connections 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c40b4a60 0x7fe9c40b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9c409bc20 0x7fe9c409dd10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 --2- 172.21.15.157:0/1108428665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9c406cc70 0x7fe9c40b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 >> 172.21.15.157:0/1108428665 conn(0x7fe9c4066f90 msgr2=0x7fe9c40b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 shutdown_connections 2024-01-19T05:17:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-01-19T05:17:41.084+0000 7fe9cb20d640 1 -- 172.21.15.157:0/1108428665 wait complete. 2024-01-19T05:17:41.101 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-19T05:17:41.102 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-19T05:17:41.104 INFO:tasks.ceph.osd.0:Started 2024-01-19T05:17:41.104 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-19T05:17:41.104 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-19T05:17:41.107 INFO:tasks.ceph.osd.1:Started 2024-01-19T05:17:41.107 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-19T05:17:41.107 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-19T05:17:41.109 INFO:tasks.ceph.osd.2:Started 2024-01-19T05:17:41.109 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-19T05:17:41.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-19T05:17:41.111 INFO:tasks.ceph.osd.3:Started 2024-01-19T05:17:41.111 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-19T05:17:41.111 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-19T05:17:41.144 INFO:tasks.ceph.osd.4:Started 2024-01-19T05:17:41.144 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-19T05:17:41.144 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-19T05:17:41.146 INFO:tasks.ceph.osd.5:Started 2024-01-19T05:17:41.146 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-19T05:17:41.146 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-19T05:17:41.148 INFO:tasks.ceph.osd.6:Started 2024-01-19T05:17:41.148 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-19T05:17:41.148 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-19T05:17:41.152 INFO:tasks.ceph.osd.7:Started 2024-01-19T05:17:41.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:17:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4569f61640 1 Processor -- start 2024-01-19T05:17:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4569f61640 1 -- start start 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4569f61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45640b96f0 0x7f45640b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4569f61640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4564140e90 0x7f45641511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4569f61640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45640b87f0 con 0x7f45640b7c40 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4569f61640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45640b9ad0 con 0x7f4564140e90 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4569f61640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45640b81e0 con 0x7f45640b96f0 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f455affd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f45640b7c40 0x7f4564140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53886/0 (socket says 172.21.15.99:53886) 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f455affd640 1 -- 172.21.15.99:0/636904601 learned_addr learned my addr 172.21.15.99:0/636904601 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f45637fe640 1 --2- 172.21.15.99:0/636904601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45640b96f0 0x7f45640b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4563fff640 1 --2- 172.21.15.99:0/636904601 >> v2:172.21.15.157:3300/0 conn(0x7f4564140e90 0x7f45641511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4562ffd640 1 -- 172.21.15.99:0/636904601 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616499153 0 0) 0x7f45640b87f0 con 0x7f45640b7c40 2024-01-19T05:17:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4562ffd640 1 -- 172.21.15.99:0/636904601 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4550003530 con 0x7f45640b7c40 2024-01-19T05:17:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f45637fe640 1 -- 172.21.15.99:0/636904601 >> v2:172.21.15.157:3300/0 conn(0x7f4564140e90 msgr2=0x7f45641511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f45637fe640 1 --2- 172.21.15.99:0/636904601 >> v2:172.21.15.157:3300/0 conn(0x7f4564140e90 0x7f45641511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f45637fe640 1 -- 172.21.15.99:0/636904601 >> v1:172.21.15.99:6789/0 conn(0x7f45640b7c40 legacy=0x7f4564140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4562ffd640 1 -- 172.21.15.99:0/636904601 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1033710392 0 0) 0x7f4550003530 con 0x7f45640b7c40 2024-01-19T05:17:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f45637fe640 1 -- 172.21.15.99:0/636904601 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456406ba20 con 0x7f45640b96f0 2024-01-19T05:17:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.295+0000 7f4563fff640 1 --2- 172.21.15.99:0/636904601 >> v2:172.21.15.157:3300/0 conn(0x7f4564140e90 0x7f45641511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:17:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f45637fe640 1 --2- 172.21.15.99:0/636904601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45640b96f0 0x7f45640b7700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45540097c0 tx=0x7f455401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c92bae4784bb38 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4562ffd640 1 -- 172.21.15.99:0/636904601 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c001680 con 0x7f45640b96f0 2024-01-19T05:17:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4562ffd640 1 -- 172.21.15.99:0/636904601 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45540a7050 con 0x7f45640b96f0 2024-01-19T05:17:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4562ffd640 1 -- 172.21.15.99:0/636904601 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540ab620 con 0x7f45640b96f0 2024-01-19T05:17:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- 172.21.15.99:0/636904601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45640b96f0 msgr2=0x7f45640b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 --2- 172.21.15.99:0/636904601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45640b96f0 0x7f45640b7700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45540097c0 tx=0x7f455401c370 comp rx=0 tx=0).stop 2024-01-19T05:17:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- 172.21.15.99:0/636904601 shutdown_connections 2024-01-19T05:17:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 --2- 172.21.15.99:0/636904601 >> v2:172.21.15.157:3300/0 conn(0x7f4564140e90 0x7f45641511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 --2- 172.21.15.99:0/636904601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f45640b96f0 0x7f45640b7700 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- 172.21.15.99:0/636904601 >> 172.21.15.99:0/636904601 conn(0x7f456409e600 msgr2=0x7f45640b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- 172.21.15.99:0/636904601 shutdown_connections 2024-01-19T05:17:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- 172.21.15.99:0/636904601 wait complete. 2024-01-19T05:17:41.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 Processor -- start 2024-01-19T05:17:41.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- start start 2024-01-19T05:17:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45640b7c40 0x7f4564146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45640b96f0 0x7f4564147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4564140e90 0x7f4564148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4564147a80 con 0x7f45640b7c40 2024-01-19T05:17:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45640b4770 con 0x7f45640b96f0 2024-01-19T05:17:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.299+0000 7f4569f61640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456414a8a0 con 0x7f4564140e90 2024-01-19T05:17:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45640b7c40 0x7f4564146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45640b7c40 0x7f4564146a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51842/0 (socket says 172.21.15.99:51842) 2024-01-19T05:17:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 -- 172.21.15.99:0/3725655289 learned_addr learned my addr 172.21.15.99:0/3725655289 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f455affd640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45640b96f0 0x7f4564147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4563fff640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4564140e90 0x7f4564148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 -- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4564140e90 msgr2=0x7f4564148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4564140e90 0x7f4564148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 -- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45640b96f0 msgr2=0x7f4564147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45640b96f0 0x7f4564147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 -- 172.21.15.99:0/3725655289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c009a70 con 0x7f45640b7c40 2024-01-19T05:17:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4563fff640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4564140e90 0x7f4564148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:17:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f45637fe640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45640b7c40 0x7f4564146a50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f45540ae040 tx=0x7f4554019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4560ff9640 1 -- 172.21.15.99:0/3725655289 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540b4430 con 0x7f45640b7c40 2024-01-19T05:17:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4560ff9640 1 -- 172.21.15.99:0/3725655289 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45540b45b0 con 0x7f45640b7c40 2024-01-19T05:17:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4554009420 con 0x7f45640b7c40 2024-01-19T05:17:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4560ff9640 1 -- 172.21.15.99:0/3725655289 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540b4960 con 0x7f45640b7c40 2024-01-19T05:17:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4564147620 con 0x7f45640b7c40 2024-01-19T05:17:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4560ff9640 1 -- 172.21.15.99:0/3725655289 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f45540b2040 con 0x7f45640b7c40 2024-01-19T05:17:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4560ff9640 1 -- 172.21.15.99:0/3725655289 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f45540bda90 con 0x7f45640b7c40 2024-01-19T05:17:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.303+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456414a700 con 0x7f45640b7c40 2024-01-19T05:17:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.311+0000 7f4560ff9640 1 -- 172.21.15.99:0/3725655289 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f456414a700 con 0x7f45640b7c40 2024-01-19T05:17:41.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.367+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45640696e0 con 0x7f45640b7c40 2024-01-19T05:17:41.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.367+0000 7f4560ff9640 1 -- 172.21.15.99:0/3725655289 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f45540cd090 con 0x7f45640b7c40 2024-01-19T05:17:41.368 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:41.368 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":10,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:17:41.084449+0000","last_up_change":"0.000000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45640b7c40 msgr2=0x7f4564146a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45640b7c40 0x7f4564146a50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f45540ae040 tx=0x7f4554019110 comp rx=0 tx=0).stop 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 shutdown_connections 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4564140e90 0x7f4564148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45640b96f0 0x7f4564147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 --2- 172.21.15.99:0/3725655289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45640b7c40 0x7f4564146a50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 >> 172.21.15.99:0/3725655289 conn(0x7f456409e600 msgr2=0x7f45640b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 shutdown_connections 2024-01-19T05:17:41.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:41.371+0000 7f4569f61640 1 -- 172.21.15.99:0/3725655289 wait complete. 2024-01-19T05:17:41.385 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-19T05:17:41.386 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-19T05:17:41.466 INFO:tasks.ceph.mgr.y.smithi099.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-19T05:17:41.466 INFO:tasks.ceph.mgr.y.smithi099.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-19T05:17:41.466 INFO:tasks.ceph.mgr.y.smithi099.stderr: from numpy import show_config as show_numpy_config 2024-01-19T05:17:41.520 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:41.519+0000 7faac9cb8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-19T05:17:41.606 INFO:tasks.ceph.mgr.x.smithi157.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-19T05:17:41.606 INFO:tasks.ceph.mgr.x.smithi157.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-19T05:17:41.607 INFO:tasks.ceph.mgr.x.smithi157.stderr: from numpy import show_config as show_numpy_config 2024-01-19T05:17:41.654 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:41.655+0000 7faac9cb8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-19T05:17:41.671 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:41.672+0000 7f5bcd779180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-19T05:17:41.763 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-01-19T05:17:41.763+0000 7f1747c37640 -1 Falling back to public interface 2024-01-19T05:17:41.776 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-01-19T05:17:41.776+0000 7f9467203640 -1 Falling back to public interface 2024-01-19T05:17:41.777 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-01-19T05:17:41.776+0000 7f14d58a0640 -1 Falling back to public interface 2024-01-19T05:17:41.777 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-01-19T05:17:41.776+0000 7f9cbabca640 -1 Falling back to public interface 2024-01-19T05:17:41.777 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-01-19T05:17:41.776+0000 7f57c1f7d640 -1 Falling back to public interface 2024-01-19T05:17:41.778 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-01-19T05:17:41.779+0000 7f97dc7ff640 -1 Falling back to public interface 2024-01-19T05:17:41.778 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-01-19T05:17:41.779+0000 7f7f97a13640 -1 Falling back to public interface 2024-01-19T05:17:41.785 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-01-19T05:17:41.787+0000 7f5d8d0f0640 -1 Falling back to public interface 2024-01-19T05:17:41.829 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:41.831+0000 7faac9cb8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-19T05:17:41.842 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:41.840+0000 7f5bcd779180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-19T05:17:41.898 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:41.899+0000 7faac9cb8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-19T05:17:42.018 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:42.016+0000 7f5bcd779180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-19T05:17:42.024 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:42.023+0000 7faac9cb8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-19T05:17:42.085 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:42.084+0000 7f5bcd779180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-19T05:17:42.192 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T05:17:42.220 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:42.220+0000 7f5bcd779180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-19T05:17:42.300 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.299+0000 7f1041606640 1 Processor -- start 2024-01-19T05:17:42.300 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.299+0000 7f1041606640 1 -- start start 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1041606640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 0x7f103c147290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1041606640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0adfd0 con 0x7f103c146eb0 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1041606640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0aed80 con 0x7f103c0b52d0 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1041606640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c13def0 con 0x7f103c0723b0 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103affd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f103c146eb0 0x7f103c0af1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32820/0 (socket says 172.21.15.99:32820) 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103affd640 1 -- 172.21.15.99:0/2676671207 learned_addr learned my addr 172.21.15.99:0/2676671207 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103b7fe640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 0x7f103c147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765407269 0 0) 0x7f103c0adfd0 con 0x7f103c146eb0 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1024003530 con 0x7f103c146eb0 2024-01-19T05:17:42.303 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3339918105 0 0) 0x7f1024003530 con 0x7f103c146eb0 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 msgr2=0x7f103c147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 0x7f103c147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 >> v1:172.21.15.157:6789/0 conn(0x7f103c0b52d0 legacy=0x7f103c09e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c0ae220 con 0x7f103c146eb0 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f102c001680 con 0x7f103c146eb0 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 >> v1:172.21.15.99:6789/0 conn(0x7f103c146eb0 legacy=0x7f103c0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 0x7f10240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1024003f80 0x7f10240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1024004d10 0x7f1024005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c13def0 con 0x7f1024003f80 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102400bb80 con 0x7f1024004d10 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102400bd40 con 0x7f103c0723b0 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103a7fc640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1024003f80 0x7f10240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:42.304 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103affd640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 0x7f10240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:42.305 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103b7fe640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1024004d10 0x7f1024005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:42.305 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103a7fc640 1 -- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 msgr2=0x7f10240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:42.305 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103a7fc640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 0x7f10240039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.305 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103a7fc640 1 -- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1024004d10 msgr2=0x7f1024005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:42.305 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103a7fc640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1024004d10 0x7f1024005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.305 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103a7fc640 1 -- 172.21.15.99:0/2676671207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024003530 con 0x7f1024003f80 2024-01-19T05:17:42.305 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103affd640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c0723b0 0x7f10240039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:17:42.308 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f103a7fc640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1024003f80 0x7f10240047d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1030001780 tx=0x7f103001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7ea2c515e68ad5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:42.308 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10300052d0 con 0x7f1024003f80 2024-01-19T05:17:42.308 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10300a7050 con 0x7f1024003f80 2024-01-19T05:17:42.308 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.303+0000 7f1039ffb640 1 -- 172.21.15.99:0/2676671207 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030003600 con 0x7f1024003f80 2024-01-19T05:17:42.308 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- 172.21.15.99:0/2676671207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1024003f80 msgr2=0x7f10240047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:42.308 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 --2- 172.21.15.99:0/2676671207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1024003f80 0x7f10240047d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1030001780 tx=0x7f103001c3a0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103b7fe640 1 -- 172.21.15.99:0/2676671207 reap_dead start 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- 172.21.15.99:0/2676671207 shutdown_connections 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- 172.21.15.99:0/2676671207 >> 172.21.15.99:0/2676671207 conn(0x7f103c0b5ab0 msgr2=0x7f103c0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- 172.21.15.99:0/2676671207 shutdown_connections 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- 172.21.15.99:0/2676671207 wait complete. 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 Processor -- start 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- start start 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f103c137190 0x7f103c1dd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f103c1dd560 0x7f103c1e0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c1e0ad0 0x7f103c1e0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c137570 con 0x7f103c1dd560 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0b2650 con 0x7f103c137190 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c13af40 con 0x7f103c1e0ad0 2024-01-19T05:17:42.309 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f103c1dd560 0x7f103c1e0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f103c1dd560 0x7f103c1e0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60904/0 (socket says 172.21.15.99:60904) 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 -- 172.21.15.99:0/2618534749 learned_addr learned my addr 172.21.15.99:0/2618534749 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103b7fe640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c1e0ad0 0x7f103c1e0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103affd640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f103c137190 0x7f103c1dd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 -- 172.21.15.99:0/2618534749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c1e0ad0 msgr2=0x7f103c1e0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c1e0ad0 0x7f103c1e0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 -- 172.21.15.99:0/2618534749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f103c137190 msgr2=0x7f103c1dd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f103c137190 0x7f103c1dd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 -- 172.21.15.99:0/2618534749 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c13b260 con 0x7f103c1dd560 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f103a7fc640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f103c1dd560 0x7f103c1e0590 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1030000c10 tx=0x7f1024005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f10237fe640 1 -- 172.21.15.99:0/2618534749 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030007220 con 0x7f103c1dd560 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f10237fe640 1 -- 172.21.15.99:0/2618534749 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1030007380 con 0x7f103c1dd560 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c137d90 con 0x7f103c1dd560 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f10237fe640 1 -- 172.21.15.99:0/2618534749 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10300067e0 con 0x7f103c1dd560 2024-01-19T05:17:42.310 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c1dd980 con 0x7f103c1dd560 2024-01-19T05:17:42.311 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f10237fe640 1 -- 172.21.15.99:0/2618534749 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f1030006940 con 0x7f103c1dd560 2024-01-19T05:17:42.311 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f10237fe640 1 -- 172.21.15.99:0/2618534749 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1030003da0 con 0x7f103c1dd560 2024-01-19T05:17:42.311 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.307+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c13ad80 con 0x7f103c1dd560 2024-01-19T05:17:42.311 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.311+0000 7f10237fe640 1 -- 172.21.15.99:0/2618534749 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f10300c1060 con 0x7f103c1dd560 2024-01-19T05:17:42.364 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.363+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f103c0b2f90 con 0x7f103c1dd560 2024-01-19T05:17:42.364 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.363+0000 7f10237fe640 1 -- 172.21.15.99:0/2618534749 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f10300ca090 con 0x7f103c1dd560 2024-01-19T05:17:42.364 INFO:teuthology.misc.health.smithi099.stdout: 2024-01-19T05:17:42.365 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":10,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:17:41.084449+0000","last_up_change":"0.000000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:17:42.365 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f103c1dd560 msgr2=0x7f103c1e0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:42.366 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f103c1dd560 0x7f103c1e0590 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1030000c10 tx=0x7f1024005800 comp rx=0 tx=0).stop 2024-01-19T05:17:42.366 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 shutdown_connections 2024-01-19T05:17:42.366 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f103c1e0ad0 0x7f103c1e0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.366 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f103c1dd560 0x7f103c1e0590 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.366 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 --2- 172.21.15.99:0/2618534749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f103c137190 0x7f103c1dd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:42.366 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 >> 172.21.15.99:0/2618534749 conn(0x7f103c0b5ab0 msgr2=0x7f103c0b85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:42.366 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 shutdown_connections 2024-01-19T05:17:42.366 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:42.367+0000 7f1041606640 1 -- 172.21.15.99:0/2618534749 wait complete. 2024-01-19T05:17:42.379 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-19T05:17:42.635 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:42.635+0000 7faac9cb8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-19T05:17:42.710 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:42.711+0000 7faac9cb8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-19T05:17:42.867 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:42.868+0000 7f5bcd779180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-19T05:17:42.881 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:42.883+0000 7faac9cb8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-19T05:17:42.941 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:42.940+0000 7f5bcd779180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-19T05:17:42.955 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:42.955+0000 7faac9cb8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-19T05:17:43.111 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:43.112+0000 7f5bcd779180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-19T05:17:43.183 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:43.184+0000 7f5bcd779180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-19T05:17:43.243 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:43.243+0000 7faac9cb8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-19T05:17:43.304 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:43.307+0000 7faac9cb8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-19T05:17:43.475 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:43.476+0000 7f5bcd779180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-19T05:17:43.537 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-01-19T05:17:43.536+0000 7f5bcd779180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-19T05:17:44.350 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:44.351+0000 7faa71509640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-19T05:17:44.351 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-01-19T05:17:44.351+0000 7faa71509640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-19T05:17:45.590 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-01-19T05:17:45.588+0000 7f9cbabca640 -1 osd.5 0 log_to_monitors true 2024-01-19T05:17:45.606 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-01-19T05:17:45.607+0000 7f7f97a13640 -1 osd.1 0 log_to_monitors true 2024-01-19T05:17:45.606 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-01-19T05:17:45.607+0000 7f1747c37640 -1 osd.0 0 log_to_monitors true 2024-01-19T05:17:45.698 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-01-19T05:17:45.696+0000 7f14d58a0640 -1 osd.4 0 log_to_monitors true 2024-01-19T05:17:45.714 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-01-19T05:17:45.712+0000 7f57c1f7d640 -1 osd.6 0 log_to_monitors true 2024-01-19T05:17:45.726 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-01-19T05:17:45.727+0000 7f5d8d0f0640 -1 osd.2 0 log_to_monitors true 2024-01-19T05:17:45.732 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-01-19T05:17:45.732+0000 7f9467203640 -1 osd.7 0 log_to_monitors true 2024-01-19T05:17:45.738 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-01-19T05:17:45.739+0000 7f97dc7ff640 -1 osd.3 0 log_to_monitors true 2024-01-19T05:17:48.904 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-01-19T05:17:48.904+0000 7f57bd703640 -1 osd.6 0 waiting for initial osdmap 2024-01-19T05:17:48.931 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-01-19T05:17:48.932+0000 7f57b5d50640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T05:17:48.972 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-01-19T05:17:48.972+0000 7f9cb7b86640 -1 osd.5 0 waiting for initial osdmap 2024-01-19T05:17:48.991 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-01-19T05:17:48.992+0000 7f94641bf640 -1 osd.7 0 waiting for initial osdmap 2024-01-19T05:17:48.991 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-01-19T05:17:48.992+0000 7f14d285c640 -1 osd.4 0 waiting for initial osdmap 2024-01-19T05:17:48.995 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-01-19T05:17:48.996+0000 7f9cae99d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T05:17:49.015 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-01-19T05:17:49.016+0000 7f945afd6640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T05:17:49.019 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-01-19T05:17:49.020+0000 7f14c9673640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T05:17:49.187 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T05:17:49.355 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.355+0000 7f009940c640 1 Processor -- start 2024-01-19T05:17:49.356 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.355+0000 7f009940c640 1 -- start start 2024-01-19T05:17:49.356 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.355+0000 7f009940c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f00940b3a30 0x7f00940af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:49.356 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f009940c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f0094147060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:49.356 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f009940c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00941475a0 0x7f009406b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:49.357 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f009940c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009409d400 con 0x7f00941475a0 2024-01-19T05:17:49.357 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f009940c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009406d270 con 0x7f00940b3a30 2024-01-19T05:17:49.357 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f009940c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009406cd90 con 0x7f00940af800 2024-01-19T05:17:49.357 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f008bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f0094147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:49.357 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f008bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f0094147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:40382/0 (socket says 172.21.15.99:40382) 2024-01-19T05:17:49.358 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f008bfff640 1 -- 172.21.15.99:0/640446972 learned_addr learned my addr 172.21.15.99:0/640446972 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:49.358 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f008bfff640 1 -- 172.21.15.99:0/640446972 >> v2:172.21.15.157:3300/0 conn(0x7f00940b3a30 msgr2=0x7f00940af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:49.358 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f0092ffd640 1 --2- 172.21.15.99:0/640446972 >> v2:172.21.15.157:3300/0 conn(0x7f00940b3a30 0x7f00940af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:49.359 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f008bfff640 1 --2- 172.21.15.99:0/640446972 >> v2:172.21.15.157:3300/0 conn(0x7f00940b3a30 0x7f00940af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.359 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f008bfff640 1 -- 172.21.15.99:0/640446972 >> v2:172.21.15.99:3300/0 conn(0x7f00941475a0 msgr2=0x7f009406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:49.359 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f00937fe640 1 --2- 172.21.15.99:0/640446972 >> v2:172.21.15.99:3300/0 conn(0x7f00941475a0 0x7f009406b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:49.359 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f008bfff640 1 --2- 172.21.15.99:0/640446972 >> v2:172.21.15.99:3300/0 conn(0x7f00941475a0 0x7f009406b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.359 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f008bfff640 1 -- 172.21.15.99:0/640446972 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940b3e10 con 0x7f00940af800 2024-01-19T05:17:49.360 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f0092ffd640 1 --2- 172.21.15.99:0/640446972 >> v2:172.21.15.157:3300/0 conn(0x7f00940b3a30 0x7f00940af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:49.360 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.359+0000 7f00937fe640 1 --2- 172.21.15.99:0/640446972 >> v2:172.21.15.99:3300/0 conn(0x7f00941475a0 0x7f009406b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:49.363 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.363+0000 7f008bfff640 1 --2- 172.21.15.99:0/640446972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f0094147060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0094072da0 tx=0x7f007c01c180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d7a7986119d29d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:49.364 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.363+0000 7f00927fc640 1 -- 172.21.15.99:0/640446972 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c0ab400 con 0x7f00940af800 2024-01-19T05:17:49.364 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.363+0000 7f00927fc640 1 -- 172.21.15.99:0/640446972 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c0a7050 con 0x7f00940af800 2024-01-19T05:17:49.364 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.363+0000 7f00927fc640 1 -- 172.21.15.99:0/640446972 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c0ab780 con 0x7f00940af800 2024-01-19T05:17:49.365 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.367+0000 7f009940c640 1 -- 172.21.15.99:0/640446972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 msgr2=0x7f0094147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:49.365 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.367+0000 7f009940c640 1 --2- 172.21.15.99:0/640446972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f0094147060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0094072da0 tx=0x7f007c01c180 comp rx=0 tx=0).stop 2024-01-19T05:17:49.365 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.367+0000 7f009940c640 1 -- 172.21.15.99:0/640446972 shutdown_connections 2024-01-19T05:17:49.365 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.367+0000 7f009940c640 1 --2- 172.21.15.99:0/640446972 >> v2:172.21.15.99:3300/0 conn(0x7f00941475a0 0x7f009406b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.365 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.367+0000 7f009940c640 1 --2- 172.21.15.99:0/640446972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f0094147060 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.365 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.367+0000 7f009940c640 1 --2- 172.21.15.99:0/640446972 >> v2:172.21.15.157:3300/0 conn(0x7f00940b3a30 0x7f00940af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.365 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.367+0000 7f009940c640 1 -- 172.21.15.99:0/640446972 >> 172.21.15.99:0/640446972 conn(0x7f00940b48c0 msgr2=0x7f00940b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:49.370 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.371+0000 7f009940c640 1 -- 172.21.15.99:0/640446972 shutdown_connections 2024-01-19T05:17:49.370 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.371+0000 7f009940c640 1 -- 172.21.15.99:0/640446972 wait complete. 2024-01-19T05:17:49.371 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.371+0000 7f009940c640 1 Processor -- start 2024-01-19T05:17:49.373 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.371+0000 7f009940c640 1 -- start start 2024-01-19T05:17:49.373 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f009940c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f009414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:49.373 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f009940c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940b3a30 0x7f009409ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:49.373 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f009940c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00941475a0 0x7f009414bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:49.373 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f009940c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094149e70 con 0x7f00940b3a30 2024-01-19T05:17:49.373 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f009940c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009414ebf0 con 0x7f00941475a0 2024-01-19T05:17:49.373 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f009940c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009414c290 con 0x7f00940af800 2024-01-19T05:17:49.374 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f009414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:49.374 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f009414a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:40398/0 (socket says 172.21.15.99:40398) 2024-01-19T05:17:49.374 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 -- 172.21.15.99:0/103978830 learned_addr learned my addr 172.21.15.99:0/103978830 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:49.374 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f008bfff640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940b3a30 0x7f009409ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:49.374 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f00937fe640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00941475a0 0x7f009414bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:49.374 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 -- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00941475a0 msgr2=0x7f009414bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:49.375 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00941475a0 0x7f009414bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.375 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 -- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940b3a30 msgr2=0x7f009409ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:49.375 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940b3a30 0x7f009409ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.375 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 -- 172.21.15.99:0/103978830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c0094d0 con 0x7f00940af800 2024-01-19T05:17:49.375 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f00937fe640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00941475a0 0x7f009414bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:49.375 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f008bfff640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940b3a30 0x7f009409ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:17:49.376 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f0092ffd640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f009414a2a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f008400cf90 tx=0x7f008400a7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:49.376 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f008b7fe640 1 -- 172.21.15.99:0/103978830 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400d840 con 0x7f00940af800 2024-01-19T05:17:49.376 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009414c560 con 0x7f00940af800 2024-01-19T05:17:49.376 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009414b6c0 con 0x7f00940af800 2024-01-19T05:17:49.376 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f008b7fe640 1 -- 172.21.15.99:0/103978830 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008400d9a0 con 0x7f00940af800 2024-01-19T05:17:49.376 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.375+0000 7f008b7fe640 1 -- 172.21.15.99:0/103978830 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400dd30 con 0x7f00940af800 2024-01-19T05:17:49.377 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.379+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00780052a0 con 0x7f00940af800 2024-01-19T05:17:49.378 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.379+0000 7f008b7fe640 1 -- 172.21.15.99:0/103978830 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7f008401e3b0 con 0x7f00940af800 2024-01-19T05:17:49.378 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.379+0000 7f008b7fe640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0074066470 0x7f0074068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:49.379 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.379+0000 7f008b7fe640 1 -- 172.21.15.99:0/103978830 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f00840839c0 con 0x7f00940af800 2024-01-19T05:17:49.379 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.379+0000 7f008bfff640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0074066470 0x7f0074068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:49.379 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.379+0000 7f008bfff640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0074066470 0x7f0074068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f007c0ad000 tx=0x7f007c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:49.392 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.391+0000 7f008b7fe640 1 -- 172.21.15.99:0/103978830 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0084051b70 con 0x7f00940af800 2024-01-19T05:17:49.542 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-01-19T05:17:49.543+0000 7f5d88876640 -1 osd.2 0 waiting for initial osdmap 2024-01-19T05:17:49.554 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-01-19T05:17:49.555+0000 7f7f93199640 -1 osd.1 0 waiting for initial osdmap 2024-01-19T05:17:49.569 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-01-19T05:17:49.571+0000 7f5d80ec3640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T05:17:49.574 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-01-19T05:17:49.575+0000 7f1744bf3640 -1 osd.0 0 waiting for initial osdmap 2024-01-19T05:17:49.585 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-01-19T05:17:49.587+0000 7f7f8b7e6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T05:17:49.610 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-01-19T05:17:49.611+0000 7f97d7f85640 -1 osd.3 0 waiting for initial osdmap 2024-01-19T05:17:49.617 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-01-19T05:17:49.619+0000 7f173ba0a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T05:17:49.637 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-01-19T05:17:49.639+0000 7f97d05d2640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-19T05:17:49.641 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.643+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0078005550 con 0x7f00940af800 2024-01-19T05:17:49.643 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.643+0000 7f008b7fe640 1 -- 172.21.15.99:0/103978830 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f008401a070 con 0x7f00940af800 2024-01-19T05:17:49.643 INFO:teuthology.misc.health.smithi099.stdout: 2024-01-19T05:17:49.643 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":12,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:17:47.353726+0000","last_up_change":"0.000000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:17:49.645 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0074066470 msgr2=0x7f0074068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:49.645 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0074066470 0x7f0074068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f007c0ad000 tx=0x7f007c0a6000 comp rx=0 tx=0).stop 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 msgr2=0x7f009414a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f009414a2a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f008400cf90 tx=0x7f008400a7d0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 shutdown_connections 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0074066470 0x7f0074068930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00941475a0 0x7f009414bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00940b3a30 0x7f009409ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 --2- 172.21.15.99:0/103978830 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00940af800 0x7f009414a2a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 >> 172.21.15.99:0/103978830 conn(0x7f00940b48c0 msgr2=0x7f00941484e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 shutdown_connections 2024-01-19T05:17:49.646 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:49.647+0000 7f009940c640 1 -- 172.21.15.99:0/103978830 wait complete. 2024-01-19T05:17:49.659 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-19T05:17:56.466 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-19T05:17:56.585 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f04602f4640 1 Processor -- start 2024-01-19T05:17:56.585 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f04602f4640 1 -- start start 2024-01-19T05:17:56.586 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f04602f4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f04581470d0 0x7f0458147530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.586 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f04602f4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045814bf30 0x7f045814e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.586 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f04602f4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04580af9b0 con 0x7f045806ba00 2024-01-19T05:17:56.586 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f04602f4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04580adff0 con 0x7f04581470d0 2024-01-19T05:17:56.586 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f04602f4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045806bde0 con 0x7f045814bf30 2024-01-19T05:17:56.587 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f045e891640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045814bf30 0x7f045814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.587 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f045e090640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f045806ba00 0x7f04580b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:37864/0 (socket says 172.21.15.99:37864) 2024-01-19T05:17:56.587 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f045e090640 1 -- 172.21.15.99:0/3902638183 learned_addr learned my addr 172.21.15.99:0/3902638183 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:17:56.587 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f045d88f640 1 --2- 172.21.15.99:0/3902638183 >> v2:172.21.15.157:3300/0 conn(0x7f04581470d0 0x7f0458147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.587 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f045e891640 1 -- 172.21.15.99:0/3902638183 >> v2:172.21.15.157:3300/0 conn(0x7f04581470d0 msgr2=0x7f0458147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:56.587 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f045e891640 1 --2- 172.21.15.99:0/3902638183 >> v2:172.21.15.157:3300/0 conn(0x7f04581470d0 0x7f0458147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.587 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f045e891640 1 -- 172.21.15.99:0/3902638183 >> v1:172.21.15.157:6789/0 conn(0x7f045806ba00 legacy=0x7f04580b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.587 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.587+0000 7f045e891640 1 -- 172.21.15.99:0/3902638183 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580ae200 con 0x7f045814bf30 2024-01-19T05:17:56.590 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f045e891640 1 --2- 172.21.15.99:0/3902638183 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045814bf30 0x7f045814e320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0450009d90 tx=0x7f045001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c200e7c48adfe3ca server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:56.590 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f045d08e640 1 -- 172.21.15.99:0/3902638183 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04500a58f0 con 0x7f045814bf30 2024-01-19T05:17:56.590 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f045d08e640 1 -- 172.21.15.99:0/3902638183 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04500a5a50 con 0x7f045814bf30 2024-01-19T05:17:56.590 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f045d08e640 1 -- 172.21.15.99:0/3902638183 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04500a5de0 con 0x7f045814bf30 2024-01-19T05:17:56.591 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- 172.21.15.99:0/3902638183 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045814bf30 msgr2=0x7f045814e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.591 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 --2- 172.21.15.99:0/3902638183 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045814bf30 0x7f045814e320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0450009d90 tx=0x7f045001c890 comp rx=0 tx=0).stop 2024-01-19T05:17:56.591 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- 172.21.15.99:0/3902638183 shutdown_connections 2024-01-19T05:17:56.591 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 --2- 172.21.15.99:0/3902638183 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045814bf30 0x7f045814e320 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.591 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 --2- 172.21.15.99:0/3902638183 >> v2:172.21.15.157:3300/0 conn(0x7f04581470d0 0x7f0458147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.591 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- 172.21.15.99:0/3902638183 >> 172.21.15.99:0/3902638183 conn(0x7f04580b7f90 msgr2=0x7f04580b83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:56.591 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- 172.21.15.99:0/3902638183 shutdown_connections 2024-01-19T05:17:56.591 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- 172.21.15.99:0/3902638183 wait complete. 2024-01-19T05:17:56.592 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 Processor -- start 2024-01-19T05:17:56.592 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- start start 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045806ba00 0x7f0458145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04581470d0 0x7f045814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045814bf30 0x7f045813d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045814e470 con 0x7f045814bf30 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04580b7360 con 0x7f04581470d0 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.591+0000 7f04602f4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0458099d10 con 0x7f045806ba00 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045814bf30 0x7f045813d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045814bf30 0x7f045813d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49964/0 (socket says 172.21.15.99:49964) 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 -- 172.21.15.99:0/3551793555 learned_addr learned my addr 172.21.15.99:0/3551793555 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045d88f640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04581470d0 0x7f045814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.594 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e090640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045806ba00 0x7f0458145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 -- 172.21.15.99:0/3551793555 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045806ba00 msgr2=0x7f0458145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045806ba00 0x7f0458145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 -- 172.21.15.99:0/3551793555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04581470d0 msgr2=0x7f045814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04581470d0 0x7f045814cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 -- 172.21.15.99:0/3551793555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0450009a70 con 0x7f045814bf30 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e891640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045814bf30 0x7f045813d390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f04500b0040 tx=0x7f0450019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f044effd640 1 -- 172.21.15.99:0/3551793555 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04500b9860 con 0x7f045814bf30 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f044effd640 1 -- 172.21.15.99:0/3551793555 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04500b99c0 con 0x7f045814bf30 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f044effd640 1 -- 172.21.15.99:0/3551793555 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04500b9d70 con 0x7f045814bf30 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0458071a60 con 0x7f045814bf30 2024-01-19T05:17:56.595 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045814c980 con 0x7f045814bf30 2024-01-19T05:17:56.596 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045814cb70 con 0x7f045814bf30 2024-01-19T05:17:56.596 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f044effd640 1 -- 172.21.15.99:0/3551793555 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f04500ad440 con 0x7f045814bf30 2024-01-19T05:17:56.596 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f044effd640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f043c066500 0x7f043c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.596 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f044effd640 1 -- 172.21.15.99:0/3551793555 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f045011edd0 con 0x7f045814bf30 2024-01-19T05:17:56.596 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e090640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f043c066500 0x7f043c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.596 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.595+0000 7f045e090640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f043c066500 0x7f043c0689c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0454000f70 tx=0x7f0454009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:56.600 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.599+0000 7f044effd640 1 -- 172.21.15.99:0/3551793555 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f04500ec450 con 0x7f045814bf30 2024-01-19T05:17:56.755 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.755+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04580749b0 con 0x7f045814bf30 2024-01-19T05:17:56.758 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f044effd640 1 -- 172.21.15.99:0/3551793555 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7f04500efa70 con 0x7f045814bf30 2024-01-19T05:17:56.758 INFO:teuthology.misc.health.smithi099.stdout: 2024-01-19T05:17:56.758 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":16,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:17:53.576391+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:17:56.760 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f043c066500 msgr2=0x7f043c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.760 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f043c066500 0x7f043c0689c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0454000f70 tx=0x7f0454009040 comp rx=0 tx=0).stop 2024-01-19T05:17:56.760 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045814bf30 msgr2=0x7f045813d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.760 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045814bf30 0x7f045813d390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f04500b0040 tx=0x7f0450019630 comp rx=0 tx=0).stop 2024-01-19T05:17:56.761 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 shutdown_connections 2024-01-19T05:17:56.761 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f043c066500 0x7f043c0689c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.761 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045814bf30 0x7f045813d390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.761 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04581470d0 0x7f045814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.761 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 --2- 172.21.15.99:0/3551793555 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f045806ba00 0x7f0458145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.761 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 >> 172.21.15.99:0/3551793555 conn(0x7f04580b7f90 msgr2=0x7f04580b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:56.761 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 shutdown_connections 2024-01-19T05:17:56.761 INFO:teuthology.misc.health.smithi099.stderr:2024-01-19T05:17:56.759+0000 7f04602f4640 1 -- 172.21.15.99:0/3551793555 wait complete. 2024-01-19T05:17:56.775 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-19T05:17:56.775 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-19T05:17:56.775 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-19T05:17:56.775 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-19T05:17:56.777 INFO:tasks.ceph.mds.a:Started 2024-01-19T05:17:56.777 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-19T05:17:56.777 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-19T05:17:56.780 INFO:tasks.ceph.mds.b:Started 2024-01-19T05:17:56.781 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-19T05:17:56.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:17:56.854 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-01-19T05:17:56.872 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-01-19T05:17:56.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6369501640 1 Processor -- start 2024-01-19T05:17:56.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6369501640 1 -- start start 2024-01-19T05:17:56.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6369501640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f636406a940 0x7f636409e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6369501640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f636409d590 0x7f636409d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6369501640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63640b4c10 con 0x7f636413e2f0 2024-01-19T05:17:56.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6369501640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63640b4900 con 0x7f636409d590 2024-01-19T05:17:56.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6369501640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636409cbe0 con 0x7f636406a940 2024-01-19T05:17:56.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f63627fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f636409d590 0x7f636409d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f63627fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f636409d590 0x7f636409d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49994/0 (socket says 172.21.15.99:49994) 2024-01-19T05:17:56.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f63627fc640 1 -- 172.21.15.99:0/1097988715 learned_addr learned my addr 172.21.15.99:0/1097988715 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:56.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6362ffd640 1 --2- 172.21.15.99:0/1097988715 >> v2:172.21.15.157:3300/0 conn(0x7f636406a940 0x7f636409e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f63627fc640 1 -- 172.21.15.99:0/1097988715 >> v2:172.21.15.157:3300/0 conn(0x7f636406a940 msgr2=0x7f636409e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:56.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f63627fc640 1 --2- 172.21.15.99:0/1097988715 >> v2:172.21.15.157:3300/0 conn(0x7f636406a940 0x7f636409e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f63627fc640 1 -- 172.21.15.99:0/1097988715 >> v1:172.21.15.157:6789/0 conn(0x7f636413e2f0 legacy=0x7f636413e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:56.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f63627fc640 1 -- 172.21.15.99:0/1097988715 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636413ee10 con 0x7f636409d590 2024-01-19T05:17:56.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.891+0000 7f6362ffd640 1 --2- 172.21.15.99:0/1097988715 >> v2:172.21.15.157:3300/0 conn(0x7f636406a940 0x7f636409e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:17:56.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f63627fc640 1 --2- 172.21.15.99:0/1097988715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636409d590 0x7f636409d9f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f636406db60 tx=0x7f635801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e9d121599bf9fc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:56.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6361ffb640 1 -- 172.21.15.99:0/1097988715 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63580ad680 con 0x7f636409d590 2024-01-19T05:17:56.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6361ffb640 1 -- 172.21.15.99:0/1097988715 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63580ad7e0 con 0x7f636409d590 2024-01-19T05:17:56.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6361ffb640 1 -- 172.21.15.99:0/1097988715 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63580adb70 con 0x7f636409d590 2024-01-19T05:17:56.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- 172.21.15.99:0/1097988715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636409d590 msgr2=0x7f636409d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 --2- 172.21.15.99:0/1097988715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636409d590 0x7f636409d9f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f636406db60 tx=0x7f635801c380 comp rx=0 tx=0).stop 2024-01-19T05:17:56.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- 172.21.15.99:0/1097988715 shutdown_connections 2024-01-19T05:17:56.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 --2- 172.21.15.99:0/1097988715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636409d590 0x7f636409d9f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 --2- 172.21.15.99:0/1097988715 >> v2:172.21.15.157:3300/0 conn(0x7f636406a940 0x7f636409e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- 172.21.15.99:0/1097988715 >> 172.21.15.99:0/1097988715 conn(0x7f6364066ef0 msgr2=0x7f63640b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:56.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- 172.21.15.99:0/1097988715 shutdown_connections 2024-01-19T05:17:56.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- 172.21.15.99:0/1097988715 wait complete. 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 Processor -- start 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- start start 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f636406a940 0x7f636413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f636409d590 0x7f6364135330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636413e2f0 0x7f6364135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640af7b0 con 0x7f636413e2f0 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640aeef0 con 0x7f636406a940 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6369501640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636406fe70 con 0x7f636409d590 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f63637fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636413e2f0 0x7f6364135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f63637fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636413e2f0 0x7f6364135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50000/0 (socket says 172.21.15.99:50000) 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f63637fe640 1 -- 172.21.15.99:0/2594229603 learned_addr learned my addr 172.21.15.99:0/2594229603 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f6362ffd640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f636406a940 0x7f636413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.895+0000 7f63627fc640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f636409d590 0x7f6364135330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f63637fe640 1 -- 172.21.15.99:0/2594229603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f636409d590 msgr2=0x7f6364135330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f63637fe640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f636409d590 0x7f6364135330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f63637fe640 1 -- 172.21.15.99:0/2594229603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f636406a940 msgr2=0x7f636413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f63637fe640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f636406a940 0x7f636413cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f63637fe640 1 -- 172.21.15.99:0/2594229603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580094d0 con 0x7f636413e2f0 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f63637fe640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636413e2f0 0x7f6364135870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f635c00b9a0 tx=0x7f635c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f634b7fe640 1 -- 172.21.15.99:0/2594229603 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00cba0 con 0x7f636413e2f0 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f634b7fe640 1 -- 172.21.15.99:0/2594229603 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c00cd00 con 0x7f636413e2f0 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63640af0f0 con 0x7f636413e2f0 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f634b7fe640 1 -- 172.21.15.99:0/2594229603 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c014680 con 0x7f636413e2f0 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63640700e0 con 0x7f636413e2f0 2024-01-19T05:17:56.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63640696e0 con 0x7f636413e2f0 2024-01-19T05:17:56.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f634b7fe640 1 -- 172.21.15.99:0/2594229603 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f635c003980 con 0x7f636413e2f0 2024-01-19T05:17:56.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f634b7fe640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6350066530 0x7f63500689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:56.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f6362ffd640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6350066530 0x7f63500689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:56.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f634b7fe640 1 -- 172.21.15.99:0/2594229603 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f635c083c80 con 0x7f636413e2f0 2024-01-19T05:17:56.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.899+0000 7f6362ffd640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6350066530 0x7f63500689f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f635400ab60 tx=0x7f6354008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:56.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:56.903+0000 7f634b7fe640 1 -- 172.21.15.99:0/2594229603 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f635c051300 con 0x7f636413e2f0 2024-01-19T05:17:57.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.059+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f636406c3c0 con 0x7f636413e2f0 2024-01-19T05:17:57.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f634b7fe640 1 -- 172.21.15.99:0/2594229603 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7f635c054920 con 0x7f636413e2f0 2024-01-19T05:17:57.061 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:57.061 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:17:53.576391+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6350066530 msgr2=0x7f63500689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6350066530 0x7f63500689f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f635400ab60 tx=0x7f6354008040 comp rx=0 tx=0).stop 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636413e2f0 msgr2=0x7f6364135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636413e2f0 0x7f6364135870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f635c00b9a0 tx=0x7f635c00be60 comp rx=0 tx=0).stop 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 shutdown_connections 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6350066530 0x7f63500689f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636413e2f0 0x7f6364135870 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f636409d590 0x7f6364135330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 --2- 172.21.15.99:0/2594229603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f636406a940 0x7f636413cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 >> 172.21.15.99:0/2594229603 conn(0x7f6364066ef0 msgr2=0x7f636406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 shutdown_connections 2024-01-19T05:17:57.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.063+0000 7f6369501640 1 -- 172.21.15.99:0/2594229603 wait complete. 2024-01-19T05:17:57.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:17:57.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:17:57.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b036be640 1 Processor -- start 2024-01-19T05:17:57.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b036be640 1 -- start start 2024-01-19T05:17:57.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b036be640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7afc06a940 0x7f7afc0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b036be640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7afc09bc20 0x7f7afc140930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b036be640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc0b3e20 con 0x7f7afc0b5150 2024-01-19T05:17:57.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b036be640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7afc06ad20 con 0x7f7afc06a940 2024-01-19T05:17:57.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b036be640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7afc09e4d0 con 0x7f7afc09bc20 2024-01-19T05:17:57.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b0145a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7afc06a940 0x7f7afc0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b01c5b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7afc0b5150 0x7f7afc06ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34096/0 (socket says 172.21.15.99:34096) 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b0145a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7afc06a940 0x7f7afc0b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50008/0 (socket says 172.21.15.99:50008) 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b01c5b640 1 -- 172.21.15.99:0/1346234231 learned_addr learned my addr 172.21.15.99:0/1346234231 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b00c59640 1 --2- 172.21.15.99:0/1346234231 >> v2:172.21.15.157:3300/0 conn(0x7f7afc09bc20 0x7f7afc140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b0145a640 1 -- 172.21.15.99:0/1346234231 >> v2:172.21.15.157:3300/0 conn(0x7f7afc09bc20 msgr2=0x7f7afc140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b0145a640 1 --2- 172.21.15.99:0/1346234231 >> v2:172.21.15.157:3300/0 conn(0x7f7afc09bc20 0x7f7afc140930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b0145a640 1 -- 172.21.15.99:0/1346234231 >> v1:172.21.15.99:6789/0 conn(0x7f7afc0b5150 legacy=0x7f7afc06ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7aeffff640 1 -- 172.21.15.99:0/1346234231 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433699575 0 0) 0x7f7afc0b3e20 con 0x7f7afc0b5150 2024-01-19T05:17:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.191+0000 7f7b0145a640 1 -- 172.21.15.99:0/1346234231 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc0b3ab0 con 0x7f7afc06a940 2024-01-19T05:17:57.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 --2- 172.21.15.99:0/1346234231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc0b4860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7afc06dc50 tx=0x7f7af401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f3aa9f96c04a3d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:57.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7aeffff640 1 -- 172.21.15.99:0/1346234231 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40ab600 con 0x7f7afc06a940 2024-01-19T05:17:57.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7aeffff640 1 -- 172.21.15.99:0/1346234231 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af40a7050 con 0x7f7afc06a940 2024-01-19T05:17:57.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7aeffff640 1 -- 172.21.15.99:0/1346234231 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40ab980 con 0x7f7afc06a940 2024-01-19T05:17:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- 172.21.15.99:0/1346234231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 msgr2=0x7f7afc0b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 --2- 172.21.15.99:0/1346234231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc0b4860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7afc06dc50 tx=0x7f7af401c460 comp rx=0 tx=0).stop 2024-01-19T05:17:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- 172.21.15.99:0/1346234231 shutdown_connections 2024-01-19T05:17:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 --2- 172.21.15.99:0/1346234231 >> v2:172.21.15.157:3300/0 conn(0x7f7afc09bc20 0x7f7afc140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 --2- 172.21.15.99:0/1346234231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc0b4860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- 172.21.15.99:0/1346234231 >> 172.21.15.99:0/1346234231 conn(0x7f7afc066ef0 msgr2=0x7f7afc0b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- 172.21.15.99:0/1346234231 shutdown_connections 2024-01-19T05:17:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- 172.21.15.99:0/1346234231 wait complete. 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 Processor -- start 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- start start 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc13ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc09bc20 0x7f7afc144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7afc0b5150 0x7f7afc071720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc071290 con 0x7f7afc06a940 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc145280 con 0x7f7afc0b5150 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc152010 con 0x7f7afc09bc20 2024-01-19T05:17:57.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc13ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc13ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50018/0 (socket says 172.21.15.99:50018) 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 -- 172.21.15.99:0/2858528060 learned_addr learned my addr 172.21.15.99:0/2858528060 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 -- 172.21.15.99:0/2858528060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc09bc20 msgr2=0x7f7afc144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b00c59640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc09bc20 0x7f7afc144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc09bc20 0x7f7afc144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 -- 172.21.15.99:0/2858528060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7afc0b5150 msgr2=0x7f7afc071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b01c5b640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7afc0b5150 0x7f7afc071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7afc0b5150 0x7f7afc071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 -- 172.21.15.99:0/2858528060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af4009420 con 0x7f7afc06a940 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b0145a640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc13ea00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7af4019070 tx=0x7f7af4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7aedffb640 1 -- 172.21.15.99:0/2858528060 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40b4840 con 0x7f7afc06a940 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7aedffb640 1 -- 172.21.15.99:0/2858528060 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af40b49a0 con 0x7f7afc06a940 2024-01-19T05:17:57.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7aedffb640 1 -- 172.21.15.99:0/2858528060 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40b4d30 con 0x7f7afc06a940 2024-01-19T05:17:57.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc1454d0 con 0x7f7afc06a940 2024-01-19T05:17:57.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.195+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc1457b0 con 0x7f7afc06a940 2024-01-19T05:17:57.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.199+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc0696e0 con 0x7f7afc06a940 2024-01-19T05:17:57.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.199+0000 7f7aedffb640 1 -- 172.21.15.99:0/2858528060 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7af40b2040 con 0x7f7afc06a940 2024-01-19T05:17:57.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.199+0000 7f7aedffb640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ae0066500 0x7f7ae00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.199+0000 7f7aedffb640 1 -- 172.21.15.99:0/2858528060 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7af411ded0 con 0x7f7afc06a940 2024-01-19T05:17:57.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.199+0000 7f7b00c59640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ae0066500 0x7f7ae00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.199+0000 7f7b00c59640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ae0066500 0x7f7ae00689c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7afc09b750 tx=0x7f7af000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:57.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.203+0000 7f7aedffb640 1 -- 172.21.15.99:0/2858528060 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7af40eb4c0 con 0x7f7afc06a940 2024-01-19T05:17:57.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.351+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7afc13d2e0 con 0x7f7afc06a940 2024-01-19T05:17:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7aedffb640 1 -- 172.21.15.99:0/2858528060 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7af40b0070 con 0x7f7afc06a940 2024-01-19T05:17:57.353 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ae0066500 msgr2=0x7f7ae00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ae0066500 0x7f7ae00689c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7afc09b750 tx=0x7f7af000b040 comp rx=0 tx=0).stop 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 msgr2=0x7f7afc13ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc13ea00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7af4019070 tx=0x7f7af4019200 comp rx=0 tx=0).stop 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 shutdown_connections 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ae0066500 0x7f7ae00689c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7afc0b5150 0x7f7afc071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7afc09bc20 0x7f7afc144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 --2- 172.21.15.99:0/2858528060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc06a940 0x7f7afc13ea00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 >> 172.21.15.99:0/2858528060 conn(0x7f7afc066ef0 msgr2=0x7f7afc13c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 shutdown_connections 2024-01-19T05:17:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.355+0000 7f7b036be640 1 -- 172.21.15.99:0/2858528060 wait complete. 2024-01-19T05:17:57.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:17:57.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.475+0000 7f2cca50e640 1 Processor -- start 2024-01-19T05:17:57.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.475+0000 7f2cca50e640 1 -- start start 2024-01-19T05:17:57.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc406ccf0 0x7f2cc4144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2cc40b3a10 0x7f2cc40ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2cc40aea40 0x7f2cc4146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc4143dc0 con 0x7f2cc40aea40 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc40b3e70 con 0x7f2cc40b3a10 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc406d0d0 con 0x7f2cc406ccf0 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2cc40aea40 0x7f2cc4146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2cc40aea40 0x7f2cc4146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50028/0 (socket says 172.21.15.99:50028) 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 -- 172.21.15.99:0/3428983919 learned_addr learned my addr 172.21.15.99:0/3428983919 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cbb7fe640 1 --2- 172.21.15.99:0/3428983919 >> v2:172.21.15.157:3300/0 conn(0x7f2cc40b3a10 0x7f2cc40ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 -- 172.21.15.99:0/3428983919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc406ccf0 msgr2=0x7f2cc4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 --2- 172.21.15.99:0/3428983919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc406ccf0 0x7f2cc4144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 -- 172.21.15.99:0/3428983919 >> v2:172.21.15.157:3300/0 conn(0x7f2cc40b3a10 msgr2=0x7f2cc40ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 --2- 172.21.15.99:0/3428983919 >> v2:172.21.15.157:3300/0 conn(0x7f2cc40b3a10 0x7f2cc40ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 -- 172.21.15.99:0/3428983919 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4143770 con 0x7f2cc40aea40 2024-01-19T05:17:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc8aab640 1 --2- 172.21.15.99:0/3428983919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40aea40 0x7f2cc4146bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40b9cc0 tx=0x7f2cbc01e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1998dbf49ee6929 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc37fe640 1 -- 172.21.15.99:0/3428983919 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00b2d0 con 0x7f2cc40aea40 2024-01-19T05:17:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc37fe640 1 -- 172.21.15.99:0/3428983919 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc00b430 con 0x7f2cc40aea40 2024-01-19T05:17:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cc37fe640 1 -- 172.21.15.99:0/3428983919 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc0a78e0 con 0x7f2cc40aea40 2024-01-19T05:17:57.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 -- 172.21.15.99:0/3428983919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40aea40 msgr2=0x7f2cc4146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3428983919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40aea40 0x7f2cc4146bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40b9cc0 tx=0x7f2cbc01e850 comp rx=0 tx=0).stop 2024-01-19T05:17:57.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 -- 172.21.15.99:0/3428983919 shutdown_connections 2024-01-19T05:17:57.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3428983919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40aea40 0x7f2cc4146bd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3428983919 >> v2:172.21.15.157:3300/0 conn(0x7f2cc40b3a10 0x7f2cc40ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3428983919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc406ccf0 0x7f2cc4144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.479+0000 7f2cca50e640 1 -- 172.21.15.99:0/3428983919 >> 172.21.15.99:0/3428983919 conn(0x7f2cc4066ef0 msgr2=0x7f2cc40b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:57.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- 172.21.15.99:0/3428983919 shutdown_connections 2024-01-19T05:17:57.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- 172.21.15.99:0/3428983919 wait complete. 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 Processor -- start 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- start start 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc406ccf0 0x7f2cc409b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc40aea40 0x7f2cc41398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40b3a10 0x7f2cc41de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4144850 con 0x7f2cc40b3a10 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4137f10 con 0x7f2cc406ccf0 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc41390b0 con 0x7f2cc40aea40 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40b3a10 0x7f2cc41de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40b3a10 0x7f2cc41de0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50032/0 (socket says 172.21.15.99:50032) 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 -- 172.21.15.99:0/3275587911 learned_addr learned my addr 172.21.15.99:0/3275587911 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 -- 172.21.15.99:0/3275587911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc40aea40 msgr2=0x7f2cc41398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc40aea40 0x7f2cc41398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 -- 172.21.15.99:0/3275587911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc406ccf0 msgr2=0x7f2cc409b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc406ccf0 0x7f2cc409b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 -- 172.21.15.99:0/3275587911 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc00bd40 con 0x7f2cc40b3a10 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc8aab640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40b3a10 0x7f2cc41de0a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc01cf00 tx=0x7f2cbc01b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc17fa640 1 -- 172.21.15.99:0/3275587911 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc009800 con 0x7f2cc40b3a10 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc17fa640 1 -- 172.21.15.99:0/3275587911 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc009980 con 0x7f2cc40b3a10 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc4139350 con 0x7f2cc40b3a10 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc17fa640 1 -- 172.21.15.99:0/3275587911 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc009d30 con 0x7f2cc40b3a10 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc413a780 con 0x7f2cc40b3a10 2024-01-19T05:17:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc4139590 con 0x7f2cc40b3a10 2024-01-19T05:17:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.483+0000 7f2cc17fa640 1 -- 172.21.15.99:0/3275587911 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2cbc0ba470 con 0x7f2cc40b3a10 2024-01-19T05:17:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.487+0000 7f2cc17fa640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ca4066500 0x7f2ca40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.487+0000 7f2cc17fa640 1 -- 172.21.15.99:0/3275587911 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2cbc121160 con 0x7f2cc40b3a10 2024-01-19T05:17:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.487+0000 7f2cc3fff640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ca4066500 0x7f2ca40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.487+0000 7f2cc3fff640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ca4066500 0x7f2ca40689c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009730 tx=0x7f2cb4006ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:57.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.491+0000 7f2cc17fa640 1 -- 172.21.15.99:0/3275587911 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2cc4139590 con 0x7f2cc40b3a10 2024-01-19T05:17:57.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.675+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cc4139590 con 0x7f2cc40b3a10 2024-01-19T05:17:57.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cc17fa640 1 -- 172.21.15.99:0/3275587911 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f2cc4139590 con 0x7f2cc40b3a10 2024-01-19T05:17:57.677 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:17:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-19T05:17:57.677 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 2 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ca4066500 msgr2=0x7f2ca40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ca4066500 0x7f2ca40689c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009730 tx=0x7f2cb4006ca0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40b3a10 msgr2=0x7f2cc41de0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40b3a10 0x7f2cc41de0a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc01cf00 tx=0x7f2cbc01b5f0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 shutdown_connections 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ca4066500 0x7f2ca40689c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cc40b3a10 0x7f2cc41de0a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cc40aea40 0x7f2cc41398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 --2- 172.21.15.99:0/3275587911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc406ccf0 0x7f2cc409b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 >> 172.21.15.99:0/3275587911 conn(0x7f2cc4066ef0 msgr2=0x7f2cc406a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 shutdown_connections 2024-01-19T05:17:57.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:57.679+0000 7f2cca50e640 1 -- 172.21.15.99:0/3275587911 wait complete. 2024-01-19T05:17:59.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:17:59.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f977c350640 1 Processor -- start 2024-01-19T05:17:59.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f977c350640 1 -- start start 2024-01-19T05:17:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f977c350640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97740725b0 0x7f9774146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f977c350640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740ae1a0 con 0x7f97740acad0 2024-01-19T05:17:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f977c350640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740aceb0 con 0x7f97741473f0 2024-01-19T05:17:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f977c350640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9774141020 con 0x7f97740725b0 2024-01-19T05:17:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f977a0ec640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f97740acad0 0x7f97740b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34104/0 (socket says 172.21.15.99:34104) 2024-01-19T05:17:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f977a0ec640 1 -- 172.21.15.99:0/1110381834 learned_addr learned my addr 172.21.15.99:0/1110381834 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:17:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886971516 0 0) 0x7f97740ae1a0 con 0x7f97740acad0 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f97798eb640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97740725b0 0x7f9774146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.826+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9760003530 con 0x7f97740acad0 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4071933938 0 0) 0x7f9760003530 con 0x7f97740acad0 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97740725b0 msgr2=0x7f9774146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97740725b0 0x7f9774146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 >> v1:172.21.15.157:6789/0 conn(0x7f97741473f0 legacy=0x7f9774151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740aefc0 con 0x7f97740acad0 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f9770001680 con 0x7f97740acad0 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 >> v1:172.21.15.99:6789/0 conn(0x7f97740acad0 legacy=0x7f97740b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97600039b0 0x7f9760003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97600047d0 0x7f9760004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9760005190 0x7f976000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774141020 con 0x7f97600039b0 2024-01-19T05:17:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976000bed0 con 0x7f97600047d0 2024-01-19T05:17:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976000c010 con 0x7f9760005190 2024-01-19T05:17:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977a0ec640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97600039b0 0x7f9760003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97798eb640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97600047d0 0x7f9760004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977a0ec640 1 -- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9760005190 msgr2=0x7f976000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977a0ec640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9760005190 0x7f976000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977a0ec640 1 -- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97600047d0 msgr2=0x7f9760004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:17:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977a0ec640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97600047d0 0x7f9760004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977a0ec640 1 -- 172.21.15.99:0/1110381834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760003530 con 0x7f97600039b0 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977a0ec640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97600039b0 0x7f9760003dd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f977000c240 tx=0x7f977001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd173625a96e3a33 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770005ae0 con 0x7f97600039b0 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9770005c60 con 0x7f97600039b0 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f97790ea640 1 -- 172.21.15.99:0/1110381834 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97700a5800 con 0x7f97600039b0 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977c350640 1 -- 172.21.15.99:0/1110381834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97600039b0 msgr2=0x7f9760003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977c350640 1 --2- 172.21.15.99:0/1110381834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97600039b0 0x7f9760003dd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f977000c240 tx=0x7f977001cbb0 comp rx=0 tx=0).stop 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977a8ed640 1 -- 172.21.15.99:0/1110381834 reap_dead start 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977c350640 1 -- 172.21.15.99:0/1110381834 shutdown_connections 2024-01-19T05:17:59.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977c350640 1 -- 172.21.15.99:0/1110381834 >> 172.21.15.99:0/1110381834 conn(0x7f97740b8080 msgr2=0x7f97740b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:17:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977c350640 1 -- 172.21.15.99:0/1110381834 shutdown_connections 2024-01-19T05:17:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.830+0000 7f977c350640 1 -- 172.21.15.99:0/1110381834 wait complete. 2024-01-19T05:17:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 Processor -- start 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 -- start start 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97600039b0 0x7f97741e2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9774139f50 0x7f9774150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977413a3d0 0x7f9774151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774139ac0 con 0x7f9774139f50 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774151cc0 con 0x7f977413a3d0 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977406f190 con 0x7f97600039b0 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9774139f50 0x7f9774150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9774139f50 0x7f9774150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50048/0 (socket says 172.21.15.99:50048) 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 -- 172.21.15.99:0/1992588351 learned_addr learned my addr 172.21.15.99:0/1992588351 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977a0ec640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97600039b0 0x7f97741e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977a8ed640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977413a3d0 0x7f9774151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 -- 172.21.15.99:0/1992588351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97600039b0 msgr2=0x7f97741e2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97600039b0 0x7f97741e2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 -- 172.21.15.99:0/1992588351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977413a3d0 msgr2=0x7f9774151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977413a3d0 0x7f9774151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 -- 172.21.15.99:0/1992588351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977406f470 con 0x7f9774139f50 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f97798eb640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9774139f50 0x7f9774150f10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9764011600 tx=0x7f9764011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f976affd640 1 -- 172.21.15.99:0/1992588351 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764004220 con 0x7f9774139f50 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f976affd640 1 -- 172.21.15.99:0/1992588351 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764004380 con 0x7f9774139f50 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9774139470 con 0x7f9774139f50 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f976affd640 1 -- 172.21.15.99:0/1992588351 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976400f920 con 0x7f9774139f50 2024-01-19T05:17:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9774151990 con 0x7f9774139f50 2024-01-19T05:17:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97741392d0 con 0x7f9774139f50 2024-01-19T05:17:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.834+0000 7f976affd640 1 -- 172.21.15.99:0/1992588351 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f976400fa80 con 0x7f9774139f50 2024-01-19T05:17:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.838+0000 7f976affd640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9758066500 0x7f97580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:17:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.838+0000 7f976affd640 1 -- 172.21.15.99:0/1992588351 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9764083c10 con 0x7f9774139f50 2024-01-19T05:17:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.838+0000 7f977a0ec640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9758066500 0x7f97580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:17:59.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.838+0000 7f977a0ec640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9758066500 0x7f97580689c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97700ab000 tx=0x7f97700a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:17:59.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:17:59.842+0000 7f976affd640 1 -- 172.21.15.99:0/1992588351 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f97741392d0 con 0x7f9774139f50 2024-01-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97741392d0 con 0x7f9774139f50 2024-01-19T05:18:00.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f976affd640 1 -- 172.21.15.99:0/1992588351 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2114 (secure 0 0 0) 0x7f9764022860 con 0x7f9774139f50 2024-01-19T05:18:00.051 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:00.051 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-19T05:18:00.051 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 3 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9758066500 msgr2=0x7f97580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9758066500 0x7f97580689c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97700ab000 tx=0x7f97700a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9774139f50 msgr2=0x7f9774150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9774139f50 0x7f9774150f10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9764011600 tx=0x7f9764011ac0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 shutdown_connections 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9758066500 0x7f97580689c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f977413a3d0 0x7f9774151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9774139f50 0x7f9774150f10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 --2- 172.21.15.99:0/1992588351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f97600039b0 0x7f97741e2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 >> 172.21.15.99:0/1992588351 conn(0x7f97740b8080 msgr2=0x7f97740b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:00.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 shutdown_connections 2024-01-19T05:18:00.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.050+0000 7f977c350640 1 -- 172.21.15.99:0/1992588351 wait complete. 2024-01-19T05:18:00.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:00.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadac7c8640 1 Processor -- start 2024-01-19T05:18:00.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadac7c8640 1 -- start start 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadac7c8640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fada40b19f0 0x7fada406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadac7c8640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada4070680 con 0x7fada4144c70 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadac7c8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada4070410 con 0x7fada40724f0 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadac7c8640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada4144790 con 0x7fada40b19f0 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadaa564640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fada40b19f0 0x7fada406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fada9d63640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fada4144c70 0x7fada4071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34112/0 (socket says 172.21.15.99:34112) 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fada9d63640 1 -- 172.21.15.99:0/2128001495 learned_addr learned my addr 172.21.15.99:0/2128001495 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadaa564640 1 -- 172.21.15.99:0/2128001495 >> v1:172.21.15.157:6789/0 conn(0x7fada40724f0 legacy=0x7fada414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadaa564640 1 -- 172.21.15.99:0/2128001495 >> v1:172.21.15.99:6789/0 conn(0x7fada4144c70 legacy=0x7fada4071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.190+0000 7fadaa564640 1 -- 172.21.15.99:0/2128001495 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada406f2b0 con 0x7fada40b19f0 2024-01-19T05:18:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadaa564640 1 --2- 172.21.15.99:0/2128001495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40b19f0 0x7fada406ebe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fada00097c0 tx=0x7fada001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951729bef31132af server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fada9562640 1 -- 172.21.15.99:0/2128001495 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00ac630 con 0x7fada40b19f0 2024-01-19T05:18:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fada9562640 1 -- 172.21.15.99:0/2128001495 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada00ac790 con 0x7fada40b19f0 2024-01-19T05:18:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fada9562640 1 -- 172.21.15.99:0/2128001495 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00acb20 con 0x7fada40b19f0 2024-01-19T05:18:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- 172.21.15.99:0/2128001495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40b19f0 msgr2=0x7fada406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 --2- 172.21.15.99:0/2128001495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40b19f0 0x7fada406ebe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fada00097c0 tx=0x7fada001c3b0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- 172.21.15.99:0/2128001495 shutdown_connections 2024-01-19T05:18:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 --2- 172.21.15.99:0/2128001495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40b19f0 0x7fada406ebe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- 172.21.15.99:0/2128001495 >> 172.21.15.99:0/2128001495 conn(0x7fada40b8080 msgr2=0x7fada40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:00.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- 172.21.15.99:0/2128001495 shutdown_connections 2024-01-19T05:18:00.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- 172.21.15.99:0/2128001495 wait complete. 2024-01-19T05:18:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 Processor -- start 2024-01-19T05:18:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- start start 2024-01-19T05:18:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40724f0 0x7fada41df580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fada40b19f0 0x7fada40b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fada4144c70 0x7fada41e2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada413bfa0 con 0x7fada40724f0 2024-01-19T05:18:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada40b0550 con 0x7fada4144c70 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadac7c8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada413bb10 con 0x7fada40b19f0 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadaa564640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40724f0 0x7fada41df580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadaa564640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40724f0 0x7fada41df580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50064/0 (socket says 172.21.15.99:50064) 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.194+0000 7fadaa564640 1 -- 172.21.15.99:0/1990518825 learned_addr learned my addr 172.21.15.99:0/1990518825 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fada9d63640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fada40b19f0 0x7fada40b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadaad65640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fada4144c70 0x7fada41e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadaa564640 1 -- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fada40b19f0 msgr2=0x7fada40b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadaa564640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fada40b19f0 0x7fada40b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadaa564640 1 -- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fada4144c70 msgr2=0x7fada41e2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadaa564640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fada4144c70 0x7fada41e2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadaa564640 1 -- 172.21.15.99:0/1990518825 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada0009420 con 0x7fada40724f0 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadaad65640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fada4144c70 0x7fada41e2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadaa564640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40724f0 0x7fada41df580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fada00af040 tx=0x7fada001abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fad9affd640 1 -- 172.21.15.99:0/1990518825 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00b8650 con 0x7fada40724f0 2024-01-19T05:18:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fad9affd640 1 -- 172.21.15.99:0/1990518825 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada00b87b0 con 0x7fada40724f0 2024-01-19T05:18:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fad9affd640 1 -- 172.21.15.99:0/1990518825 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00b8b60 con 0x7fada40724f0 2024-01-19T05:18:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada40af580 con 0x7fada40724f0 2024-01-19T05:18:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada40b7bf0 con 0x7fada40724f0 2024-01-19T05:18:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada40696e0 con 0x7fada40724f0 2024-01-19T05:18:00.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fad9affd640 1 -- 172.21.15.99:0/1990518825 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fada00b8cc0 con 0x7fada40724f0 2024-01-19T05:18:00.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fad9affd640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fad88066500 0x7fad880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fad9affd640 1 -- 172.21.15.99:0/1990518825 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fada011e560 con 0x7fada40724f0 2024-01-19T05:18:00.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fada9d63640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fad88066500 0x7fad880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.198+0000 7fada9d63640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fad88066500 0x7fad880689c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fada41dcee0 tx=0x7fad94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.202+0000 7fad9affd640 1 -- 172.21.15.99:0/1990518825 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fada00ebb40 con 0x7fada40724f0 2024-01-19T05:18:00.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fada40b0750 con 0x7fada40724f0 2024-01-19T05:18:00.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fad9affd640 1 -- 172.21.15.99:0/1990518825 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12815 (secure 0 0 0) 0x7fada00ef160 con 0x7fada40724f0 2024-01-19T05:18:00.358 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:00.359 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:17:53.576391+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fad88066500 msgr2=0x7fad880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fad88066500 0x7fad880689c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fada41dcee0 tx=0x7fad94009040 comp rx=0 tx=0).stop 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40724f0 msgr2=0x7fada41df580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40724f0 0x7fada41df580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fada00af040 tx=0x7fada001abf0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 shutdown_connections 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fad88066500 0x7fad880689c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fada4144c70 0x7fada41e2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fada40b19f0 0x7fada40b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 --2- 172.21.15.99:0/1990518825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada40724f0 0x7fada41df580 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 >> 172.21.15.99:0/1990518825 conn(0x7fada40b8080 msgr2=0x7fada40b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 shutdown_connections 2024-01-19T05:18:00.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.358+0000 7fadac7c8640 1 -- 172.21.15.99:0/1990518825 wait complete. 2024-01-19T05:18:00.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:00.376 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5b0a5d640 1 Processor -- start 2024-01-19T05:18:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5b0a5d640 1 -- start start 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5b0a5d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe5ac06ebe0 0x7fe5ac071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5b0a5d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac072320 0x7fe5ac14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5b0a5d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac06f070 con 0x7fe5ac0b19f0 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5b0a5d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ac070680 con 0x7fe5ac06ebe0 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5b0a5d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac070410 con 0x7fe5ac072320 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5a9d9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe5ac06ebe0 0x7fe5ac071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5a9d9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe5ac06ebe0 0x7fe5ac071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50078/0 (socket says 172.21.15.99:50078) 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5a9d9b640 1 -- 172.21.15.99:0/1509873243 learned_addr learned my addr 172.21.15.99:0/1509873243 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5aad9d640 1 --2- 172.21.15.99:0/1509873243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac072320 0x7fe5ac14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5a9d9b640 1 -- 172.21.15.99:0/1509873243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac072320 msgr2=0x7fe5ac14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5a9d9b640 1 --2- 172.21.15.99:0/1509873243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac072320 0x7fe5ac14ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5a9d9b640 1 -- 172.21.15.99:0/1509873243 >> v1:172.21.15.157:6789/0 conn(0x7fe5ac0b19f0 legacy=0x7fe5ac144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.498+0000 7fe5a9d9b640 1 -- 172.21.15.99:0/1509873243 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac144790 con 0x7fe5ac06ebe0 2024-01-19T05:18:00.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 --2- 172.21.15.99:0/1509873243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac06ebe0 0x7fe5ac071de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009870 tx=0x7fe5a001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5978d2243076ce6d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a959a640 1 -- 172.21.15.99:0/1509873243 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00ab620 con 0x7fe5ac06ebe0 2024-01-19T05:18:00.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a959a640 1 -- 172.21.15.99:0/1509873243 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a00ab780 con 0x7fe5ac06ebe0 2024-01-19T05:18:00.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a959a640 1 -- 172.21.15.99:0/1509873243 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00abb10 con 0x7fe5ac06ebe0 2024-01-19T05:18:00.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/1509873243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac06ebe0 msgr2=0x7fe5ac071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/1509873243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac06ebe0 0x7fe5ac071de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009870 tx=0x7fe5a001c440 comp rx=0 tx=0).stop 2024-01-19T05:18:00.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/1509873243 shutdown_connections 2024-01-19T05:18:00.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/1509873243 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac072320 0x7fe5ac14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/1509873243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac06ebe0 0x7fe5ac071de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/1509873243 >> 172.21.15.99:0/1509873243 conn(0x7fe5ac0b8080 msgr2=0x7fe5ac0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/1509873243 shutdown_connections 2024-01-19T05:18:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/1509873243 wait complete. 2024-01-19T05:18:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 Processor -- start 2024-01-19T05:18:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- start start 2024-01-19T05:18:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac06ebe0 0x7fe5ac13a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac072320 0x7fe5ac134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5ac0b19f0 0x7fe5ac1e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac139fa0 con 0x7fe5ac072320 2024-01-19T05:18:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac139170 con 0x7fe5ac0b19f0 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac139c50 con 0x7fe5ac06ebe0 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac072320 0x7fe5ac134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac072320 0x7fe5ac134aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50092/0 (socket says 172.21.15.99:50092) 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 -- 172.21.15.99:0/3639171910 learned_addr learned my addr 172.21.15.99:0/3639171910 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5aad9d640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5ac0b19f0 0x7fe5ac1e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5aa59c640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac06ebe0 0x7fe5ac13a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 -- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac06ebe0 msgr2=0x7fe5ac13a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac06ebe0 0x7fe5ac13a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 -- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5ac0b19f0 msgr2=0x7fe5ac1e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5ac0b19f0 0x7fe5ac1e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 -- 172.21.15.99:0/3639171910 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00094d0 con 0x7fe5ac072320 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5aad9d640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5ac0b19f0 0x7fe5ac1e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5a9d9b640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac072320 0x7fe5ac134aa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00ad040 tx=0x7fe5a001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe59affd640 1 -- 172.21.15.99:0/3639171910 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00be3f0 con 0x7fe5ac072320 2024-01-19T05:18:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe59affd640 1 -- 172.21.15.99:0/3639171910 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a00be550 con 0x7fe5ac072320 2024-01-19T05:18:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac139360 con 0x7fe5ac072320 2024-01-19T05:18:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe59affd640 1 -- 172.21.15.99:0/3639171910 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00be900 con 0x7fe5ac072320 2024-01-19T05:18:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.502+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac13a900 con 0x7fe5ac072320 2024-01-19T05:18:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.506+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac0696e0 con 0x7fe5ac072320 2024-01-19T05:18:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.506+0000 7fe59affd640 1 -- 172.21.15.99:0/3639171910 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe5a00c7440 con 0x7fe5ac072320 2024-01-19T05:18:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.506+0000 7fe59affd640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe58c066500 0x7fe58c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.506+0000 7fe5aa59c640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe58c066500 0x7fe58c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.506+0000 7fe59affd640 1 -- 172.21.15.99:0/3639171910 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe5a011e200 con 0x7fe5ac072320 2024-01-19T05:18:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.506+0000 7fe5aa59c640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe58c066500 0x7fe58c0689c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00b810 tx=0x7fe59c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.510+0000 7fe59affd640 1 -- 172.21.15.99:0/3639171910 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe5a00eb880 con 0x7fe5ac072320 2024-01-19T05:18:00.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.666+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5ac06f070 con 0x7fe5ac072320 2024-01-19T05:18:00.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.666+0000 7fe59affd640 1 -- 172.21.15.99:0/3639171910 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5ac06f070 con 0x7fe5ac072320 2024-01-19T05:18:00.668 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:00.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe58c066500 msgr2=0x7fe58c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe58c066500 0x7fe58c0689c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00b810 tx=0x7fe59c008040 comp rx=0 tx=0).stop 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac072320 msgr2=0x7fe5ac134aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac072320 0x7fe5ac134aa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00ad040 tx=0x7fe5a001ac80 comp rx=0 tx=0).stop 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 shutdown_connections 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe58c066500 0x7fe58c0689c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5ac0b19f0 0x7fe5ac1e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5ac072320 0x7fe5ac134aa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 --2- 172.21.15.99:0/3639171910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe5ac06ebe0 0x7fe5ac13a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 >> 172.21.15.99:0/3639171910 conn(0x7fe5ac0b8080 msgr2=0x7fe5ac142660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 shutdown_connections 2024-01-19T05:18:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.670+0000 7fe5b0a5d640 1 -- 172.21.15.99:0/3639171910 wait complete. 2024-01-19T05:18:00.686 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T05:18:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.798+0000 7ffb62633640 1 Processor -- start 2024-01-19T05:18:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.798+0000 7ffb62633640 1 -- start start 2024-01-19T05:18:00.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb62633640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffb5c06ebe0 0x7ffb5c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb62633640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c072320 0x7ffb5c14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb62633640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c06f070 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb62633640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5c070680 con 0x7ffb5c06ebe0 2024-01-19T05:18:00.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb62633640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c070410 con 0x7ffb5c072320 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb5b7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffb5c06ebe0 0x7ffb5c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb60bd0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c072320 0x7ffb5c14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb5b7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffb5c06ebe0 0x7ffb5c071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:35634/0 (socket says 172.21.15.99:35634) 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb5bfff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ffb5c0b19f0 0x7ffb5c144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:37930/0 (socket says 172.21.15.99:37930) 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb5b7fe640 1 -- 172.21.15.99:0/425214104 learned_addr learned my addr 172.21.15.99:0/425214104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb5b7fe640 1 -- 172.21.15.99:0/425214104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c072320 msgr2=0x7ffb5c14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb5b7fe640 1 --2- 172.21.15.99:0/425214104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c072320 0x7ffb5c14ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb5b7fe640 1 -- 172.21.15.99:0/425214104 >> v1:172.21.15.157:6789/0 conn(0x7ffb5c0b19f0 legacy=0x7ffb5c144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb5b7fe640 1 -- 172.21.15.99:0/425214104 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c144790 con 0x7ffb5c06ebe0 2024-01-19T05:18:00.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.802+0000 7ffb60bd0640 1 --2- 172.21.15.99:0/425214104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c072320 0x7ffb5c14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:00.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb5b7fe640 1 --2- 172.21.15.99:0/425214104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c06ebe0 0x7ffb5c071de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009870 tx=0x7ffb4c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ee797dfd1aade49 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb5affd640 1 -- 172.21.15.99:0/425214104 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0a6040 con 0x7ffb5c06ebe0 2024-01-19T05:18:00.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb5affd640 1 -- 172.21.15.99:0/425214104 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c0aa600 con 0x7ffb5c06ebe0 2024-01-19T05:18:00.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb5affd640 1 -- 172.21.15.99:0/425214104 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0aa990 con 0x7ffb5c06ebe0 2024-01-19T05:18:00.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- 172.21.15.99:0/425214104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c06ebe0 msgr2=0x7ffb5c071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 --2- 172.21.15.99:0/425214104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c06ebe0 0x7ffb5c071de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009870 tx=0x7ffb4c01c480 comp rx=0 tx=0).stop 2024-01-19T05:18:00.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- 172.21.15.99:0/425214104 shutdown_connections 2024-01-19T05:18:00.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 --2- 172.21.15.99:0/425214104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c072320 0x7ffb5c14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 --2- 172.21.15.99:0/425214104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c06ebe0 0x7ffb5c071de0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- 172.21.15.99:0/425214104 >> 172.21.15.99:0/425214104 conn(0x7ffb5c0b8080 msgr2=0x7ffb5c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:00.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- 172.21.15.99:0/425214104 shutdown_connections 2024-01-19T05:18:00.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- 172.21.15.99:0/425214104 wait complete. 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 Processor -- start 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- start start 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c06ebe0 0x7ffb5c133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c072320 0x7ffb5c1e0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb5c0b19f0 0x7ffb5c1e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c12f590 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c139000 con 0x7ffb5c072320 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c13a770 con 0x7ffb5c06ebe0 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb5c0b19f0 0x7ffb5c1e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb5c0b19f0 0x7ffb5c1e05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50096/0 (socket says 172.21.15.99:50096) 2024-01-19T05:18:00.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 -- 172.21.15.99:0/1119183515 learned_addr learned my addr 172.21.15.99:0/1119183515 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb5bfff640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c06ebe0 0x7ffb5c133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb5b7fe640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c072320 0x7ffb5c1e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 -- 172.21.15.99:0/1119183515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c06ebe0 msgr2=0x7ffb5c133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c06ebe0 0x7ffb5c133cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 -- 172.21.15.99:0/1119183515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c072320 msgr2=0x7ffb5c1e0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c072320 0x7ffb5c1e0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 -- 172.21.15.99:0/1119183515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009a70 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb60bd0640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb5c0b19f0 0x7ffb5c1e05a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400efc0 tx=0x7ffb54009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb58ff9640 1 -- 172.21.15.99:0/1119183515 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54009d70 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb58ff9640 1 -- 172.21.15.99:0/1119183515 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5400f040 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c0094d0 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb58ff9640 1 -- 172.21.15.99:0/1119183515 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb540039a0 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.806+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c138d20 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.810+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c0696e0 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.810+0000 7ffb58ff9640 1 -- 172.21.15.99:0/1119183515 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ffb540144a0 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.810+0000 7ffb58ff9640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ffb48066500 0x7ffb480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:00.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.810+0000 7ffb5bfff640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ffb48066500 0x7ffb480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:00.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.810+0000 7ffb58ff9640 1 -- 172.21.15.99:0/1119183515 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb54084850 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.810+0000 7ffb5bfff640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ffb48066500 0x7ffb480689c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0ae670 tx=0x7ffb50007cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.814+0000 7ffb58ff9640 1 -- 172.21.15.99:0/1119183515 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ffb54051e30 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.958+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffb5c12f7e0 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.958+0000 7ffb58ff9640 1 -- 172.21.15.99:0/1119183515 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ffb54055450 con 0x7ffb5c0b19f0 2024-01-19T05:18:00.960 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:00.961 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-01-19T05:18:00.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:00.961 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-01-19T05:18:00.961 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-01-19T05:18:00.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:00.961 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ffb48066500 msgr2=0x7ffb480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ffb48066500 0x7ffb480689c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0ae670 tx=0x7ffb50007cf0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb5c0b19f0 msgr2=0x7ffb5c1e05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb5c0b19f0 0x7ffb5c1e05a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400efc0 tx=0x7ffb54009f90 comp rx=0 tx=0).stop 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 shutdown_connections 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ffb48066500 0x7ffb480689c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb5c0b19f0 0x7ffb5c1e05a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb5c072320 0x7ffb5c1e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 --2- 172.21.15.99:0/1119183515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb5c06ebe0 0x7ffb5c133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 >> 172.21.15.99:0/1119183515 conn(0x7ffb5c0b8080 msgr2=0x7ffb5c0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:00.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 shutdown_connections 2024-01-19T05:18:00.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:00.962+0000 7ffb62633640 1 -- 172.21.15.99:0/1119183515 wait complete. 2024-01-19T05:18:00.978 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-19T05:18:00.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-19T05:18:01.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3bbe0640 1 Processor -- start 2024-01-19T05:18:01.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3bbe0640 1 -- start start 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3bbe0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b34140780 0x7f9b34140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3bbe0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b340b87f0 con 0x7f9b340b96f0 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3bbe0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b340b9ad0 con 0x7f9b3414f1b0 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3bbe0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b34141120 con 0x7f9b34140780 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3997c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9b340b96f0 0x7f9b340b7700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34116/0 (socket says 172.21.15.99:34116) 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3997c640 1 -- 172.21.15.99:0/3655990801 learned_addr learned my addr 172.21.15.99:0/3655990801 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564517592 0 0) 0x7f9b340b87f0 con 0x7f9b340b96f0 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b20003530 con 0x7f9b340b96f0 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3917b640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b34140780 0x7f9b34140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2259175676 0 0) 0x7f9b20003530 con 0x7f9b340b96f0 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b34140780 msgr2=0x7f9b34140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b34140780 0x7f9b34140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 >> v1:172.21.15.157:6789/0 conn(0x7f9b3414f1b0 legacy=0x7f9b341515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b340b81e0 con 0x7f9b340b96f0 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f9b2c001a00 con 0x7f9b340b96f0 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 >> v1:172.21.15.99:6789/0 conn(0x7f9b340b96f0 legacy=0x7f9b340b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b200039b0 0x7f9b20003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b34140780 0x7f9b200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b20004d10 0x7f9b20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b34141120 con 0x7f9b20004d10 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2000bb20 con 0x7f9b200039b0 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2000bcb0 con 0x7f9b34140780 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3a17d640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b20004d10 0x7f9b20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3917b640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b34140780 0x7f9b200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3997c640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b200039b0 0x7f9b20003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3a17d640 1 -- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b34140780 msgr2=0x7f9b200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3a17d640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b34140780 0x7f9b200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3a17d640 1 -- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b200039b0 msgr2=0x7f9b20003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3a17d640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b200039b0 0x7f9b20003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.098+0000 7f9b3a17d640 1 -- 172.21.15.99:0/3655990801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b20003530 con 0x7f9b20004d10 2024-01-19T05:18:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3a17d640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b20004d10 0x7f9b20005190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b30001750 tx=0x7f9b3001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b6989c8ae1f5c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300052d0 con 0x7f9b20004d10 2024-01-19T05:18:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b300a7050 con 0x7f9b20004d10 2024-01-19T05:18:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3897a640 1 -- 172.21.15.99:0/3655990801 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30003600 con 0x7f9b20004d10 2024-01-19T05:18:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3655990801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b20004d10 msgr2=0x7f9b20005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 --2- 172.21.15.99:0/3655990801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b20004d10 0x7f9b20005190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b30001750 tx=0x7f9b3001c380 comp rx=0 tx=0).stop 2024-01-19T05:18:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3a17d640 1 -- 172.21.15.99:0/3655990801 reap_dead start 2024-01-19T05:18:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3655990801 shutdown_connections 2024-01-19T05:18:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3655990801 >> 172.21.15.99:0/3655990801 conn(0x7f9b3409e600 msgr2=0x7f9b340b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3655990801 shutdown_connections 2024-01-19T05:18:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3655990801 wait complete. 2024-01-19T05:18:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 Processor -- start 2024-01-19T05:18:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- start start 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b20004d10 0x7f9b34144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3409b680 0x7f9b341378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b34137e00 0x7f9b34133f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b34139020 con 0x7f9b3409b680 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3409aba0 con 0x7f9b34137e00 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.102+0000 7f9b3bbe0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3409ae80 con 0x7f9b20004d10 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3409b680 0x7f9b341378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3409b680 0x7f9b341378c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50104/0 (socket says 172.21.15.99:50104) 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 -- 172.21.15.99:0/3846005395 learned_addr learned my addr 172.21.15.99:0/3846005395 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3997c640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b20004d10 0x7f9b34144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3a17d640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b34137e00 0x7f9b34133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 -- 172.21.15.99:0/3846005395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b20004d10 msgr2=0x7f9b34144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b20004d10 0x7f9b34144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 -- 172.21.15.99:0/3846005395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b34137e00 msgr2=0x7f9b34133f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b34137e00 0x7f9b34133f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 -- 172.21.15.99:0/3846005395 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3409b160 con 0x7f9b3409b680 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3917b640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3409b680 0x7f9b341378c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400f580 tx=0x7f9b2400fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b2a7fc640 1 -- 172.21.15.99:0/3846005395 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24014870 con 0x7f9b3409b680 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b2a7fc640 1 -- 172.21.15.99:0/3846005395 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b240149d0 con 0x7f9b3409b680 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b34099eb0 con 0x7f9b3409b680 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b2a7fc640 1 -- 172.21.15.99:0/3846005395 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24014d60 con 0x7f9b3409b680 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b34134480 con 0x7f9b3409b680 2024-01-19T05:18:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3409bb00 con 0x7f9b3409b680 2024-01-19T05:18:01.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b2a7fc640 1 -- 172.21.15.99:0/3846005395 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9b24015410 con 0x7f9b3409b680 2024-01-19T05:18:01.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b2a7fc640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9b18066530 0x7f9b180689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b2a7fc640 1 -- 172.21.15.99:0/3846005395 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9b24084570 con 0x7f9b3409b680 2024-01-19T05:18:01.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3997c640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9b18066530 0x7f9b180689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.106+0000 7f9b3997c640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9b18066530 0x7f9b180689f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c002240 tx=0x7f9b2c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.110+0000 7f9b2a7fc640 1 -- 172.21.15.99:0/3846005395 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9b24051b70 con 0x7f9b3409b680 2024-01-19T05:18:01.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.262+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9b340696e0 con 0x7f9b3409b680 2024-01-19T05:18:01.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.618+0000 7f9b2a7fc640 1 -- 172.21.15.99:0/3846005395 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9b24055190 con 0x7f9b3409b680 2024-01-19T05:18:01.620 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9b18066530 msgr2=0x7f9b180689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9b18066530 0x7f9b180689f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c002240 tx=0x7f9b2c009040 comp rx=0 tx=0).stop 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3409b680 msgr2=0x7f9b341378c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3409b680 0x7f9b341378c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400f580 tx=0x7f9b2400fa40 comp rx=0 tx=0).stop 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 shutdown_connections 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9b18066530 0x7f9b180689f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b34137e00 0x7f9b34133f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3409b680 0x7f9b341378c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 --2- 172.21.15.99:0/3846005395 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b20004d10 0x7f9b34144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 >> 172.21.15.99:0/3846005395 conn(0x7f9b3409e600 msgr2=0x7f9b340b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:01.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 shutdown_connections 2024-01-19T05:18:01.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.622+0000 7f9b3bbe0640 1 -- 172.21.15.99:0/3846005395 wait complete. 2024-01-19T05:18:01.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T05:18:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.774+0000 7f1a21c39640 1 Processor -- start 2024-01-19T05:18:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.774+0000 7f1a21c39640 1 -- start start 2024-01-19T05:18:01.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a21c39640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a1c0adf40 0x7f1a1c142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a21c39640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1a1c143350 0x7f1a1c1437a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a21c39640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c0b3ee0 con 0x7f1a1c0b4410 2024-01-19T05:18:01.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a21c39640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c143ce0 con 0x7f1a1c0adf40 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a21c39640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c0ad390 con 0x7f1a1c143350 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1b7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1a1c0b4410 0x7f1a1c0999f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34118/0 (socket says 172.21.15.99:34118) 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1b7fe640 1 -- 172.21.15.99:0/2257412105 learned_addr learned my addr 172.21.15.99:0/2257412105 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1affd640 1 --2- 172.21.15.99:0/2257412105 >> v2:172.21.15.99:3300/0 conn(0x7f1a1c0adf40 0x7f1a1c142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1bfff640 1 --2- 172.21.15.99:0/2257412105 >> v2:172.21.15.157:3300/0 conn(0x7f1a1c143350 0x7f1a1c1437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1a7fc640 1 -- 172.21.15.99:0/2257412105 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810380228 0 0) 0x7f1a1c0b3ee0 con 0x7f1a1c0b4410 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1a7fc640 1 -- 172.21.15.99:0/2257412105 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a08003530 con 0x7f1a1c0b4410 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1affd640 1 -- 172.21.15.99:0/2257412105 >> v2:172.21.15.157:3300/0 conn(0x7f1a1c143350 msgr2=0x7f1a1c1437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1affd640 1 --2- 172.21.15.99:0/2257412105 >> v2:172.21.15.157:3300/0 conn(0x7f1a1c143350 0x7f1a1c1437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1affd640 1 -- 172.21.15.99:0/2257412105 >> v1:172.21.15.99:6789/0 conn(0x7f1a1c0b4410 legacy=0x7f1a1c0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1affd640 1 -- 172.21.15.99:0/2257412105 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0b47f0 con 0x7f1a1c0adf40 2024-01-19T05:18:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1affd640 1 --2- 172.21.15.99:0/2257412105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0adf40 0x7f1a1c142e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c072880 tx=0x7f1a0c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b1c61d49c6d07b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1a7fc640 1 -- 172.21.15.99:0/2257412105 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c004230 con 0x7f1a1c0adf40 2024-01-19T05:18:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1a7fc640 1 -- 172.21.15.99:0/2257412105 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c0a7050 con 0x7f1a1c0adf40 2024-01-19T05:18:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.778+0000 7f1a1a7fc640 1 -- 172.21.15.99:0/2257412105 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c003620 con 0x7f1a1c0adf40 2024-01-19T05:18:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- 172.21.15.99:0/2257412105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0adf40 msgr2=0x7f1a1c142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 --2- 172.21.15.99:0/2257412105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0adf40 0x7f1a1c142e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c072880 tx=0x7f1a0c01c3d0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- 172.21.15.99:0/2257412105 shutdown_connections 2024-01-19T05:18:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 --2- 172.21.15.99:0/2257412105 >> v2:172.21.15.157:3300/0 conn(0x7f1a1c143350 0x7f1a1c1437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 --2- 172.21.15.99:0/2257412105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0adf40 0x7f1a1c142e10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- 172.21.15.99:0/2257412105 >> 172.21.15.99:0/2257412105 conn(0x7f1a1c0b8600 msgr2=0x7f1a1c0b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- 172.21.15.99:0/2257412105 shutdown_connections 2024-01-19T05:18:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- 172.21.15.99:0/2257412105 wait complete. 2024-01-19T05:18:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 Processor -- start 2024-01-19T05:18:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- start start 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1c0adf40 0x7f1a1c13d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0b4410 0x7f1a1c0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1c143350 0x7f1a1c1e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0b1540 con 0x7f1a1c0b4410 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c06ebc0 con 0x7f1a1c143350 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c06eea0 con 0x7f1a1c0adf40 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0b4410 0x7f1a1c0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0b4410 0x7f1a1c0b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50120/0 (socket says 172.21.15.99:50120) 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 -- 172.21.15.99:0/3037148625 learned_addr learned my addr 172.21.15.99:0/3037148625 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1b7fe640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1c0adf40 0x7f1a1c13d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1bfff640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1c143350 0x7f1a1c1e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 -- 172.21.15.99:0/3037148625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1c0adf40 msgr2=0x7f1a1c13d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1c0adf40 0x7f1a1c13d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 -- 172.21.15.99:0/3037148625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1c143350 msgr2=0x7f1a1c1e1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1c143350 0x7f1a1c1e1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 -- 172.21.15.99:0/3037148625 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009420 con 0x7f1a1c0b4410 2024-01-19T05:18:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a1affd640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0b4410 0x7f1a1c0b1d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0ae040 tx=0x7f1a0c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a13fff640 1 -- 172.21.15.99:0/3037148625 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c003e60 con 0x7f1a1c0b4410 2024-01-19T05:18:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a13fff640 1 -- 172.21.15.99:0/3037148625 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c006e20 con 0x7f1a1c0b4410 2024-01-19T05:18:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a13fff640 1 -- 172.21.15.99:0/3037148625 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0ab6a0 con 0x7f1a1c0b4410 2024-01-19T05:18:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c0b0ef0 con 0x7f1a1c0b4410 2024-01-19T05:18:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.782+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c0b22b0 con 0x7f1a1c0b4410 2024-01-19T05:18:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.786+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c0696e0 con 0x7f1a1c0b4410 2024-01-19T05:18:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.786+0000 7f1a13fff640 1 -- 172.21.15.99:0/3037148625 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1a0c0b2040 con 0x7f1a1c0b4410 2024-01-19T05:18:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.786+0000 7f1a13fff640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19fc066500 0x7f19fc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.786+0000 7f1a13fff640 1 -- 172.21.15.99:0/3037148625 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1a0c11df70 con 0x7f1a1c0b4410 2024-01-19T05:18:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.786+0000 7f1a1b7fe640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19fc066500 0x7f19fc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.786+0000 7f1a1b7fe640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19fc066500 0x7f19fc0689c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a04005890 tx=0x7f1a04009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.790+0000 7f1a13fff640 1 -- 172.21.15.99:0/3037148625 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1a0c0eb3e0 con 0x7f1a1c0b4410 2024-01-19T05:18:01.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:01.938+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1a1c140f80 con 0x7f1a1c0b4410 2024-01-19T05:18:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.622+0000 7f1a13fff640 1 -- 172.21.15.99:0/3037148625 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1a0c0eea00 con 0x7f1a1c0b4410 2024-01-19T05:18:02.625 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-01-19T05:18:02.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19fc066500 msgr2=0x7f19fc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19fc066500 0x7f19fc0689c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a04005890 tx=0x7f1a04009040 comp rx=0 tx=0).stop 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0b4410 msgr2=0x7f1a1c0b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0b4410 0x7f1a1c0b1d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0ae040 tx=0x7f1a0c019170 comp rx=0 tx=0).stop 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 shutdown_connections 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19fc066500 0x7f19fc0689c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a1c143350 0x7f1a1c1e1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a1c0b4410 0x7f1a1c0b1d70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 --2- 172.21.15.99:0/3037148625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1a1c0adf40 0x7f1a1c13d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 >> 172.21.15.99:0/3037148625 conn(0x7f1a1c0b8600 msgr2=0x7f1a1c06c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 shutdown_connections 2024-01-19T05:18:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.626+0000 7f1a21c39640 1 -- 172.21.15.99:0/3037148625 wait complete. 2024-01-19T05:18:02.664 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-19T05:18:02.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.782+0000 7fc60ae37640 1 Processor -- start 2024-01-19T05:18:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.782+0000 7fc60ae37640 1 -- start start 2024-01-19T05:18:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc60ae37640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc60406ebe0 0x7fc604071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc60ae37640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc604072320 0x7fc60414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc60ae37640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc604070680 con 0x7fc6040b19f0 2024-01-19T05:18:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc60ae37640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc604070410 con 0x7fc604072320 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc60ae37640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60406f040 con 0x7fc60406ebe0 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6093d4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc604072320 0x7fc60414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6093d4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc604072320 0x7fc60414ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55450/0 (socket says 172.21.15.99:55450) 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6093d4640 1 -- 172.21.15.99:0/2183597840 learned_addr learned my addr 172.21.15.99:0/2183597840 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6093d4640 1 -- 172.21.15.99:0/2183597840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc60406ebe0 msgr2=0x7fc604071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc603fff640 1 --2- 172.21.15.99:0/2183597840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc60406ebe0 0x7fc604071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6093d4640 1 --2- 172.21.15.99:0/2183597840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc60406ebe0 0x7fc604071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6093d4640 1 -- 172.21.15.99:0/2183597840 >> v1:172.21.15.157:6789/0 conn(0x7fc6040b19f0 legacy=0x7fc604144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6093d4640 1 -- 172.21.15.99:0/2183597840 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604144790 con 0x7fc604072320 2024-01-19T05:18:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc603fff640 1 --2- 172.21.15.99:0/2183597840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc60406ebe0 0x7fc604071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:02.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6093d4640 1 --2- 172.21.15.99:0/2183597840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc604072320 0x7fc60414ee90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc604070810 tx=0x7fc5f401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af4bba1e6c47ce8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6037fe640 1 -- 172.21.15.99:0/2183597840 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ab600 con 0x7fc604072320 2024-01-19T05:18:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6037fe640 1 -- 172.21.15.99:0/2183597840 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40ab760 con 0x7fc604072320 2024-01-19T05:18:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.786+0000 7fc6037fe640 1 -- 172.21.15.99:0/2183597840 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40abaf0 con 0x7fc604072320 2024-01-19T05:18:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- 172.21.15.99:0/2183597840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc604072320 msgr2=0x7fc60414ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2183597840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc604072320 0x7fc60414ee90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc604070810 tx=0x7fc5f401c420 comp rx=0 tx=0).stop 2024-01-19T05:18:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- 172.21.15.99:0/2183597840 shutdown_connections 2024-01-19T05:18:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2183597840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc604072320 0x7fc60414ee90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2183597840 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc60406ebe0 0x7fc604071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- 172.21.15.99:0/2183597840 >> 172.21.15.99:0/2183597840 conn(0x7fc6040b8080 msgr2=0x7fc6040b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- 172.21.15.99:0/2183597840 shutdown_connections 2024-01-19T05:18:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- 172.21.15.99:0/2183597840 wait complete. 2024-01-19T05:18:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 Processor -- start 2024-01-19T05:18:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- start start 2024-01-19T05:18:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60406ebe0 0x7fc6040b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc604072320 0x7fc6041e0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6040b19f0 0x7fc60413f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041dfe60 con 0x7fc60406ebe0 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60413ec70 con 0x7fc604072320 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc604141820 con 0x7fc6040b19f0 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60406ebe0 0x7fc6040b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60406ebe0 0x7fc6040b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55464/0 (socket says 172.21.15.99:55464) 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 -- 172.21.15.99:0/2369745596 learned_addr learned my addr 172.21.15.99:0/2369745596 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc603fff640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc604072320 0x7fc6041e0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc6093d4640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6040b19f0 0x7fc60413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 -- 172.21.15.99:0/2369745596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6040b19f0 msgr2=0x7fc60413f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6040b19f0 0x7fc60413f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 -- 172.21.15.99:0/2369745596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc604072320 msgr2=0x7fc6041e0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc604072320 0x7fc6041e0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 -- 172.21.15.99:0/2369745596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f40094d0 con 0x7fc60406ebe0 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc608bd3640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60406ebe0 0x7fc6040b7460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00c450 tx=0x7fc5fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc6017fa640 1 -- 172.21.15.99:0/2369745596 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc012830 con 0x7fc60406ebe0 2024-01-19T05:18:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc6017fa640 1 -- 172.21.15.99:0/2369745596 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0129b0 con 0x7fc60406ebe0 2024-01-19T05:18:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60413d5c0 con 0x7fc60406ebe0 2024-01-19T05:18:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc6017fa640 1 -- 172.21.15.99:0/2369745596 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc012d60 con 0x7fc60406ebe0 2024-01-19T05:18:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6041e0070 con 0x7fc60406ebe0 2024-01-19T05:18:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.790+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6040ae4a0 con 0x7fc60406ebe0 2024-01-19T05:18:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.794+0000 7fc6017fa640 1 -- 172.21.15.99:0/2369745596 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc5fc01c460 con 0x7fc60406ebe0 2024-01-19T05:18:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.794+0000 7fc6017fa640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc5e4066500 0x7fc5e40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.794+0000 7fc603fff640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc5e4066500 0x7fc5e40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.794+0000 7fc6017fa640 1 -- 172.21.15.99:0/2369745596 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc5fc0847c0 con 0x7fc60406ebe0 2024-01-19T05:18:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.794+0000 7fc603fff640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc5e4066500 0x7fc5e40689c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec007510 tx=0x7fc5ec0074a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.798+0000 7fc6017fa640 1 -- 172.21.15.99:0/2369745596 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc5fc051b30 con 0x7fc60406ebe0 2024-01-19T05:18:02.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:02.986+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc6041e0290 con 0x7fc60406ebe0 2024-01-19T05:18:03.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.658+0000 7fc6017fa640 1 -- 172.21.15.99:0/2369745596 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc5fc055150 con 0x7fc60406ebe0 2024-01-19T05:18:03.660 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 2 and data pool 3 2024-01-19T05:18:03.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc5e4066500 msgr2=0x7fc5e40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:03.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc5e4066500 0x7fc5e40689c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec007510 tx=0x7fc5ec0074a0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60406ebe0 msgr2=0x7fc6040b7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60406ebe0 0x7fc6040b7460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00c450 tx=0x7fc5fc00c910 comp rx=0 tx=0).stop 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 shutdown_connections 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc5e4066500 0x7fc5e40689c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6040b19f0 0x7fc60413f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc604072320 0x7fc6041e0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 --2- 172.21.15.99:0/2369745596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60406ebe0 0x7fc6040b7460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 >> 172.21.15.99:0/2369745596 conn(0x7fc6040b8080 msgr2=0x7fc604142560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 shutdown_connections 2024-01-19T05:18:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.662+0000 7fc60ae37640 1 -- 172.21.15.99:0/2369745596 wait complete. 2024-01-19T05:18:03.689 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.806+0000 7fbf31edb640 1 Processor -- start 2024-01-19T05:18:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf31edb640 1 -- start start 2024-01-19T05:18:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf31edb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbf2c0b2ce0 0x7fbf2c071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf31edb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1441d0 0x7fbf2c072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf31edb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c06f620 con 0x7fbf2c0b1870 2024-01-19T05:18:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf31edb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c141000 con 0x7fbf2c0b2ce0 2024-01-19T05:18:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf31edb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c143610 con 0x7fbf2c1441d0 2024-01-19T05:18:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2affd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbf2c0b1870 0x7fbf2c143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42392/0 (socket says 172.21.15.99:42392) 2024-01-19T05:18:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2affd640 1 -- 172.21.15.99:0/1418086822 learned_addr learned my addr 172.21.15.99:0/1418086822 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444040375 0 0) 0x7fbf2c06f620 con 0x7fbf2c0b1870 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf18003530 con 0x7fbf2c0b1870 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/1418086822 >> v2:172.21.15.157:3300/0 conn(0x7fbf2c0b2ce0 0x7fbf2c071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2bfff640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1441d0 0x7fbf2c072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 889252267 0 0) 0x7fbf18003530 con 0x7fbf2c0b1870 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1441d0 msgr2=0x7fbf2c072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1441d0 0x7fbf2c072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 >> v2:172.21.15.157:3300/0 conn(0x7fbf2c0b2ce0 msgr2=0x7fbf2c071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 --2- 172.21.15.99:0/1418086822 >> v2:172.21.15.157:3300/0 conn(0x7fbf2c0b2ce0 0x7fbf2c071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0b30c0 con 0x7fbf2c0b1870 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fbf24001a00 con 0x7fbf2c0b1870 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 >> v1:172.21.15.99:6789/0 conn(0x7fbf2c0b1870 legacy=0x7fbf2c143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf18003980 0x7fbf18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1441d0 0x7fbf180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18004d10 0x7fbf18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c141000 con 0x7fbf18003980 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c143610 con 0x7fbf18004d10 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1800ba40 con 0x7fbf2c1441d0 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf18003980 0x7fbf18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2affd640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1441d0 0x7fbf180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2bfff640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18004d10 0x7fbf18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2b7fe640 1 -- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1441d0 msgr2=0x7fbf180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1441d0 0x7fbf180047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2b7fe640 1 -- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18004d10 msgr2=0x7fbf18005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18004d10 0x7fbf18005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.810+0000 7fbf2b7fe640 1 -- 172.21.15.99:0/1418086822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18003530 con 0x7fbf18003980 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf18003980 0x7fbf18003da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400ba40 tx=0x7fbf1401e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5800dbd9e0c17be2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140ad670 con 0x7fbf18003980 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf140ad7d0 con 0x7fbf18003980 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2a7fc640 1 -- 172.21.15.99:0/1418086822 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140adb80 con 0x7fbf18003980 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- 172.21.15.99:0/1418086822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf18003980 msgr2=0x7fbf18003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 --2- 172.21.15.99:0/1418086822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf18003980 0x7fbf18003da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400ba40 tx=0x7fbf1401e860 comp rx=0 tx=0).stop 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2bfff640 1 -- 172.21.15.99:0/1418086822 reap_dead start 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- 172.21.15.99:0/1418086822 shutdown_connections 2024-01-19T05:18:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- 172.21.15.99:0/1418086822 >> 172.21.15.99:0/1418086822 conn(0x7fbf2c0b8080 msgr2=0x7fbf2c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- 172.21.15.99:0/1418086822 shutdown_connections 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- 172.21.15.99:0/1418086822 wait complete. 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 Processor -- start 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- start start 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18003980 0x7fbf2c0a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf2c0aa780 0x7fbf2c13c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1de060 0x7fbf2c1de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0a8b20 con 0x7fbf2c0aa780 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c13a090 con 0x7fbf18003980 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0706d0 con 0x7fbf2c1de060 2024-01-19T05:18:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf2c0aa780 0x7fbf2c13c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf2c0aa780 0x7fbf2c13c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55468/0 (socket says 172.21.15.99:55468) 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 -- 172.21.15.99:0/3133965113 learned_addr learned my addr 172.21.15.99:0/3133965113 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2bfff640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1de060 0x7fbf2c1de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18003980 0x7fbf2c0a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 -- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1de060 msgr2=0x7fbf2c1de4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1de060 0x7fbf2c1de4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 -- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18003980 msgr2=0x7fbf2c0a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18003980 0x7fbf2c0a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 -- 172.21.15.99:0/3133965113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0aaf40 con 0x7fbf2c0aa780 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2bfff640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1de060 0x7fbf2c1de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18003980 0x7fbf2c0a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf2affd640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf2c0aa780 0x7fbf2c13c1e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf240021c0 tx=0x7fbf2400b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf23fff640 1 -- 172.21.15.99:0/3133965113 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24004d70 con 0x7fbf2c0aa780 2024-01-19T05:18:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf23fff640 1 -- 172.21.15.99:0/3133965113 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf240070d0 con 0x7fbf2c0aa780 2024-01-19T05:18:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c0ab220 con 0x7fbf2c0aa780 2024-01-19T05:18:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf23fff640 1 -- 172.21.15.99:0/3133965113 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24007480 con 0x7fbf2c0aa780 2024-01-19T05:18:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.814+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c0a8740 con 0x7fbf2c0aa780 2024-01-19T05:18:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.818+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c0a8c60 con 0x7fbf2c0aa780 2024-01-19T05:18:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.818+0000 7fbf23fff640 1 -- 172.21.15.99:0/3133965113 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbf240075e0 con 0x7fbf2c0aa780 2024-01-19T05:18:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.818+0000 7fbf23fff640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbf0c066500 0x7fbf0c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.818+0000 7fbf23fff640 1 -- 172.21.15.99:0/3133965113 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf24084390 con 0x7fbf2c0aa780 2024-01-19T05:18:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.818+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbf0c066500 0x7fbf0c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.818+0000 7fbf2b7fe640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbf0c066500 0x7fbf0c0689c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf140b1000 tx=0x7fbf140046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.822+0000 7fbf23fff640 1 -- 172.21.15.99:0/3133965113 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbf2c0a8c60 con 0x7fbf2c0aa780 2024-01-19T05:18:03.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.978+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf2c0a8c60 con 0x7fbf2c0aa780 2024-01-19T05:18:03.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.978+0000 7fbf23fff640 1 -- 172.21.15.99:0/3133965113 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16483 (secure 0 0 0) 0x7fbf2c0a8c60 con 0x7fbf2c0aa780 2024-01-19T05:18:03.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:03.981 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:02.994158+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbf0c066500 msgr2=0x7fbf0c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbf0c066500 0x7fbf0c0689c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf140b1000 tx=0x7fbf140046d0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf2c0aa780 msgr2=0x7fbf2c13c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf2c0aa780 0x7fbf2c13c1e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf240021c0 tx=0x7fbf2400b560 comp rx=0 tx=0).stop 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 shutdown_connections 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbf0c066500 0x7fbf0c0689c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf2c1de060 0x7fbf2c1de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf2c0aa780 0x7fbf2c13c1e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 --2- 172.21.15.99:0/3133965113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf18003980 0x7fbf2c0a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 >> 172.21.15.99:0/3133965113 conn(0x7fbf2c0b8080 msgr2=0x7fbf2c1423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 shutdown_connections 2024-01-19T05:18:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:03.982+0000 7fbf31edb640 1 -- 172.21.15.99:0/3133965113 wait complete. 2024-01-19T05:18:04.000 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:04.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.118+0000 7f6bcaca0640 1 Processor -- start 2024-01-19T05:18:04.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.118+0000 7f6bcaca0640 1 -- start start 2024-01-19T05:18:04.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bcaca0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6bc409b420 0x7f6bc40b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bcaca0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6bc4146c20 0x7f6bc41470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bcaca0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc41475f0 con 0x7f6bc406ab40 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bcaca0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc406b500 con 0x7f6bc409b420 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bcaca0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc4141120 con 0x7f6bc4146c20 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6bc409b420 0x7f6bc40b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6bc409b420 0x7f6bc40b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55480/0 (socket says 172.21.15.99:55480) 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc3fff640 1 -- 172.21.15.99:0/2658705042 learned_addr learned my addr 172.21.15.99:0/2658705042 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc923d640 1 --2- 172.21.15.99:0/2658705042 >> v2:172.21.15.157:3300/0 conn(0x7f6bc4146c20 0x7f6bc41470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc3fff640 1 -- 172.21.15.99:0/2658705042 >> v2:172.21.15.157:3300/0 conn(0x7f6bc4146c20 msgr2=0x7f6bc41470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc3fff640 1 --2- 172.21.15.99:0/2658705042 >> v2:172.21.15.157:3300/0 conn(0x7f6bc4146c20 0x7f6bc41470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc3fff640 1 -- 172.21.15.99:0/2658705042 >> v1:172.21.15.157:6789/0 conn(0x7f6bc406ab40 legacy=0x7f6bc409ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc3fff640 1 -- 172.21.15.99:0/2658705042 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc406af20 con 0x7f6bc409b420 2024-01-19T05:18:04.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc3fff640 1 --2- 172.21.15.99:0/2658705042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc409b420 0x7f6bc40b7490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6bc406c9b0 tx=0x7f6bbc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88eae5124720c530 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc37fe640 1 -- 172.21.15.99:0/2658705042 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0a5720 con 0x7f6bc409b420 2024-01-19T05:18:04.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc37fe640 1 -- 172.21.15.99:0/2658705042 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0a5880 con 0x7f6bc409b420 2024-01-19T05:18:04.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.122+0000 7f6bc37fe640 1 -- 172.21.15.99:0/2658705042 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0a5c10 con 0x7f6bc409b420 2024-01-19T05:18:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- 172.21.15.99:0/2658705042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc409b420 msgr2=0x7f6bc40b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/2658705042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc409b420 0x7f6bc40b7490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6bc406c9b0 tx=0x7f6bbc01c970 comp rx=0 tx=0).stop 2024-01-19T05:18:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- 172.21.15.99:0/2658705042 shutdown_connections 2024-01-19T05:18:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/2658705042 >> v2:172.21.15.157:3300/0 conn(0x7f6bc4146c20 0x7f6bc41470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/2658705042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc409b420 0x7f6bc40b7490 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- 172.21.15.99:0/2658705042 >> 172.21.15.99:0/2658705042 conn(0x7f6bc40b8e80 msgr2=0x7f6bc40b9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- 172.21.15.99:0/2658705042 shutdown_connections 2024-01-19T05:18:04.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- 172.21.15.99:0/2658705042 wait complete. 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 Processor -- start 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- start start 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc406ab40 0x7f6bc40a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6bc409b420 0x7f6bc41e2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc4146c20 0x7f6bc41e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40b5320 con 0x7f6bc406ab40 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40b5c90 con 0x7f6bc4146c20 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40b5800 con 0x7f6bc409b420 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc406ab40 0x7f6bc40a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc406ab40 0x7f6bc40a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55492/0 (socket says 172.21.15.99:55492) 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 -- 172.21.15.99:0/3134694186 learned_addr learned my addr 172.21.15.99:0/3134694186 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc923d640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc4146c20 0x7f6bc41e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc3fff640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6bc409b420 0x7f6bc41e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 -- 172.21.15.99:0/3134694186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6bc409b420 msgr2=0x7f6bc41e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6bc409b420 0x7f6bc41e2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 -- 172.21.15.99:0/3134694186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc4146c20 msgr2=0x7f6bc41e2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc4146c20 0x7f6bc41e2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 -- 172.21.15.99:0/3134694186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009b30 con 0x7f6bc406ab40 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc8a3c640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc406ab40 0x7f6bc40a1770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c480 tx=0x7f6bac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc17fa640 1 -- 172.21.15.99:0/3134694186 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac012830 con 0x7f6bc406ab40 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc17fa640 1 -- 172.21.15.99:0/3134694186 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac0129b0 con 0x7f6bc406ab40 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc40b5ec0 con 0x7f6bc406ab40 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bc17fa640 1 -- 172.21.15.99:0/3134694186 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac012d60 con 0x7f6bc406ab40 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc41e2050 con 0x7f6bc406ab40 2024-01-19T05:18:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.126+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc4067bf0 con 0x7f6bc406ab40 2024-01-19T05:18:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.130+0000 7f6bc17fa640 1 -- 172.21.15.99:0/3134694186 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6bac01c460 con 0x7f6bc406ab40 2024-01-19T05:18:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.130+0000 7f6bc17fa640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ba4066500 0x7f6ba40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.130+0000 7f6bc17fa640 1 -- 172.21.15.99:0/3134694186 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bac083d30 con 0x7f6bc406ab40 2024-01-19T05:18:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.130+0000 7f6bc3fff640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ba4066500 0x7f6ba40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.130+0000 7f6bc3fff640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ba4066500 0x7f6ba40689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0ae000 tx=0x7f6bbc0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.134+0000 7f6bc17fa640 1 -- 172.21.15.99:0/3134694186 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6bac051060 con 0x7f6bc406ab40 2024-01-19T05:18:04.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.290+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bc40696e0 con 0x7f6bc406ab40 2024-01-19T05:18:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.290+0000 7f6bc17fa640 1 -- 172.21.15.99:0/3134694186 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16483 (secure 0 0 0) 0x7f6bac054680 con 0x7f6bc406ab40 2024-01-19T05:18:04.292 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:02.994158+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ba4066500 msgr2=0x7f6ba40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ba4066500 0x7f6ba40689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0ae000 tx=0x7f6bbc0a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc406ab40 msgr2=0x7f6bc40a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc406ab40 0x7f6bc40a1770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c480 tx=0x7f6bac00c940 comp rx=0 tx=0).stop 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 shutdown_connections 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ba4066500 0x7f6ba40689c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc4146c20 0x7f6bc41e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6bc409b420 0x7f6bc41e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 --2- 172.21.15.99:0/3134694186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bc406ab40 0x7f6bc40a1770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 >> 172.21.15.99:0/3134694186 conn(0x7f6bc40b8e80 msgr2=0x7f6bc4144880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 shutdown_connections 2024-01-19T05:18:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.294+0000 7f6bcaca0640 1 -- 172.21.15.99:0/3134694186 wait complete. 2024-01-19T05:18:04.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-19T05:18:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.426+0000 7f27565af640 1 Processor -- start 2024-01-19T05:18:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.426+0000 7f27565af640 1 -- start start 2024-01-19T05:18:04.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f27565af640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f27500b2ce0 0x7f2750071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f27565af640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501441d0 0x7f2750072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f27565af640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275006f620 con 0x7f27500b1870 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f27565af640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2750141000 con 0x7f27500b2ce0 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f27565af640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2750143610 con 0x7f27501441d0 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274f7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f27500b1870 0x7f2750143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42396/0 (socket says 172.21.15.99:42396) 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274f7fe640 1 -- 172.21.15.99:0/81691418 learned_addr learned my addr 172.21.15.99:0/81691418 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f2754b4c640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501441d0 0x7f2750072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274ffff640 1 --2- 172.21.15.99:0/81691418 >> v2:172.21.15.157:3300/0 conn(0x7f27500b2ce0 0x7f2750071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203019214 0 0) 0x7f275006f620 con 0x7f27500b1870 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273c003530 con 0x7f27500b1870 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3385469677 0 0) 0x7f273c003530 con 0x7f27500b1870 2024-01-19T05:18:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501441d0 msgr2=0x7f2750072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501441d0 0x7f2750072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 >> v2:172.21.15.157:3300/0 conn(0x7f27500b2ce0 msgr2=0x7f2750071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 --2- 172.21.15.99:0/81691418 >> v2:172.21.15.157:3300/0 conn(0x7f27500b2ce0 0x7f2750071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500b30c0 con 0x7f27500b1870 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f2740001680 con 0x7f27500b1870 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 >> v1:172.21.15.99:6789/0 conn(0x7f27500b1870 legacy=0x7f2750143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f273c003980 0x7f273c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501441d0 0x7f273c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f273c004d10 0x7f273c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750141000 con 0x7f273c004d10 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750143610 con 0x7f273c003980 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c00b990 con 0x7f27501441d0 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f2754b4c640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f273c004d10 0x7f273c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274ffff640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f273c003980 0x7f273c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f2754b4c640 1 -- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501441d0 msgr2=0x7f273c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f2754b4c640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501441d0 0x7f273c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f2754b4c640 1 -- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f273c003980 msgr2=0x7f273c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f2754b4c640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f273c003980 0x7f273c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f2754b4c640 1 -- 172.21.15.99:0/81691418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c003530 con 0x7f273c004d10 2024-01-19T05:18:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274ffff640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f273c003980 0x7f273c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:04.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f2754b4c640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f273c004d10 0x7f273c005190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2748009fc0 tx=0x7f274801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c998f38d0adaed09 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480a5cb0 con 0x7f273c004d10 2024-01-19T05:18:04.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800f040 con 0x7f273c004d10 2024-01-19T05:18:04.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.430+0000 7f274effd640 1 -- 172.21.15.99:0/81691418 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480ad680 con 0x7f273c004d10 2024-01-19T05:18:04.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- 172.21.15.99:0/81691418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f273c004d10 msgr2=0x7f273c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 --2- 172.21.15.99:0/81691418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f273c004d10 0x7f273c005190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2748009fc0 tx=0x7f274801cca0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 -- 172.21.15.99:0/81691418 reap_dead start 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- 172.21.15.99:0/81691418 shutdown_connections 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- 172.21.15.99:0/81691418 >> 172.21.15.99:0/81691418 conn(0x7f27500b8080 msgr2=0x7f27500b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- 172.21.15.99:0/81691418 shutdown_connections 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- 172.21.15.99:0/81691418 wait complete. 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 Processor -- start 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- start start 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501cf3c0 0x7f27501cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27501cf7a0 0x7f27501cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27501dba90 0x7f27501dbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27501cffa0 con 0x7f27501dba90 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500a9de0 con 0x7f27501cf7a0 2024-01-19T05:18:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27500aa0c0 con 0x7f27501cf3c0 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27501dba90 0x7f27501dbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27501dba90 0x7f27501dbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55512/0 (socket says 172.21.15.99:55512) 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 -- 172.21.15.99:0/897672302 learned_addr learned my addr 172.21.15.99:0/897672302 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f274f7fe640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27501cf7a0 0x7f27501cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f274ffff640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501cf3c0 0x7f27501cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 -- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501cf3c0 msgr2=0x7f27501cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501cf3c0 0x7f27501cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 -- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27501cf7a0 msgr2=0x7f27501cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27501cf7a0 0x7f27501cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 -- 172.21.15.99:0/897672302 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27501ce800 con 0x7f27501dba90 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f274ffff640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501cf3c0 0x7f27501cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f2754b4c640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27501dba90 0x7f27501dbef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2748002240 tx=0x7f2748009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f274cff9640 1 -- 172.21.15.99:0/897672302 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480039a0 con 0x7f27501dba90 2024-01-19T05:18:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f274cff9640 1 -- 172.21.15.99:0/897672302 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748003b00 con 0x7f27501dba90 2024-01-19T05:18:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27501cfcc0 con 0x7f27501dba90 2024-01-19T05:18:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f274cff9640 1 -- 172.21.15.99:0/897672302 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748003e70 con 0x7f27501dba90 2024-01-19T05:18:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27500a8570 con 0x7f27501dba90 2024-01-19T05:18:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.434+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275006a870 con 0x7f27501dba90 2024-01-19T05:18:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.438+0000 7f274cff9640 1 -- 172.21.15.99:0/897672302 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f27480b4040 con 0x7f27501dba90 2024-01-19T05:18:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.438+0000 7f274cff9640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2730066530 0x7f27300689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.438+0000 7f274ffff640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2730066530 0x7f27300689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.438+0000 7f274cff9640 1 -- 172.21.15.99:0/897672302 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f274811dc70 con 0x7f27501dba90 2024-01-19T05:18:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.438+0000 7f274ffff640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2730066530 0x7f27300689f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2738009b40 tx=0x7f2738008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.442+0000 7f274cff9640 1 -- 172.21.15.99:0/897672302 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f27480eb050 con 0x7f27501dba90 2024-01-19T05:18:04.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.642+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f27501d01a0 con 0x7f27501dba90 2024-01-19T05:18:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f274cff9640 1 -- 172.21.15.99:0/897672302 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f27501d01a0 con 0x7f27501dba90 2024-01-19T05:18:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2730066530 msgr2=0x7f27300689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2730066530 0x7f27300689f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2738009b40 tx=0x7f2738008040 comp rx=0 tx=0).stop 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27501dba90 msgr2=0x7f27501dbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27501dba90 0x7f27501dbef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2748002240 tx=0x7f2748009750 comp rx=0 tx=0).stop 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 shutdown_connections 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2730066530 0x7f27300689f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27501dba90 0x7f27501dbef0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27501cf7a0 0x7f27501cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 --2- 172.21.15.99:0/897672302 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27501cf3c0 0x7f27501cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 >> 172.21.15.99:0/897672302 conn(0x7f27500b8080 msgr2=0x7f2750142150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 shutdown_connections 2024-01-19T05:18:04.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.662+0000 7f27565af640 1 -- 172.21.15.99:0/897672302 wait complete. 2024-01-19T05:18:04.680 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T05:18:04.680 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f0445369640 1 Processor -- start 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f0445369640 1 -- start start 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f0445369640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f04400b2ce0 0x7f0440071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f0445369640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04401441d0 0x7f0440072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f0445369640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044006f620 con 0x7f04400b1870 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f0445369640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0440141000 con 0x7f04400b2ce0 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f0445369640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0440143610 con 0x7f04401441d0 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043e7fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f04400b1870 0x7f0440143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42406/0 (socket says 172.21.15.99:42406) 2024-01-19T05:18:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043e7fc640 1 -- 172.21.15.99:0/1889378449 learned_addr learned my addr 172.21.15.99:0/1889378449 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043f7fe640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04401441d0 0x7f0440072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153164776 0 0) 0x7f044006f620 con 0x7f04400b1870 2024-01-19T05:18:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0428005740 con 0x7f04400b1870 2024-01-19T05:18:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043effd640 1 --2- 172.21.15.99:0/1889378449 >> v2:172.21.15.157:3300/0 conn(0x7f04400b2ce0 0x7f0440071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1458641540 0 0) 0x7f0428005740 con 0x7f04400b1870 2024-01-19T05:18:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04401441d0 msgr2=0x7f0440072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04401441d0 0x7f0440072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 >> v2:172.21.15.157:3300/0 conn(0x7f04400b2ce0 msgr2=0x7f0440071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 --2- 172.21.15.99:0/1889378449 >> v2:172.21.15.157:3300/0 conn(0x7f04400b2ce0 0x7f0440071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400b30c0 con 0x7f04400b1870 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f0434001680 con 0x7f04400b1870 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043effd640 1 --2- 172.21.15.99:0/1889378449 >> v2:172.21.15.157:3300/0 conn(0x7f04400b2ce0 0x7f0440071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 >> v1:172.21.15.99:6789/0 conn(0x7f04400b1870 legacy=0x7f0440143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0428005b90 0x7f0428005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04280069e0 0x7f0428006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04401441d0 0x7f04280073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440141000 con 0x7f04280069e0 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440143610 con 0x7f0428005b90 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042800dba0 con 0x7f04401441d0 2024-01-19T05:18:04.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043e7fc640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04280069e0 0x7f0428006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043effd640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0428005b90 0x7f0428005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043f7fe640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04401441d0 0x7f04280073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043e7fc640 1 -- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04401441d0 msgr2=0x7f04280073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043e7fc640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04401441d0 0x7f04280073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043e7fc640 1 -- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0428005b90 msgr2=0x7f0428005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043e7fc640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0428005b90 0x7f0428005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043e7fc640 1 -- 172.21.15.99:0/1889378449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0428005740 con 0x7f04280069e0 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.794+0000 7f043effd640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0428005b90 0x7f0428005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f043e7fc640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04280069e0 0x7f0428006e60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f043400c290 tx=0x7f043401f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8ef7fe163cb107 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340a8cd0 con 0x7f04280069e0 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04340a8e30 con 0x7f04280069e0 2024-01-19T05:18:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f043dffb640 1 -- 172.21.15.99:0/1889378449 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434005b20 con 0x7f04280069e0 2024-01-19T05:18:04.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f0445369640 1 -- 172.21.15.99:0/1889378449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04280069e0 msgr2=0x7f0428006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f0445369640 1 --2- 172.21.15.99:0/1889378449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04280069e0 0x7f0428006e60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f043400c290 tx=0x7f043401f430 comp rx=0 tx=0).stop 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f043f7fe640 1 -- 172.21.15.99:0/1889378449 reap_dead start 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f0445369640 1 -- 172.21.15.99:0/1889378449 shutdown_connections 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f0445369640 1 -- 172.21.15.99:0/1889378449 >> 172.21.15.99:0/1889378449 conn(0x7f04400b8080 msgr2=0x7f04400b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f0445369640 1 -- 172.21.15.99:0/1889378449 shutdown_connections 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f0445369640 1 -- 172.21.15.99:0/1889378449 wait complete. 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f0445369640 1 Processor -- start 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.798+0000 7f0445369640 1 -- start start 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04280069e0 0x7f04400abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04400acc00 0x7f044013e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f044013e920 0x7f04400a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04400a9190 con 0x7f04400acc00 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04401d1fa0 con 0x7f04280069e0 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04400ae5a0 con 0x7f044013e920 2024-01-19T05:18:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04400acc00 0x7f044013e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04400acc00 0x7f044013e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55526/0 (socket says 172.21.15.99:55526) 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 -- 172.21.15.99:0/319854665 learned_addr learned my addr 172.21.15.99:0/319854665 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043f7fe640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f044013e920 0x7f04400a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 -- 172.21.15.99:0/319854665 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f044013e920 msgr2=0x7f04400a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f044013e920 0x7f04400a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 -- 172.21.15.99:0/319854665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04280069e0 msgr2=0x7f04400abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04280069e0 0x7f04400abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 -- 172.21.15.99:0/319854665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400ad060 con 0x7f04400acc00 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043e7fc640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04400acc00 0x7f044013e3e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0434007040 tx=0x7f0428007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f04277fe640 1 -- 172.21.15.99:0/319854665 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340049f0 con 0x7f04400acc00 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f04277fe640 1 -- 172.21.15.99:0/319854665 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04340b6070 con 0x7f04400acc00 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04400ad500 con 0x7f04400acc00 2024-01-19T05:18:04.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f04277fe640 1 -- 172.21.15.99:0/319854665 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434004dd0 con 0x7f04400acc00 2024-01-19T05:18:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04400ae810 con 0x7f04400acc00 2024-01-19T05:18:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04400a9400 con 0x7f04400acc00 2024-01-19T05:18:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f04277fe640 1 -- 172.21.15.99:0/319854665 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f04340070d0 con 0x7f04400acc00 2024-01-19T05:18:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f04277fe640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f042c066500 0x7f042c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f04277fe640 1 -- 172.21.15.99:0/319854665 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04340b8070 con 0x7f04400acc00 2024-01-19T05:18:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043effd640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f042c066500 0x7f042c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.802+0000 7f043effd640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f042c066500 0x7f042c0689c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f043000d900 tx=0x7f0430006e00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.806+0000 7f04277fe640 1 -- 172.21.15.99:0/319854665 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f04340ee360 con 0x7f04400acc00 2024-01-19T05:18:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:04.986+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f04400696e0 con 0x7f04400acc00 2024-01-19T05:18:05.254 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:18:05.257 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:18:05.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.670+0000 7f04277fe640 1 -- 172.21.15.99:0/319854665 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04340f1980 con 0x7f04400acc00 2024-01-19T05:18:05.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f042c066500 msgr2=0x7f042c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f042c066500 0x7f042c0689c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f043000d900 tx=0x7f0430006e00 comp rx=0 tx=0).stop 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04400acc00 msgr2=0x7f044013e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04400acc00 0x7f044013e3e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0434007040 tx=0x7f0428007a10 comp rx=0 tx=0).stop 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 shutdown_connections 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f042c066500 0x7f042c0689c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f044013e920 0x7f04400a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04400acc00 0x7f044013e3e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 --2- 172.21.15.99:0/319854665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04280069e0 0x7f04400abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 >> 172.21.15.99:0/319854665 conn(0x7f04400b8080 msgr2=0x7f0440142640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 shutdown_connections 2024-01-19T05:18:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.674+0000 7f0445369640 1 -- 172.21.15.99:0/319854665 wait complete. 2024-01-19T05:18:05.698 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-19T05:18:05.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:05.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.818+0000 7f937cd7c640 1 Processor -- start 2024-01-19T05:18:05.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.818+0000 7f937cd7c640 1 -- start start 2024-01-19T05:18:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93780724f0 0x7f937814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937806f070 con 0x7f937806ebe0 2024-01-19T05:18:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9378070680 con 0x7f93780b19f0 2024-01-19T05:18:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9378070410 con 0x7f93780724f0 2024-01-19T05:18:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9376d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93780724f0 0x7f937814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f936ffff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f937806ebe0 0x7f9378071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42410/0 (socket says 172.21.15.99:42410) 2024-01-19T05:18:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9376d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93780724f0 0x7f937814fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55536/0 (socket says 172.21.15.99:55536) 2024-01-19T05:18:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f936ffff640 1 -- 172.21.15.99:0/4083359810 learned_addr learned my addr 172.21.15.99:0/4083359810 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9375d9b640 1 -- 172.21.15.99:0/4083359810 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594755425 0 0) 0x7f9368001120 con 0x7f937806ebe0 2024-01-19T05:18:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9375d9b640 1 -- 172.21.15.99:0/4083359810 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9364003530 con 0x7f937806ebe0 2024-01-19T05:18:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9376d9d640 1 -- 172.21.15.99:0/4083359810 >> v1:172.21.15.157:6789/0 conn(0x7f93780b19f0 legacy=0x7f9378144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9376d9d640 1 -- 172.21.15.99:0/4083359810 >> v1:172.21.15.99:6789/0 conn(0x7f937806ebe0 legacy=0x7f9378071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9376d9d640 1 -- 172.21.15.99:0/4083359810 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378144790 con 0x7f93780724f0 2024-01-19T05:18:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9376d9d640 1 --2- 172.21.15.99:0/4083359810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780724f0 0x7f937814fea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9370009d90 tx=0x7f937001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9724d9f48c3184c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9375d9b640 1 -- 172.21.15.99:0/4083359810 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93700a5960 con 0x7f93780724f0 2024-01-19T05:18:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9375d9b640 1 -- 172.21.15.99:0/4083359810 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93700a5ac0 con 0x7f93780724f0 2024-01-19T05:18:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f9375d9b640 1 -- 172.21.15.99:0/4083359810 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93700a5e50 con 0x7f93780724f0 2024-01-19T05:18:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 -- 172.21.15.99:0/4083359810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780724f0 msgr2=0x7f937814fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 --2- 172.21.15.99:0/4083359810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780724f0 0x7f937814fea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9370009d90 tx=0x7f937001c880 comp rx=0 tx=0).stop 2024-01-19T05:18:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 -- 172.21.15.99:0/4083359810 shutdown_connections 2024-01-19T05:18:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 --2- 172.21.15.99:0/4083359810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780724f0 0x7f937814fea0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 -- 172.21.15.99:0/4083359810 >> 172.21.15.99:0/4083359810 conn(0x7f93780b8080 msgr2=0x7f93780b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 -- 172.21.15.99:0/4083359810 shutdown_connections 2024-01-19T05:18:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.822+0000 7f937cd7c640 1 -- 172.21.15.99:0/4083359810 wait complete. 2024-01-19T05:18:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 Processor -- start 2024-01-19T05:18:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 -- start start 2024-01-19T05:18:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f937806ebe0 0x7f93780b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93780724f0 0x7f937813f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780b19f0 0x7f9378136110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937813fd20 con 0x7f93780b19f0 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9378141260 con 0x7f937806ebe0 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9378141490 con 0x7f93780724f0 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780b19f0 0x7f9378136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780b19f0 0x7f9378136110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55552/0 (socket says 172.21.15.99:55552) 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 -- 172.21.15.99:0/3305449422 learned_addr learned my addr 172.21.15.99:0/3305449422 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937659c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f937806ebe0 0x7f93780b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 -- 172.21.15.99:0/3305449422 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93780724f0 msgr2=0x7f937813f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93780724f0 0x7f937813f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 -- 172.21.15.99:0/3305449422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f937806ebe0 msgr2=0x7f93780b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f937806ebe0 0x7f93780b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 -- 172.21.15.99:0/3305449422 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9370009a70 con 0x7f93780b19f0 2024-01-19T05:18:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937659c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f937806ebe0 0x7f93780b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f9376d9d640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780b19f0 0x7f9378136110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9370009d90 tx=0x7f9370019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f936effd640 1 -- 172.21.15.99:0/3305449422 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93700add90 con 0x7f93780b19f0 2024-01-19T05:18:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f936effd640 1 -- 172.21.15.99:0/3305449422 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9370009450 con 0x7f93780b19f0 2024-01-19T05:18:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937813c8c0 con 0x7f93780b19f0 2024-01-19T05:18:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f936effd640 1 -- 172.21.15.99:0/3305449422 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93700b7630 con 0x7f93780b19f0 2024-01-19T05:18:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937813ed30 con 0x7f93780b19f0 2024-01-19T05:18:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937813f500 con 0x7f93780b19f0 2024-01-19T05:18:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.826+0000 7f936effd640 1 -- 172.21.15.99:0/3305449422 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f93700b4050 con 0x7f93780b19f0 2024-01-19T05:18:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.830+0000 7f936effd640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9358066500 0x7f93580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.830+0000 7f936effd640 1 -- 172.21.15.99:0/3305449422 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f937011f130 con 0x7f93780b19f0 2024-01-19T05:18:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.830+0000 7f937659c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9358066500 0x7f93580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:05.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.830+0000 7f937659c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9358066500 0x7f93580689c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f936000a850 tx=0x7f9360008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:05.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:05.834+0000 7f936effd640 1 -- 172.21.15.99:0/3305449422 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f937813f500 con 0x7f93780b19f0 2024-01-19T05:18:06.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.026+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f937813f500 con 0x7f93780b19f0 2024-01-19T05:18:06.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.026+0000 7f936effd640 1 -- 172.21.15.99:0/3305449422 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3352 (secure 0 0 0) 0x7f93700b2d30 con 0x7f93780b19f0 2024-01-19T05:18:06.029 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:06.029 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:02.994909+0000","modified":"2024-01-19T05:18:04.990494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:18:06.030 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9358066500 msgr2=0x7f93580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9358066500 0x7f93580689c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f936000a850 tx=0x7f9360008040 comp rx=0 tx=0).stop 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780b19f0 msgr2=0x7f9378136110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780b19f0 0x7f9378136110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9370009d90 tx=0x7f9370019620 comp rx=0 tx=0).stop 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 shutdown_connections 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9358066500 0x7f93580689c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93780b19f0 0x7f9378136110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93780724f0 0x7f937813f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 --2- 172.21.15.99:0/3305449422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f937806ebe0 0x7f93780b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 >> 172.21.15.99:0/3305449422 conn(0x7f93780b8080 msgr2=0x7f9378139090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 shutdown_connections 2024-01-19T05:18:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.030+0000 7f937cd7c640 1 -- 172.21.15.99:0/3305449422 wait complete. 2024-01-19T05:18:06.048 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:06.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5292891640 1 Processor -- start 2024-01-19T05:18:06.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5292891640 1 -- start start 2024-01-19T05:18:06.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5292891640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f528c0b96f0 0x7f528c0b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5292891640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f528c0b7c40 0x7f528c140780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5292891640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0b87f0 con 0x7f528c140cc0 2024-01-19T05:18:06.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5292891640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c141110 con 0x7f528c0b7c40 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5292891640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c0b9ad0 con 0x7f528c0b96f0 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f528b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f528c0b7c40 0x7f528c140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5290e2e640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f528c140cc0 0x7f528c149e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42422/0 (socket says 172.21.15.99:42422) 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f5290e2e640 1 -- 172.21.15.99:0/1786881646 learned_addr learned my addr 172.21.15.99:0/1786881646 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f528bfff640 1 --2- 172.21.15.99:0/1786881646 >> v2:172.21.15.157:3300/0 conn(0x7f528c0b96f0 0x7f528c0b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f528b7fe640 1 -- 172.21.15.99:0/1786881646 >> v2:172.21.15.157:3300/0 conn(0x7f528c0b96f0 msgr2=0x7f528c0b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f528b7fe640 1 --2- 172.21.15.99:0/1786881646 >> v2:172.21.15.157:3300/0 conn(0x7f528c0b96f0 0x7f528c0b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f528b7fe640 1 -- 172.21.15.99:0/1786881646 >> v1:172.21.15.99:6789/0 conn(0x7f528c140cc0 legacy=0x7f528c149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f528affd640 1 -- 172.21.15.99:0/1786881646 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909612591 0 0) 0x7f528c0b87f0 con 0x7f528c140cc0 2024-01-19T05:18:06.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.166+0000 7f528b7fe640 1 -- 172.21.15.99:0/1786881646 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c0b81e0 con 0x7f528c0b7c40 2024-01-19T05:18:06.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f528b7fe640 1 --2- 172.21.15.99:0/1786881646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c140780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f528c0b8c50 tx=0x7f528001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6327314fb7bcb26 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f528affd640 1 -- 172.21.15.99:0/1786881646 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800ad680 con 0x7f528c0b7c40 2024-01-19T05:18:06.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f528affd640 1 -- 172.21.15.99:0/1786881646 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52800ad7e0 con 0x7f528c0b7c40 2024-01-19T05:18:06.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f528affd640 1 -- 172.21.15.99:0/1786881646 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800adb70 con 0x7f528c0b7c40 2024-01-19T05:18:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f5292891640 1 -- 172.21.15.99:0/1786881646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 msgr2=0x7f528c140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f5292891640 1 --2- 172.21.15.99:0/1786881646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c140780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f528c0b8c50 tx=0x7f528001c460 comp rx=0 tx=0).stop 2024-01-19T05:18:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f5292891640 1 -- 172.21.15.99:0/1786881646 shutdown_connections 2024-01-19T05:18:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f5292891640 1 --2- 172.21.15.99:0/1786881646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c140780 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f5292891640 1 --2- 172.21.15.99:0/1786881646 >> v2:172.21.15.157:3300/0 conn(0x7f528c0b96f0 0x7f528c0b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f5292891640 1 -- 172.21.15.99:0/1786881646 >> 172.21.15.99:0/1786881646 conn(0x7f528c09e600 msgr2=0x7f528c0b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f5292891640 1 -- 172.21.15.99:0/1786881646 shutdown_connections 2024-01-19T05:18:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.170+0000 7f5292891640 1 -- 172.21.15.99:0/1786881646 wait complete. 2024-01-19T05:18:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 Processor -- start 2024-01-19T05:18:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 -- start start 2024-01-19T05:18:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f528c0b96f0 0x7f528c149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f528c140cc0 0x7f528c13a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c138720 con 0x7f528c0b7c40 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c13b690 con 0x7f528c140cc0 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c138f70 con 0x7f528c0b96f0 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55576/0 (socket says 172.21.15.99:55576) 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 -- 172.21.15.99:0/3271966228 learned_addr learned my addr 172.21.15.99:0/3271966228 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 -- 172.21.15.99:0/3271966228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f528c0b96f0 msgr2=0x7f528c149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f528c0b96f0 0x7f528c149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 -- 172.21.15.99:0/3271966228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f528c140cc0 msgr2=0x7f528c13a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f528c140cc0 0x7f528c13a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 -- 172.21.15.99:0/3271966228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280009420 con 0x7f528c0b7c40 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f528bfff640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c09f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f527c00ce40 tx=0x7f527c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5288ff9640 1 -- 172.21.15.99:0/3271966228 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c003ba0 con 0x7f528c0b7c40 2024-01-19T05:18:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5288ff9640 1 -- 172.21.15.99:0/3271966228 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c003d00 con 0x7f528c0b7c40 2024-01-19T05:18:06.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528c1372a0 con 0x7f528c0b7c40 2024-01-19T05:18:06.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5288ff9640 1 -- 172.21.15.99:0/3271966228 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c004260 con 0x7f528c0b7c40 2024-01-19T05:18:06.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528c09fa50 con 0x7f528c0b7c40 2024-01-19T05:18:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528c0696e0 con 0x7f528c0b7c40 2024-01-19T05:18:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5288ff9640 1 -- 172.21.15.99:0/3271966228 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f527c0043c0 con 0x7f528c0b7c40 2024-01-19T05:18:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.174+0000 7f5288ff9640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5278066500 0x7f52780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.178+0000 7f5288ff9640 1 -- 172.21.15.99:0/3271966228 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f527c012070 con 0x7f528c0b7c40 2024-01-19T05:18:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.178+0000 7f528b7fe640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5278066500 0x7f52780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.178+0000 7f528b7fe640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5278066500 0x7f52780689c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52800af000 tx=0x7f5280008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.182+0000 7f5288ff9640 1 -- 172.21.15.99:0/3271966228 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f527c051b20 con 0x7f528c0b7c40 2024-01-19T05:18:06.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.338+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f528c09dd90 con 0x7f528c0b7c40 2024-01-19T05:18:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.338+0000 7f5288ff9640 1 -- 172.21.15.99:0/3271966228 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f527c055140 con 0x7f528c0b7c40 2024-01-19T05:18:06.340 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:06.340 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5278066500 msgr2=0x7f52780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5278066500 0x7f52780689c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52800af000 tx=0x7f5280008040 comp rx=0 tx=0).stop 2024-01-19T05:18:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 msgr2=0x7f528c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c09f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f527c00ce40 tx=0x7f527c00a660 comp rx=0 tx=0).stop 2024-01-19T05:18:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 shutdown_connections 2024-01-19T05:18:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5278066500 0x7f52780689c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f528c140cc0 0x7f528c13a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f528c0b96f0 0x7f528c149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 --2- 172.21.15.99:0/3271966228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c0b7c40 0x7f528c09f110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 >> 172.21.15.99:0/3271966228 conn(0x7f528c09e600 msgr2=0x7f528c0ba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 shutdown_connections 2024-01-19T05:18:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.342+0000 7f5292891640 1 -- 172.21.15.99:0/3271966228 wait complete. 2024-01-19T05:18:06.359 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T05:18:06.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:06.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2dd8ff640 1 Processor -- start 2024-01-19T05:18:06.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2dd8ff640 1 -- start start 2024-01-19T05:18:06.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2dd8ff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc2d806e150 0x7fc2d8144650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2dd8ff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2d8144b90 0x7fc2d81415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2dd8ff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8072510 0x7fc2d8141b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2dd8ff640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d81485b0 con 0x7fc2d8144b90 2024-01-19T05:18:06.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2dd8ff640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d806e530 con 0x7fc2d806e150 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2dd8ff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8147f60 con 0x7fc2d8072510 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2d8144b90 0x7fc2d81415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2d8144b90 0x7fc2d81415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55586/0 (socket says 172.21.15.99:55586) 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 -- 172.21.15.99:0/3065428779 learned_addr learned my addr 172.21.15.99:0/3065428779 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2d6ffd640 1 --2- 172.21.15.99:0/3065428779 >> v2:172.21.15.157:3300/0 conn(0x7fc2d806e150 0x7fc2d8144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2d77fe640 1 --2- 172.21.15.99:0/3065428779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8072510 0x7fc2d8141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 -- 172.21.15.99:0/3065428779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8072510 msgr2=0x7fc2d8141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 --2- 172.21.15.99:0/3065428779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8072510 0x7fc2d8141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 -- 172.21.15.99:0/3065428779 >> v2:172.21.15.157:3300/0 conn(0x7fc2d806e150 msgr2=0x7fc2d8144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 --2- 172.21.15.99:0/3065428779 >> v2:172.21.15.157:3300/0 conn(0x7fc2d806e150 0x7fc2d8144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 -- 172.21.15.99:0/3065428779 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8148240 con 0x7fc2d8144b90 2024-01-19T05:18:06.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.478+0000 7fc2cffff640 1 --2- 172.21.15.99:0/3065428779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8144b90 0x7fc2d81415c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8072260 tx=0x7fc2c801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa6bc6b58a0df10 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2d67fc640 1 -- 172.21.15.99:0/3065428779 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80ab600 con 0x7fc2d8144b90 2024-01-19T05:18:06.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2d67fc640 1 -- 172.21.15.99:0/3065428779 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80a7050 con 0x7fc2d8144b90 2024-01-19T05:18:06.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2d67fc640 1 -- 172.21.15.99:0/3065428779 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80ab980 con 0x7fc2d8144b90 2024-01-19T05:18:06.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/3065428779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8144b90 msgr2=0x7fc2d81415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/3065428779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8144b90 0x7fc2d81415c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8072260 tx=0x7fc2c801c410 comp rx=0 tx=0).stop 2024-01-19T05:18:06.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/3065428779 shutdown_connections 2024-01-19T05:18:06.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/3065428779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8144b90 0x7fc2d81415c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/3065428779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8072510 0x7fc2d8141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/3065428779 >> v2:172.21.15.157:3300/0 conn(0x7fc2d806e150 0x7fc2d8144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/3065428779 >> 172.21.15.99:0/3065428779 conn(0x7fc2d80ba500 msgr2=0x7fc2d80ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:06.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/3065428779 shutdown_connections 2024-01-19T05:18:06.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/3065428779 wait complete. 2024-01-19T05:18:06.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 Processor -- start 2024-01-19T05:18:06.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- start start 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d806e150 0x7fc2d809d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8072510 0x7fc2d81dee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8144b90 0x7fc2d81df380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d81de960 con 0x7fc2d8072510 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d809f110 con 0x7fc2d806e150 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80b0540 con 0x7fc2d8144b90 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8072510 0x7fc2d81dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8072510 0x7fc2d81dee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55600/0 (socket says 172.21.15.99:55600) 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 -- 172.21.15.99:0/1175346181 learned_addr learned my addr 172.21.15.99:0/1175346181 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2d77fe640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8144b90 0x7fc2d81df380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2d6ffd640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d806e150 0x7fc2d809d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 -- 172.21.15.99:0/1175346181 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8144b90 msgr2=0x7fc2d81df380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8144b90 0x7fc2d81df380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 -- 172.21.15.99:0/1175346181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d806e150 msgr2=0x7fc2d809d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d806e150 0x7fc2d809d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 -- 172.21.15.99:0/1175346181 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c80094d0 con 0x7fc2d8072510 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2cffff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8072510 0x7fc2d81dee40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80ae040 tx=0x7fc2c8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2d4ff9640 1 -- 172.21.15.99:0/1175346181 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80b6420 con 0x7fc2d8072510 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2d4ff9640 1 -- 172.21.15.99:0/1175346181 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80b6580 con 0x7fc2d8072510 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2d4ff9640 1 -- 172.21.15.99:0/1175346181 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80b68f0 con 0x7fc2d8072510 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d809c680 con 0x7fc2d8072510 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.482+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d809e710 con 0x7fc2d8072510 2024-01-19T05:18:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.486+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d81de7c0 con 0x7fc2d8072510 2024-01-19T05:18:06.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.486+0000 7fc2d4ff9640 1 -- 172.21.15.99:0/1175346181 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc2c80b2040 con 0x7fc2d8072510 2024-01-19T05:18:06.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.486+0000 7fc2d4ff9640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc2b8066500 0x7fc2b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.486+0000 7fc2d4ff9640 1 -- 172.21.15.99:0/1175346181 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2c811e1b0 con 0x7fc2d8072510 2024-01-19T05:18:06.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.486+0000 7fc2d6ffd640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc2b8066500 0x7fc2b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.486+0000 7fc2d6ffd640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc2b8066500 0x7fc2b80689c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000b9d0 tx=0x7fc2c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.490+0000 7fc2d4ff9640 1 -- 172.21.15.99:0/1175346181 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc2d81de7c0 con 0x7fc2d8072510 2024-01-19T05:18:06.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.642+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2d809e900 con 0x7fc2b8066500 2024-01-19T05:18:06.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.662+0000 7fc2d4ff9640 1 -- 172.21.15.99:0/1175346181 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249779 (secure 0 0 0) 0x7fc2d809e900 con 0x7fc2b8066500 2024-01-19T05:18:06.667 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc2b8066500 msgr2=0x7fc2b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc2b8066500 0x7fc2b80689c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000b9d0 tx=0x7fc2c0008040 comp rx=0 tx=0).stop 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8072510 msgr2=0x7fc2d81dee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8072510 0x7fc2d81dee40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80ae040 tx=0x7fc2c8019210 comp rx=0 tx=0).stop 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 shutdown_connections 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc2b8066500 0x7fc2b80689c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2d8144b90 0x7fc2d81df380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2d8072510 0x7fc2d81dee40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 --2- 172.21.15.99:0/1175346181 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2d806e150 0x7fc2d809d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 >> 172.21.15.99:0/1175346181 conn(0x7fc2d80ba500 msgr2=0x7fc2d80b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 shutdown_connections 2024-01-19T05:18:06.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.666+0000 7fc2dd8ff640 1 -- 172.21.15.99:0/1175346181 wait complete. 2024-01-19T05:18:06.686 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-19T05:18:05.344235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235328,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739392,"statfs":{"total":773094113280,"available":772853137408,"internally_reserved":0,"allocated":2433024,"data_stored":1546680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001353"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-01-19T05:17:54.978725+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:17:54.978725+0000","last_peered":"2024-01-19T05:17:54.978725+0000","last_clean":"2024-01-19T05:17:54.978725+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:17:54.978725+0000","last_undegraded":"2024-01-19T05:17:54.978725+0000","last_fullsized":"2024-01-19T05:17:54.978725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31340,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31340,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31332,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:06.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:06.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.850+0000 7fa0b6f8e640 1 Processor -- start 2024-01-19T05:18:06.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.850+0000 7fa0b6f8e640 1 -- start start 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.850+0000 7fa0b6f8e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa0b00b19f0 0x7fa0b006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa0b0144c70 0x7fa0b0145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b0070680 con 0x7fa0b0071de0 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b0070410 con 0x7fa0b0144c70 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b0144790 con 0x7fa0b00b19f0 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0affff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa0b0144c70 0x7fa0b0145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b552b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa0b0071de0 0x7fa0b00721f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42436/0 (socket says 172.21.15.99:42436) 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b552b640 1 -- 172.21.15.99:0/860641216 learned_addr learned my addr 172.21.15.99:0/860641216 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b4d2a640 1 --2- 172.21.15.99:0/860641216 >> v2:172.21.15.157:3300/0 conn(0x7fa0b00b19f0 0x7fa0b006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0affff640 1 -- 172.21.15.99:0/860641216 >> v2:172.21.15.157:3300/0 conn(0x7fa0b00b19f0 msgr2=0x7fa0b006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:06.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0affff640 1 --2- 172.21.15.99:0/860641216 >> v2:172.21.15.157:3300/0 conn(0x7fa0b00b19f0 0x7fa0b006ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0affff640 1 -- 172.21.15.99:0/860641216 >> v1:172.21.15.99:6789/0 conn(0x7fa0b0071de0 legacy=0x7fa0b00721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0af7fe640 1 -- 172.21.15.99:0/860641216 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548001588 0 0) 0x7fa0b0070680 con 0x7fa0b0071de0 2024-01-19T05:18:06.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0affff640 1 -- 172.21.15.99:0/860641216 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b006f2b0 con 0x7fa0b0144c70 2024-01-19T05:18:06.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0affff640 1 --2- 172.21.15.99:0/860641216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b0145100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa0b006d030 tx=0x7fa0a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8934236bd73497da server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0af7fe640 1 -- 172.21.15.99:0/860641216 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40ab600 con 0x7fa0b0144c70 2024-01-19T05:18:06.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0af7fe640 1 -- 172.21.15.99:0/860641216 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a40a7050 con 0x7fa0b0144c70 2024-01-19T05:18:06.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0af7fe640 1 -- 172.21.15.99:0/860641216 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40ab980 con 0x7fa0b0144c70 2024-01-19T05:18:06.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/860641216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 msgr2=0x7fa0b0145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/860641216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b0145100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa0b006d030 tx=0x7fa0a401c3d0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/860641216 shutdown_connections 2024-01-19T05:18:06.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/860641216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b0145100 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/860641216 >> v2:172.21.15.157:3300/0 conn(0x7fa0b00b19f0 0x7fa0b006ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/860641216 >> 172.21.15.99:0/860641216 conn(0x7fa0b00b8080 msgr2=0x7fa0b00b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:06.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/860641216 shutdown_connections 2024-01-19T05:18:06.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.854+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/860641216 wait complete. 2024-01-19T05:18:06.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 Processor -- start 2024-01-19T05:18:06.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 -- start start 2024-01-19T05:18:06.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b0071de0 0x7fa0b00b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0b00b19f0 0x7fa0b01e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b01e2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b013a800 con 0x7fa0b0144c70 2024-01-19T05:18:06.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b013d940 con 0x7fa0b0071de0 2024-01-19T05:18:06.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b013f7e0 con 0x7fa0b00b19f0 2024-01-19T05:18:06.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b01e2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b01e2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55620/0 (socket says 172.21.15.99:55620) 2024-01-19T05:18:06.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 -- 172.21.15.99:0/3241749598 learned_addr learned my addr 172.21.15.99:0/3241749598 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:06.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b4d2a640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b0071de0 0x7fa0b00b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0affff640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0b00b19f0 0x7fa0b01e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 -- 172.21.15.99:0/3241749598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0b00b19f0 msgr2=0x7fa0b01e20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0b00b19f0 0x7fa0b01e20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 -- 172.21.15.99:0/3241749598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b0071de0 msgr2=0x7fa0b00b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:06.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b0071de0 0x7fa0b00b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:06.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 -- 172.21.15.99:0/3241749598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a4009420 con 0x7fa0b0144c70 2024-01-19T05:18:06.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b552b640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b01e2610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800caf0 tx=0x7fa0a80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0ad7fa640 1 -- 172.21.15.99:0/3241749598 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800ac00 con 0x7fa0b0144c70 2024-01-19T05:18:06.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0ad7fa640 1 -- 172.21.15.99:0/3241749598 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a800ad60 con 0x7fa0b0144c70 2024-01-19T05:18:06.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0ad7fa640 1 -- 172.21.15.99:0/3241749598 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8012640 con 0x7fa0b0144c70 2024-01-19T05:18:06.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b013fa30 con 0x7fa0b0144c70 2024-01-19T05:18:06.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b013b460 con 0x7fa0b0144c70 2024-01-19T05:18:06.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.858+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b013ff50 con 0x7fa0b0144c70 2024-01-19T05:18:06.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.862+0000 7fa0ad7fa640 1 -- 172.21.15.99:0/3241749598 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa0a80127a0 con 0x7fa0b0144c70 2024-01-19T05:18:06.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.862+0000 7fa0ad7fa640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa09c066530 0x7fa09c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:06.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.862+0000 7fa0ad7fa640 1 -- 172.21.15.99:0/3241749598 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0a80842a0 con 0x7fa0b0144c70 2024-01-19T05:18:06.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.862+0000 7fa0b4d2a640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa09c066530 0x7fa09c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:06.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.862+0000 7fa0b4d2a640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa09c066530 0x7fa09c0689f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000b9d0 tx=0x7fa0a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:06.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:06.866+0000 7fa0ad7fa640 1 -- 172.21.15.99:0/3241749598 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa0b013ff50 con 0x7fa0b0144c70 2024-01-19T05:18:07.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.018+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0b013ff50 con 0x7fa09c066530 2024-01-19T05:18:07.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.026+0000 7fa0ad7fa640 1 -- 172.21.15.99:0/3241749598 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249779 (secure 0 0 0) 0x7fa0b013ff50 con 0x7fa09c066530 2024-01-19T05:18:07.029 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:07.030 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa09c066530 msgr2=0x7fa09c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa09c066530 0x7fa09c0689f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000b9d0 tx=0x7fa0a0008040 comp rx=0 tx=0).stop 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 msgr2=0x7fa0b01e2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b01e2610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800caf0 tx=0x7fa0a80021d0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 shutdown_connections 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa09c066530 0x7fa09c0689f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0b0144c70 0x7fa0b01e2610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0b00b19f0 0x7fa0b01e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 --2- 172.21.15.99:0/3241749598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b0071de0 0x7fa0b00b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 >> 172.21.15.99:0/3241749598 conn(0x7fa0b00b8080 msgr2=0x7fa0b0140bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 shutdown_connections 2024-01-19T05:18:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.030+0000 7fa0b6f8e640 1 -- 172.21.15.99:0/3241749598 wait complete. 2024-01-19T05:18:07.047 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-19T05:18:05.344235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235328,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739392,"statfs":{"total":773094113280,"available":772853137408,"internally_reserved":0,"allocated":2433024,"data_stored":1546680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001353"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-01-19T05:17:54.978725+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:17:54.978725+0000","last_peered":"2024-01-19T05:17:54.978725+0000","last_clean":"2024-01-19T05:17:54.978725+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:17:54.978725+0000","last_undegraded":"2024-01-19T05:17:54.978725+0000","last_fullsized":"2024-01-19T05:17:54.978725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:02.624304+0000","last_change":"2024-01-19T05:18:02.624304+0000","last_active":"2024-01-19T05:18:02.624304+0000","last_peered":"2024-01-19T05:18:02.624304+0000","last_clean":"2024-01-19T05:18:02.624304+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:02.624304+0000","last_undegraded":"2024-01-19T05:18:02.624304+0000","last_fullsized":"2024-01-19T05:18:02.624304+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:01.615645+0000","last_change":"2024-01-19T05:18:01.615645+0000","last_active":"2024-01-19T05:18:01.615645+0000","last_peered":"2024-01-19T05:18:01.615645+0000","last_clean":"2024-01-19T05:18:01.615645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:01.615645+0000","last_undegraded":"2024-01-19T05:18:01.615645+0000","last_fullsized":"2024-01-19T05:18:01.615645+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31340,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31340,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31332,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:07.051 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:07.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.206+0000 7fbb4fda2640 1 Processor -- start 2024-01-19T05:18:07.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.206+0000 7fbb4fda2640 1 -- start start 2024-01-19T05:18:07.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4fda2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbb480b19f0 0x7fbb4806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4fda2640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb48070680 con 0x7fbb480724f0 2024-01-19T05:18:07.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4fda2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb48070410 con 0x7fbb48144c70 2024-01-19T05:18:07.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4fda2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb48144790 con 0x7fbb480b19f0 2024-01-19T05:18:07.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4e33f640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbb480724f0 0x7fbb4814ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42450/0 (socket says 172.21.15.99:42450) 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4e33f640 1 -- 172.21.15.99:0/4048172754 learned_addr learned my addr 172.21.15.99:0/4048172754 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4db3e640 1 --2- 172.21.15.99:0/4048172754 >> v2:172.21.15.157:3300/0 conn(0x7fbb480b19f0 0x7fbb4806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970555 0 0) 0x7fbb48070680 con 0x7fbb480724f0 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb30003530 con 0x7fbb480724f0 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2602290381 0 0) 0x7fbb30003530 con 0x7fbb480724f0 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 >> v2:172.21.15.157:3300/0 conn(0x7fbb480b19f0 msgr2=0x7fbb4806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 --2- 172.21.15.99:0/4048172754 >> v2:172.21.15.157:3300/0 conn(0x7fbb480b19f0 0x7fbb4806ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 >> v1:172.21.15.157:6789/0 conn(0x7fbb48144c70 legacy=0x7fbb48071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4806f2b0 con 0x7fbb480724f0 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fbb380016a0 con 0x7fbb480724f0 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 >> v1:172.21.15.99:6789/0 conn(0x7fbb480724f0 legacy=0x7fbb4814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb30003980 0x7fbb30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb300047d0 0x7fbb30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb30005190 0x7fbb3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb48144790 con 0x7fbb30003980 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3000c130 con 0x7fbb30005190 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3000c2f0 con 0x7fbb300047d0 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4db3e640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb30003980 0x7fbb30003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4e33f640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb30005190 0x7fbb3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4db3e640 1 -- 172.21.15.99:0/4048172754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb300047d0 msgr2=0x7fbb30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4db3e640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb300047d0 0x7fbb30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4db3e640 1 -- 172.21.15.99:0/4048172754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb30005190 msgr2=0x7fbb3000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4db3e640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb30005190 0x7fbb3000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4e33f640 1 -- 172.21.15.99:0/4048172754 reap_dead start 2024-01-19T05:18:07.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.210+0000 7fbb4db3e640 1 -- 172.21.15.99:0/4048172754 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30003530 con 0x7fbb30003980 2024-01-19T05:18:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4db3e640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb30003980 0x7fbb30003da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009fc0 tx=0x7fbb4001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c0da528777a62f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb400a5c70 con 0x7fbb30003980 2024-01-19T05:18:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4000f040 con 0x7fbb30003980 2024-01-19T05:18:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4cb3c640 1 -- 172.21.15.99:0/4048172754 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb400ad440 con 0x7fbb30003980 2024-01-19T05:18:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- 172.21.15.99:0/4048172754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb30003980 msgr2=0x7fbb30003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb30003980 0x7fbb30003da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009fc0 tx=0x7fbb4001cc60 comp rx=0 tx=0).stop 2024-01-19T05:18:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- 172.21.15.99:0/4048172754 shutdown_connections 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 --2- 172.21.15.99:0/4048172754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb30003980 0x7fbb30003da0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- 172.21.15.99:0/4048172754 >> 172.21.15.99:0/4048172754 conn(0x7fbb480b8080 msgr2=0x7fbb480b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- 172.21.15.99:0/4048172754 shutdown_connections 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- 172.21.15.99:0/4048172754 wait complete. 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 Processor -- start 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- start start 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb30003980 0x7fbb481d3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb481461a0 0x7fbb48146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4813d6d0 0x7fbb4813db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb48146b60 con 0x7fbb4813d6d0 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb48143a30 con 0x7fbb481461a0 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb48143d10 con 0x7fbb30003980 2024-01-19T05:18:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4813d6d0 0x7fbb4813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4813d6d0 0x7fbb4813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55640/0 (socket says 172.21.15.99:55640) 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 -- 172.21.15.99:0/2142415221 learned_addr learned my addr 172.21.15.99:0/2142415221 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4db3e640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb30003980 0x7fbb481d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4d33d640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb481461a0 0x7fbb48146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 -- 172.21.15.99:0/2142415221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb30003980 msgr2=0x7fbb481d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb30003980 0x7fbb481d3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 -- 172.21.15.99:0/2142415221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb481461a0 msgr2=0x7fbb48146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb481461a0 0x7fbb48146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 -- 172.21.15.99:0/2142415221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb48143ff0 con 0x7fbb4813d6d0 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4e33f640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4813d6d0 0x7fbb4813db50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb480702d0 tx=0x7fbb3800d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb467fc640 1 -- 172.21.15.99:0/2142415221 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38007440 con 0x7fbb4813d6d0 2024-01-19T05:18:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb467fc640 1 -- 172.21.15.99:0/2142415221 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380075a0 con 0x7fbb4813d6d0 2024-01-19T05:18:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb480a8600 con 0x7fbb4813d6d0 2024-01-19T05:18:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb467fc640 1 -- 172.21.15.99:0/2142415221 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38004a10 con 0x7fbb4813d6d0 2024-01-19T05:18:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.214+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4813e090 con 0x7fbb4813d6d0 2024-01-19T05:18:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.218+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb480696e0 con 0x7fbb4813d6d0 2024-01-19T05:18:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.218+0000 7fbb467fc640 1 -- 172.21.15.99:0/2142415221 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbb38004b70 con 0x7fbb4813d6d0 2024-01-19T05:18:07.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.218+0000 7fbb467fc640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb34066530 0x7fbb340689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.218+0000 7fbb467fc640 1 -- 172.21.15.99:0/2142415221 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb38083910 con 0x7fbb4813d6d0 2024-01-19T05:18:07.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.218+0000 7fbb4db3e640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb34066530 0x7fbb340689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.218+0000 7fbb4db3e640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb34066530 0x7fbb340689f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb400af000 tx=0x7fbb400a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.222+0000 7fbb467fc640 1 -- 172.21.15.99:0/2142415221 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbb38050c60 con 0x7fbb4813d6d0 2024-01-19T05:18:07.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.374+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb4806f590 con 0x7fbb34066530 2024-01-19T05:18:07.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.382+0000 7fbb467fc640 1 -- 172.21.15.99:0/2142415221 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264560 (secure 0 0 0) 0x7fbb400a5bf0 con 0x7fbb34066530 2024-01-19T05:18:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:07.389 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb34066530 msgr2=0x7fbb340689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb34066530 0x7fbb340689f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb400af000 tx=0x7fbb400a7040 comp rx=0 tx=0).stop 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4813d6d0 msgr2=0x7fbb4813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4813d6d0 0x7fbb4813db50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb480702d0 tx=0x7fbb3800d960 comp rx=0 tx=0).stop 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 shutdown_connections 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb34066530 0x7fbb340689f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4813d6d0 0x7fbb4813db50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb481461a0 0x7fbb48146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 --2- 172.21.15.99:0/2142415221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb30003980 0x7fbb481d3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 >> 172.21.15.99:0/2142415221 conn(0x7fbb480b8080 msgr2=0x7fbb480b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:07.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 shutdown_connections 2024-01-19T05:18:07.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.390+0000 7fbb4fda2640 1 -- 172.21.15.99:0/2142415221 wait complete. 2024-01-19T05:18:07.406 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-19T05:18:07.344811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235600,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739120,"statfs":{"total":773094113280,"available":772852858880,"internally_reserved":0,"allocated":2842624,"data_stored":1727636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.718706"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729517+0000","last_change":"2024-01-19T05:18:03.537400+0000","last_active":"2024-01-19T05:18:04.729517+0000","last_peered":"2024-01-19T05:18:04.729517+0000","last_clean":"2024-01-19T05:18:04.729517+0000","last_became_active":"2024-01-19T05:18:03.536533+0000","last_became_peered":"2024-01-19T05:18:03.536533+0000","last_unstale":"2024-01-19T05:18:04.729517+0000","last_undegraded":"2024-01-19T05:18:04.729517+0000","last_fullsized":"2024-01-19T05:18:04.729517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513273+0000","last_change":"2024-01-19T05:18:03.538419+0000","last_active":"2024-01-19T05:18:04.513273+0000","last_peered":"2024-01-19T05:18:04.513273+0000","last_clean":"2024-01-19T05:18:04.513273+0000","last_became_active":"2024-01-19T05:18:03.537715+0000","last_became_peered":"2024-01-19T05:18:03.537715+0000","last_unstale":"2024-01-19T05:18:04.513273+0000","last_undegraded":"2024-01-19T05:18:04.513273+0000","last_fullsized":"2024-01-19T05:18:04.513273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728283+0000","last_change":"2024-01-19T05:18:03.554921+0000","last_active":"2024-01-19T05:18:04.728283+0000","last_peered":"2024-01-19T05:18:04.728283+0000","last_clean":"2024-01-19T05:18:04.728283+0000","last_became_active":"2024-01-19T05:18:03.554270+0000","last_became_peered":"2024-01-19T05:18:03.554270+0000","last_unstale":"2024-01-19T05:18:04.728283+0000","last_undegraded":"2024-01-19T05:18:04.728283+0000","last_fullsized":"2024-01-19T05:18:04.728283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:13.087104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730979+0000","last_change":"2024-01-19T05:18:03.566913+0000","last_active":"2024-01-19T05:18:04.730979+0000","last_peered":"2024-01-19T05:18:04.730979+0000","last_clean":"2024-01-19T05:18:04.730979+0000","last_became_active":"2024-01-19T05:18:03.566063+0000","last_became_peered":"2024-01-19T05:18:03.566063+0000","last_unstale":"2024-01-19T05:18:04.730979+0000","last_undegraded":"2024-01-19T05:18:04.730979+0000","last_fullsized":"2024-01-19T05:18:04.730979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.554926+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.554035+0000","last_became_peered":"2024-01-19T05:18:03.554035+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730556+0000","last_change":"2024-01-19T05:18:03.563300+0000","last_active":"2024-01-19T05:18:04.730556+0000","last_peered":"2024-01-19T05:18:04.730556+0000","last_clean":"2024-01-19T05:18:04.730556+0000","last_became_active":"2024-01-19T05:18:03.562655+0000","last_became_peered":"2024-01-19T05:18:03.562655+0000","last_unstale":"2024-01-19T05:18:04.730556+0000","last_undegraded":"2024-01-19T05:18:04.730556+0000","last_fullsized":"2024-01-19T05:18:04.730556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729148+0000","last_change":"2024-01-19T05:18:03.535107+0000","last_active":"2024-01-19T05:18:04.729148+0000","last_peered":"2024-01-19T05:18:04.729148+0000","last_clean":"2024-01-19T05:18:04.729148+0000","last_became_active":"2024-01-19T05:18:03.534338+0000","last_became_peered":"2024-01-19T05:18:03.534338+0000","last_unstale":"2024-01-19T05:18:04.729148+0000","last_undegraded":"2024-01-19T05:18:04.729148+0000","last_fullsized":"2024-01-19T05:18:04.729148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728969+0000","last_change":"2024-01-19T05:18:03.567466+0000","last_active":"2024-01-19T05:18:04.728969+0000","last_peered":"2024-01-19T05:18:04.728969+0000","last_clean":"2024-01-19T05:18:04.728969+0000","last_became_active":"2024-01-19T05:18:03.566828+0000","last_became_peered":"2024-01-19T05:18:03.566828+0000","last_unstale":"2024-01-19T05:18:04.728969+0000","last_undegraded":"2024-01-19T05:18:04.728969+0000","last_fullsized":"2024-01-19T05:18:04.728969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.573607+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.573072+0000","last_became_peered":"2024-01-19T05:18:03.573072+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515175+0000","last_change":"2024-01-19T05:18:03.560176+0000","last_active":"2024-01-19T05:18:04.515175+0000","last_peered":"2024-01-19T05:18:04.515175+0000","last_clean":"2024-01-19T05:18:04.515175+0000","last_became_active":"2024-01-19T05:18:03.559432+0000","last_became_peered":"2024-01-19T05:18:03.559432+0000","last_unstale":"2024-01-19T05:18:04.515175+0000","last_undegraded":"2024-01-19T05:18:04.515175+0000","last_fullsized":"2024-01-19T05:18:04.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515576+0000","last_change":"2024-01-19T05:18:03.570077+0000","last_active":"2024-01-19T05:18:04.515576+0000","last_peered":"2024-01-19T05:18:04.515576+0000","last_clean":"2024-01-19T05:18:04.515576+0000","last_became_active":"2024-01-19T05:18:03.569528+0000","last_became_peered":"2024-01-19T05:18:03.569528+0000","last_unstale":"2024-01-19T05:18:04.515576+0000","last_undegraded":"2024-01-19T05:18:04.515576+0000","last_fullsized":"2024-01-19T05:18:04.515576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516108+0000","last_change":"2024-01-19T05:18:03.538635+0000","last_active":"2024-01-19T05:18:04.516108+0000","last_peered":"2024-01-19T05:18:04.516108+0000","last_clean":"2024-01-19T05:18:04.516108+0000","last_became_active":"2024-01-19T05:18:03.537778+0000","last_became_peered":"2024-01-19T05:18:03.537778+0000","last_unstale":"2024-01-19T05:18:04.516108+0000","last_undegraded":"2024-01-19T05:18:04.516108+0000","last_fullsized":"2024-01-19T05:18:04.516108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729656+0000","last_change":"2024-01-19T05:18:03.542188+0000","last_active":"2024-01-19T05:18:04.729656+0000","last_peered":"2024-01-19T05:18:04.729656+0000","last_clean":"2024-01-19T05:18:04.729656+0000","last_became_active":"2024-01-19T05:18:03.541504+0000","last_became_peered":"2024-01-19T05:18:03.541504+0000","last_unstale":"2024-01-19T05:18:04.729656+0000","last_undegraded":"2024-01-19T05:18:04.729656+0000","last_fullsized":"2024-01-19T05:18:04.729656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728750+0000","last_change":"2024-01-19T05:18:03.547095+0000","last_active":"2024-01-19T05:18:04.728750+0000","last_peered":"2024-01-19T05:18:04.728750+0000","last_clean":"2024-01-19T05:18:04.728750+0000","last_became_active":"2024-01-19T05:18:03.546466+0000","last_became_peered":"2024-01-19T05:18:03.546466+0000","last_unstale":"2024-01-19T05:18:04.728750+0000","last_undegraded":"2024-01-19T05:18:04.728750+0000","last_fullsized":"2024-01-19T05:18:04.728750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512907+0000","last_change":"2024-01-19T05:18:03.540449+0000","last_active":"2024-01-19T05:18:04.512907+0000","last_peered":"2024-01-19T05:18:04.512907+0000","last_clean":"2024-01-19T05:18:04.512907+0000","last_became_active":"2024-01-19T05:18:03.539616+0000","last_became_peered":"2024-01-19T05:18:03.539616+0000","last_unstale":"2024-01-19T05:18:04.512907+0000","last_undegraded":"2024-01-19T05:18:04.512907+0000","last_fullsized":"2024-01-19T05:18:04.512907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728960+0000","last_change":"2024-01-19T05:18:03.568406+0000","last_active":"2024-01-19T05:18:04.728960+0000","last_peered":"2024-01-19T05:18:04.728960+0000","last_clean":"2024-01-19T05:18:04.728960+0000","last_became_active":"2024-01-19T05:18:03.567759+0000","last_became_peered":"2024-01-19T05:18:03.567759+0000","last_unstale":"2024-01-19T05:18:04.728960+0000","last_undegraded":"2024-01-19T05:18:04.728960+0000","last_fullsized":"2024-01-19T05:18:04.728960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731803+0000","last_change":"2024-01-19T05:18:03.571085+0000","last_active":"2024-01-19T05:18:04.731803+0000","last_peered":"2024-01-19T05:18:04.731803+0000","last_clean":"2024-01-19T05:18:04.731803+0000","last_became_active":"2024-01-19T05:18:03.569878+0000","last_became_peered":"2024-01-19T05:18:03.569878+0000","last_unstale":"2024-01-19T05:18:04.731803+0000","last_undegraded":"2024-01-19T05:18:04.731803+0000","last_fullsized":"2024-01-19T05:18:04.731803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728098+0000","last_change":"2024-01-19T05:18:03.520269+0000","last_active":"2024-01-19T05:18:04.728098+0000","last_peered":"2024-01-19T05:18:04.728098+0000","last_clean":"2024-01-19T05:18:04.728098+0000","last_became_active":"2024-01-19T05:18:03.519676+0000","last_became_peered":"2024-01-19T05:18:03.519676+0000","last_unstale":"2024-01-19T05:18:04.728098+0000","last_undegraded":"2024-01-19T05:18:04.728098+0000","last_fullsized":"2024-01-19T05:18:04.728098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730254+0000","last_change":"2024-01-19T05:18:03.555567+0000","last_active":"2024-01-19T05:18:04.730254+0000","last_peered":"2024-01-19T05:18:04.730254+0000","last_clean":"2024-01-19T05:18:04.730254+0000","last_became_active":"2024-01-19T05:18:03.554832+0000","last_became_peered":"2024-01-19T05:18:03.554832+0000","last_unstale":"2024-01-19T05:18:04.730254+0000","last_undegraded":"2024-01-19T05:18:04.730254+0000","last_fullsized":"2024-01-19T05:18:04.730254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514744+0000","last_change":"2024-01-19T05:18:03.545771+0000","last_active":"2024-01-19T05:18:04.514744+0000","last_peered":"2024-01-19T05:18:04.514744+0000","last_clean":"2024-01-19T05:18:04.514744+0000","last_became_active":"2024-01-19T05:18:03.545003+0000","last_became_peered":"2024-01-19T05:18:03.545003+0000","last_unstale":"2024-01-19T05:18:04.514744+0000","last_undegraded":"2024-01-19T05:18:04.514744+0000","last_fullsized":"2024-01-19T05:18:04.514744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728346+0000","last_change":"2024-01-19T05:18:03.551774+0000","last_active":"2024-01-19T05:18:04.728346+0000","last_peered":"2024-01-19T05:18:04.728346+0000","last_clean":"2024-01-19T05:18:04.728346+0000","last_became_active":"2024-01-19T05:18:03.550788+0000","last_became_peered":"2024-01-19T05:18:03.550788+0000","last_unstale":"2024-01-19T05:18:04.728346+0000","last_undegraded":"2024-01-19T05:18:04.728346+0000","last_fullsized":"2024-01-19T05:18:04.728346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731558+0000","last_change":"2024-01-19T05:18:03.568310+0000","last_active":"2024-01-19T05:18:04.731558+0000","last_peered":"2024-01-19T05:18:04.731558+0000","last_clean":"2024-01-19T05:18:04.731558+0000","last_became_active":"2024-01-19T05:18:03.567678+0000","last_became_peered":"2024-01-19T05:18:03.567678+0000","last_unstale":"2024-01-19T05:18:04.731558+0000","last_undegraded":"2024-01-19T05:18:04.731558+0000","last_fullsized":"2024-01-19T05:18:04.731558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729157+0000","last_change":"2024-01-19T05:18:03.554839+0000","last_active":"2024-01-19T05:18:04.729157+0000","last_peered":"2024-01-19T05:18:04.729157+0000","last_clean":"2024-01-19T05:18:04.729157+0000","last_became_active":"2024-01-19T05:18:03.551361+0000","last_became_peered":"2024-01-19T05:18:03.551361+0000","last_unstale":"2024-01-19T05:18:04.729157+0000","last_undegraded":"2024-01-19T05:18:04.729157+0000","last_fullsized":"2024-01-19T05:18:04.729157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729155+0000","last_change":"2024-01-19T05:18:03.563289+0000","last_active":"2024-01-19T05:18:04.729155+0000","last_peered":"2024-01-19T05:18:04.729155+0000","last_clean":"2024-01-19T05:18:04.729155+0000","last_became_active":"2024-01-19T05:18:03.556561+0000","last_became_peered":"2024-01-19T05:18:03.556561+0000","last_unstale":"2024-01-19T05:18:04.729155+0000","last_undegraded":"2024-01-19T05:18:04.729155+0000","last_fullsized":"2024-01-19T05:18:04.729155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730025+0000","last_change":"2024-01-19T05:18:03.546978+0000","last_active":"2024-01-19T05:18:04.730025+0000","last_peered":"2024-01-19T05:18:04.730025+0000","last_clean":"2024-01-19T05:18:04.730025+0000","last_became_active":"2024-01-19T05:18:03.546276+0000","last_became_peered":"2024-01-19T05:18:03.546276+0000","last_unstale":"2024-01-19T05:18:04.730025+0000","last_undegraded":"2024-01-19T05:18:04.730025+0000","last_fullsized":"2024-01-19T05:18:04.730025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515447+0000","last_change":"2024-01-19T05:18:03.525138+0000","last_active":"2024-01-19T05:18:04.515447+0000","last_peered":"2024-01-19T05:18:04.515447+0000","last_clean":"2024-01-19T05:18:04.515447+0000","last_became_active":"2024-01-19T05:18:03.524523+0000","last_became_peered":"2024-01-19T05:18:03.524523+0000","last_unstale":"2024-01-19T05:18:04.515447+0000","last_undegraded":"2024-01-19T05:18:04.515447+0000","last_fullsized":"2024-01-19T05:18:04.515447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512997+0000","last_change":"2024-01-19T05:18:03.544359+0000","last_active":"2024-01-19T05:18:04.512997+0000","last_peered":"2024-01-19T05:18:04.512997+0000","last_clean":"2024-01-19T05:18:04.512997+0000","last_became_active":"2024-01-19T05:18:03.543559+0000","last_became_peered":"2024-01-19T05:18:03.543559+0000","last_unstale":"2024-01-19T05:18:04.512997+0000","last_undegraded":"2024-01-19T05:18:04.512997+0000","last_fullsized":"2024-01-19T05:18:04.512997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729855+0000","last_change":"2024-01-19T05:18:03.549033+0000","last_active":"2024-01-19T05:18:04.729855+0000","last_peered":"2024-01-19T05:18:04.729855+0000","last_clean":"2024-01-19T05:18:04.729855+0000","last_became_active":"2024-01-19T05:18:03.548292+0000","last_became_peered":"2024-01-19T05:18:03.548292+0000","last_unstale":"2024-01-19T05:18:04.729855+0000","last_undegraded":"2024-01-19T05:18:04.729855+0000","last_fullsized":"2024-01-19T05:18:04.729855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728511+0000","last_change":"2024-01-19T05:18:03.557894+0000","last_active":"2024-01-19T05:18:04.728511+0000","last_peered":"2024-01-19T05:18:04.728511+0000","last_clean":"2024-01-19T05:18:04.728511+0000","last_became_active":"2024-01-19T05:18:03.556934+0000","last_became_peered":"2024-01-19T05:18:03.556934+0000","last_unstale":"2024-01-19T05:18:04.728511+0000","last_undegraded":"2024-01-19T05:18:04.728511+0000","last_fullsized":"2024-01-19T05:18:04.728511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730933+0000","last_change":"2024-01-19T05:18:03.557384+0000","last_active":"2024-01-19T05:18:04.730933+0000","last_peered":"2024-01-19T05:18:04.730933+0000","last_clean":"2024-01-19T05:18:04.730933+0000","last_became_active":"2024-01-19T05:18:03.555960+0000","last_became_peered":"2024-01-19T05:18:03.555960+0000","last_unstale":"2024-01-19T05:18:04.730933+0000","last_undegraded":"2024-01-19T05:18:04.730933+0000","last_fullsized":"2024-01-19T05:18:04.730933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727845+0000","last_change":"2024-01-19T05:18:03.560129+0000","last_active":"2024-01-19T05:18:04.727845+0000","last_peered":"2024-01-19T05:18:04.727845+0000","last_clean":"2024-01-19T05:18:04.727845+0000","last_became_active":"2024-01-19T05:18:03.559502+0000","last_became_peered":"2024-01-19T05:18:03.559502+0000","last_unstale":"2024-01-19T05:18:04.727845+0000","last_undegraded":"2024-01-19T05:18:04.727845+0000","last_fullsized":"2024-01-19T05:18:04.727845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513499+0000","last_change":"2024-01-19T05:18:03.537557+0000","last_active":"2024-01-19T05:18:04.513499+0000","last_peered":"2024-01-19T05:18:04.513499+0000","last_clean":"2024-01-19T05:18:04.513499+0000","last_became_active":"2024-01-19T05:18:03.536744+0000","last_became_peered":"2024-01-19T05:18:03.536744+0000","last_unstale":"2024-01-19T05:18:04.513499+0000","last_undegraded":"2024-01-19T05:18:04.513499+0000","last_fullsized":"2024-01-19T05:18:04.513499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514550+0000","last_change":"2024-01-19T05:18:03.537254+0000","last_active":"2024-01-19T05:18:04.514550+0000","last_peered":"2024-01-19T05:18:04.514550+0000","last_clean":"2024-01-19T05:18:04.514550+0000","last_became_active":"2024-01-19T05:18:03.536484+0000","last_became_peered":"2024-01-19T05:18:03.536484+0000","last_unstale":"2024-01-19T05:18:04.514550+0000","last_undegraded":"2024-01-19T05:18:04.514550+0000","last_fullsized":"2024-01-19T05:18:04.514550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:40.310261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729759+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.729759+0000","last_peered":"2024-01-19T05:18:04.729759+0000","last_clean":"2024-01-19T05:18:04.729759+0000","last_became_active":"2024-01-19T05:18:02.664263+0000","last_became_peered":"2024-01-19T05:18:02.664263+0000","last_unstale":"2024-01-19T05:18:04.729759+0000","last_undegraded":"2024-01-19T05:18:04.729759+0000","last_fullsized":"2024-01-19T05:18:04.729759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728651+0000","last_change":"2024-01-19T05:18:03.544005+0000","last_active":"2024-01-19T05:18:04.728651+0000","last_peered":"2024-01-19T05:18:04.728651+0000","last_clean":"2024-01-19T05:18:04.728651+0000","last_became_active":"2024-01-19T05:18:03.543213+0000","last_became_peered":"2024-01-19T05:18:03.543213+0000","last_unstale":"2024-01-19T05:18:04.728651+0000","last_undegraded":"2024-01-19T05:18:04.728651+0000","last_fullsized":"2024-01-19T05:18:04.728651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515401+0000","last_change":"2024-01-19T05:18:02.657382+0000","last_active":"2024-01-19T05:18:04.515401+0000","last_peered":"2024-01-19T05:18:04.515401+0000","last_clean":"2024-01-19T05:18:04.515401+0000","last_became_active":"2024-01-19T05:18:02.656806+0000","last_became_peered":"2024-01-19T05:18:02.656806+0000","last_unstale":"2024-01-19T05:18:04.515401+0000","last_undegraded":"2024-01-19T05:18:04.515401+0000","last_fullsized":"2024-01-19T05:18:04.515401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729079+0000","last_change":"2024-01-19T05:18:02.653215+0000","last_active":"2024-01-19T05:18:04.729079+0000","last_peered":"2024-01-19T05:18:04.729079+0000","last_clean":"2024-01-19T05:18:04.729079+0000","last_became_active":"2024-01-19T05:18:02.652938+0000","last_became_peered":"2024-01-19T05:18:02.652938+0000","last_unstale":"2024-01-19T05:18:04.729079+0000","last_undegraded":"2024-01-19T05:18:04.729079+0000","last_fullsized":"2024-01-19T05:18:04.729079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729005+0000","last_change":"2024-01-19T05:18:03.541881+0000","last_active":"2024-01-19T05:18:04.729005+0000","last_peered":"2024-01-19T05:18:04.729005+0000","last_clean":"2024-01-19T05:18:04.729005+0000","last_became_active":"2024-01-19T05:18:03.541176+0000","last_became_peered":"2024-01-19T05:18:03.541176+0000","last_unstale":"2024-01-19T05:18:04.729005+0000","last_undegraded":"2024-01-19T05:18:04.729005+0000","last_fullsized":"2024-01-19T05:18:04.729005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730990+0000","last_change":"2024-01-19T05:18:02.657034+0000","last_active":"2024-01-19T05:18:04.730990+0000","last_peered":"2024-01-19T05:18:04.730990+0000","last_clean":"2024-01-19T05:18:04.730990+0000","last_became_active":"2024-01-19T05:18:02.656500+0000","last_became_peered":"2024-01-19T05:18:02.656500+0000","last_unstale":"2024-01-19T05:18:04.730990+0000","last_undegraded":"2024-01-19T05:18:04.730990+0000","last_fullsized":"2024-01-19T05:18:04.730990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512764+0000","last_change":"2024-01-19T05:18:03.544242+0000","last_active":"2024-01-19T05:18:04.512764+0000","last_peered":"2024-01-19T05:18:04.512764+0000","last_clean":"2024-01-19T05:18:04.512764+0000","last_became_active":"2024-01-19T05:18:03.543438+0000","last_became_peered":"2024-01-19T05:18:03.543438+0000","last_unstale":"2024-01-19T05:18:04.512764+0000","last_undegraded":"2024-01-19T05:18:04.512764+0000","last_fullsized":"2024-01-19T05:18:04.512764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515016+0000","last_change":"2024-01-19T05:18:02.653594+0000","last_active":"2024-01-19T05:18:04.515016+0000","last_peered":"2024-01-19T05:18:04.515016+0000","last_clean":"2024-01-19T05:18:04.515016+0000","last_became_active":"2024-01-19T05:18:02.653182+0000","last_became_peered":"2024-01-19T05:18:02.653182+0000","last_unstale":"2024-01-19T05:18:04.515016+0000","last_undegraded":"2024-01-19T05:18:04.515016+0000","last_fullsized":"2024-01-19T05:18:04.515016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730837+0000","last_change":"2024-01-19T05:18:03.562845+0000","last_active":"2024-01-19T05:18:04.730837+0000","last_peered":"2024-01-19T05:18:04.730837+0000","last_clean":"2024-01-19T05:18:04.730837+0000","last_became_active":"2024-01-19T05:18:03.562235+0000","last_became_peered":"2024-01-19T05:18:03.562235+0000","last_unstale":"2024-01-19T05:18:04.730837+0000","last_undegraded":"2024-01-19T05:18:04.730837+0000","last_fullsized":"2024-01-19T05:18:04.730837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731055+0000","last_change":"2024-01-19T05:18:02.660025+0000","last_active":"2024-01-19T05:18:04.731055+0000","last_peered":"2024-01-19T05:18:04.731055+0000","last_clean":"2024-01-19T05:18:04.731055+0000","last_became_active":"2024-01-19T05:18:02.659546+0000","last_became_peered":"2024-01-19T05:18:02.659546+0000","last_unstale":"2024-01-19T05:18:04.731055+0000","last_undegraded":"2024-01-19T05:18:04.731055+0000","last_fullsized":"2024-01-19T05:18:04.731055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:56.624468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728512+0000","last_change":"2024-01-19T05:18:03.568936+0000","last_active":"2024-01-19T05:18:04.728512+0000","last_peered":"2024-01-19T05:18:04.728512+0000","last_clean":"2024-01-19T05:18:04.728512+0000","last_became_active":"2024-01-19T05:18:03.568337+0000","last_became_peered":"2024-01-19T05:18:03.568337+0000","last_unstale":"2024-01-19T05:18:04.728512+0000","last_undegraded":"2024-01-19T05:18:04.728512+0000","last_fullsized":"2024-01-19T05:18:04.728512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513376+0000","last_change":"2024-01-19T05:18:02.661567+0000","last_active":"2024-01-19T05:18:04.513376+0000","last_peered":"2024-01-19T05:18:04.513376+0000","last_clean":"2024-01-19T05:18:04.513376+0000","last_became_active":"2024-01-19T05:18:02.660906+0000","last_became_peered":"2024-01-19T05:18:02.660906+0000","last_unstale":"2024-01-19T05:18:04.513376+0000","last_undegraded":"2024-01-19T05:18:04.513376+0000","last_fullsized":"2024-01-19T05:18:04.513376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516234+0000","last_change":"2024-01-19T05:18:03.548080+0000","last_active":"2024-01-19T05:18:04.516234+0000","last_peered":"2024-01-19T05:18:04.516234+0000","last_clean":"2024-01-19T05:18:04.516234+0000","last_became_active":"2024-01-19T05:18:03.547506+0000","last_became_peered":"2024-01-19T05:18:03.547506+0000","last_unstale":"2024-01-19T05:18:04.516234+0000","last_undegraded":"2024-01-19T05:18:04.516234+0000","last_fullsized":"2024-01-19T05:18:04.516234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514989+0000","last_change":"2024-01-19T05:18:02.660672+0000","last_active":"2024-01-19T05:18:04.514989+0000","last_peered":"2024-01-19T05:18:04.514989+0000","last_clean":"2024-01-19T05:18:04.514989+0000","last_became_active":"2024-01-19T05:18:02.659596+0000","last_became_peered":"2024-01-19T05:18:02.659596+0000","last_unstale":"2024-01-19T05:18:04.514989+0000","last_undegraded":"2024-01-19T05:18:04.514989+0000","last_fullsized":"2024-01-19T05:18:04.514989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729720+0000","last_change":"2024-01-19T05:18:03.550622+0000","last_active":"2024-01-19T05:18:04.729720+0000","last_peered":"2024-01-19T05:18:04.729720+0000","last_clean":"2024-01-19T05:18:04.729720+0000","last_became_active":"2024-01-19T05:18:03.548243+0000","last_became_peered":"2024-01-19T05:18:03.548243+0000","last_unstale":"2024-01-19T05:18:04.729720+0000","last_undegraded":"2024-01-19T05:18:04.729720+0000","last_fullsized":"2024-01-19T05:18:04.729720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728733+0000","last_change":"2024-01-19T05:18:02.653694+0000","last_active":"2024-01-19T05:18:04.728733+0000","last_peered":"2024-01-19T05:18:04.728733+0000","last_clean":"2024-01-19T05:18:04.728733+0000","last_became_active":"2024-01-19T05:18:02.653236+0000","last_became_peered":"2024-01-19T05:18:02.653236+0000","last_unstale":"2024-01-19T05:18:04.728733+0000","last_undegraded":"2024-01-19T05:18:04.728733+0000","last_fullsized":"2024-01-19T05:18:04.728733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728870+0000","last_change":"2024-01-19T05:18:03.541272+0000","last_active":"2024-01-19T05:18:04.728870+0000","last_peered":"2024-01-19T05:18:04.728870+0000","last_clean":"2024-01-19T05:18:04.728870+0000","last_became_active":"2024-01-19T05:18:03.540187+0000","last_became_peered":"2024-01-19T05:18:03.540187+0000","last_unstale":"2024-01-19T05:18:04.728870+0000","last_undegraded":"2024-01-19T05:18:04.728870+0000","last_fullsized":"2024-01-19T05:18:04.728870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731175+0000","last_change":"2024-01-19T05:18:02.662629+0000","last_active":"2024-01-19T05:18:04.731175+0000","last_peered":"2024-01-19T05:18:04.731175+0000","last_clean":"2024-01-19T05:18:04.731175+0000","last_became_active":"2024-01-19T05:18:02.662095+0000","last_became_peered":"2024-01-19T05:18:02.662095+0000","last_unstale":"2024-01-19T05:18:04.731175+0000","last_undegraded":"2024-01-19T05:18:04.731175+0000","last_fullsized":"2024-01-19T05:18:04.731175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:03.589258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729878+0000","last_change":"2024-01-19T05:18:03.543853+0000","last_active":"2024-01-19T05:18:04.729878+0000","last_peered":"2024-01-19T05:18:04.729878+0000","last_clean":"2024-01-19T05:18:04.729878+0000","last_became_active":"2024-01-19T05:18:03.543119+0000","last_became_peered":"2024-01-19T05:18:03.543119+0000","last_unstale":"2024-01-19T05:18:04.729878+0000","last_undegraded":"2024-01-19T05:18:04.729878+0000","last_fullsized":"2024-01-19T05:18:04.729878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513670+0000","last_change":"2024-01-19T05:18:02.657695+0000","last_active":"2024-01-19T05:18:04.513670+0000","last_peered":"2024-01-19T05:18:04.513670+0000","last_clean":"2024-01-19T05:18:04.513670+0000","last_became_active":"2024-01-19T05:18:02.656870+0000","last_became_peered":"2024-01-19T05:18:02.656870+0000","last_unstale":"2024-01-19T05:18:04.513670+0000","last_undegraded":"2024-01-19T05:18:04.513670+0000","last_fullsized":"2024-01-19T05:18:04.513670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513835+0000","last_change":"2024-01-19T05:18:03.534680+0000","last_active":"2024-01-19T05:18:04.513835+0000","last_peered":"2024-01-19T05:18:04.513835+0000","last_clean":"2024-01-19T05:18:04.513835+0000","last_became_active":"2024-01-19T05:18:03.533937+0000","last_became_peered":"2024-01-19T05:18:03.533937+0000","last_unstale":"2024-01-19T05:18:04.513835+0000","last_undegraded":"2024-01-19T05:18:04.513835+0000","last_fullsized":"2024-01-19T05:18:04.513835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727901+0000","last_change":"2024-01-19T05:18:02.650559+0000","last_active":"2024-01-19T05:18:04.727901+0000","last_peered":"2024-01-19T05:18:04.727901+0000","last_clean":"2024-01-19T05:18:04.727901+0000","last_became_active":"2024-01-19T05:18:02.649764+0000","last_became_peered":"2024-01-19T05:18:02.649764+0000","last_unstale":"2024-01-19T05:18:04.727901+0000","last_undegraded":"2024-01-19T05:18:04.727901+0000","last_fullsized":"2024-01-19T05:18:04.727901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729375+0000","last_change":"2024-01-19T05:18:03.550709+0000","last_active":"2024-01-19T05:18:04.729375+0000","last_peered":"2024-01-19T05:18:04.729375+0000","last_clean":"2024-01-19T05:18:04.729375+0000","last_became_active":"2024-01-19T05:18:03.550073+0000","last_became_peered":"2024-01-19T05:18:03.550073+0000","last_unstale":"2024-01-19T05:18:04.729375+0000","last_undegraded":"2024-01-19T05:18:04.729375+0000","last_fullsized":"2024-01-19T05:18:04.729375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516191+0000","last_change":"2024-01-19T05:18:02.655120+0000","last_active":"2024-01-19T05:18:04.516191+0000","last_peered":"2024-01-19T05:18:04.516191+0000","last_clean":"2024-01-19T05:18:04.516191+0000","last_became_active":"2024-01-19T05:18:02.654360+0000","last_became_peered":"2024-01-19T05:18:02.654360+0000","last_unstale":"2024-01-19T05:18:04.516191+0000","last_undegraded":"2024-01-19T05:18:04.516191+0000","last_fullsized":"2024-01-19T05:18:04.516191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:32:02.214385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730500+0000","last_change":"2024-01-19T05:18:03.543739+0000","last_active":"2024-01-19T05:18:04.730500+0000","last_peered":"2024-01-19T05:18:04.730500+0000","last_clean":"2024-01-19T05:18:04.730500+0000","last_became_active":"2024-01-19T05:18:03.543142+0000","last_became_peered":"2024-01-19T05:18:03.543142+0000","last_unstale":"2024-01-19T05:18:04.730500+0000","last_undegraded":"2024-01-19T05:18:04.730500+0000","last_fullsized":"2024-01-19T05:18:04.730500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728061+0000","last_change":"2024-01-19T05:18:02.662915+0000","last_active":"2024-01-19T05:18:04.728061+0000","last_peered":"2024-01-19T05:18:04.728061+0000","last_clean":"2024-01-19T05:18:04.728061+0000","last_became_active":"2024-01-19T05:18:02.662617+0000","last_became_peered":"2024-01-19T05:18:02.662617+0000","last_unstale":"2024-01-19T05:18:04.728061+0000","last_undegraded":"2024-01-19T05:18:04.728061+0000","last_fullsized":"2024-01-19T05:18:04.728061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729905+0000","last_change":"2024-01-19T05:18:03.543521+0000","last_active":"2024-01-19T05:18:04.729905+0000","last_peered":"2024-01-19T05:18:04.729905+0000","last_clean":"2024-01-19T05:18:04.729905+0000","last_became_active":"2024-01-19T05:18:03.542803+0000","last_became_peered":"2024-01-19T05:18:03.542803+0000","last_unstale":"2024-01-19T05:18:04.729905+0000","last_undegraded":"2024-01-19T05:18:04.729905+0000","last_fullsized":"2024-01-19T05:18:04.729905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513101+0000","last_change":"2024-01-19T05:18:02.650642+0000","last_active":"2024-01-19T05:18:04.513101+0000","last_peered":"2024-01-19T05:18:04.513101+0000","last_clean":"2024-01-19T05:18:04.513101+0000","last_became_active":"2024-01-19T05:18:02.650319+0000","last_became_peered":"2024-01-19T05:18:02.650319+0000","last_unstale":"2024-01-19T05:18:04.513101+0000","last_undegraded":"2024-01-19T05:18:04.513101+0000","last_fullsized":"2024-01-19T05:18:04.513101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.565837+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.564725+0000","last_became_peered":"2024-01-19T05:18:03.564725+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727937+0000","last_change":"2024-01-19T05:18:02.656957+0000","last_active":"2024-01-19T05:18:04.727937+0000","last_peered":"2024-01-19T05:18:04.727937+0000","last_clean":"2024-01-19T05:18:04.727937+0000","last_became_active":"2024-01-19T05:18:02.656536+0000","last_became_peered":"2024-01-19T05:18:02.656536+0000","last_unstale":"2024-01-19T05:18:04.727937+0000","last_undegraded":"2024-01-19T05:18:04.727937+0000","last_fullsized":"2024-01-19T05:18:04.727937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729922+0000","last_change":"2024-01-19T05:18:03.571256+0000","last_active":"2024-01-19T05:18:04.729922+0000","last_peered":"2024-01-19T05:18:04.729922+0000","last_clean":"2024-01-19T05:18:04.729922+0000","last_became_active":"2024-01-19T05:18:03.570499+0000","last_became_peered":"2024-01-19T05:18:03.570499+0000","last_unstale":"2024-01-19T05:18:04.729922+0000","last_undegraded":"2024-01-19T05:18:04.729922+0000","last_fullsized":"2024-01-19T05:18:04.729922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-19T05:18:03.520367+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:03.520367+0000","last_peered":"2024-01-19T05:18:03.520367+0000","last_clean":"2024-01-19T05:18:03.520367+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:03.520367+0000","last_undegraded":"2024-01-19T05:18:03.520367+0000","last_fullsized":"2024-01-19T05:18:03.520367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730433+0000","last_change":"2024-01-19T05:18:02.650789+0000","last_active":"2024-01-19T05:18:04.730433+0000","last_peered":"2024-01-19T05:18:04.730433+0000","last_clean":"2024-01-19T05:18:04.730433+0000","last_became_active":"2024-01-19T05:18:02.649923+0000","last_became_peered":"2024-01-19T05:18:02.649923+0000","last_unstale":"2024-01-19T05:18:04.730433+0000","last_undegraded":"2024-01-19T05:18:04.730433+0000","last_fullsized":"2024-01-19T05:18:04.730433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:12.078445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729614+0000","last_change":"2024-01-19T05:18:03.569109+0000","last_active":"2024-01-19T05:18:04.729614+0000","last_peered":"2024-01-19T05:18:04.729614+0000","last_clean":"2024-01-19T05:18:04.729614+0000","last_became_active":"2024-01-19T05:18:03.568602+0000","last_became_peered":"2024-01-19T05:18:03.568602+0000","last_unstale":"2024-01-19T05:18:04.729614+0000","last_undegraded":"2024-01-19T05:18:04.729614+0000","last_fullsized":"2024-01-19T05:18:04.729614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729626+0000","last_change":"2024-01-19T05:18:02.671990+0000","last_active":"2024-01-19T05:18:04.729626+0000","last_peered":"2024-01-19T05:18:04.729626+0000","last_clean":"2024-01-19T05:18:04.729626+0000","last_became_active":"2024-01-19T05:18:02.671477+0000","last_became_peered":"2024-01-19T05:18:02.671477+0000","last_unstale":"2024-01-19T05:18:04.729626+0000","last_undegraded":"2024-01-19T05:18:04.729626+0000","last_fullsized":"2024-01-19T05:18:04.729626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728522+0000","last_change":"2024-01-19T05:18:03.551760+0000","last_active":"2024-01-19T05:18:04.728522+0000","last_peered":"2024-01-19T05:18:04.728522+0000","last_clean":"2024-01-19T05:18:04.728522+0000","last_became_active":"2024-01-19T05:18:03.550881+0000","last_became_peered":"2024-01-19T05:18:03.550881+0000","last_unstale":"2024-01-19T05:18:04.728522+0000","last_undegraded":"2024-01-19T05:18:04.728522+0000","last_fullsized":"2024-01-19T05:18:04.728522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727890+0000","last_change":"2024-01-19T05:18:02.663101+0000","last_active":"2024-01-19T05:18:04.727890+0000","last_peered":"2024-01-19T05:18:04.727890+0000","last_clean":"2024-01-19T05:18:04.727890+0000","last_became_active":"2024-01-19T05:18:02.662604+0000","last_became_peered":"2024-01-19T05:18:02.662604+0000","last_unstale":"2024-01-19T05:18:04.727890+0000","last_undegraded":"2024-01-19T05:18:04.727890+0000","last_fullsized":"2024-01-19T05:18:04.727890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512852+0000","last_change":"2024-01-19T05:18:03.537638+0000","last_active":"2024-01-19T05:18:04.512852+0000","last_peered":"2024-01-19T05:18:04.512852+0000","last_clean":"2024-01-19T05:18:04.512852+0000","last_became_active":"2024-01-19T05:18:03.536862+0000","last_became_peered":"2024-01-19T05:18:03.536862+0000","last_unstale":"2024-01-19T05:18:04.512852+0000","last_undegraded":"2024-01-19T05:18:04.512852+0000","last_fullsized":"2024-01-19T05:18:04.512852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731398+0000","last_change":"2024-01-19T05:18:02.655462+0000","last_active":"2024-01-19T05:18:04.731398+0000","last_peered":"2024-01-19T05:18:04.731398+0000","last_clean":"2024-01-19T05:18:04.731398+0000","last_became_active":"2024-01-19T05:18:02.654363+0000","last_became_peered":"2024-01-19T05:18:02.654363+0000","last_unstale":"2024-01-19T05:18:04.731398+0000","last_undegraded":"2024-01-19T05:18:04.731398+0000","last_fullsized":"2024-01-19T05:18:04.731398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:40.854099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515031+0000","last_change":"2024-01-19T05:18:03.540906+0000","last_active":"2024-01-19T05:18:04.515031+0000","last_peered":"2024-01-19T05:18:04.515031+0000","last_clean":"2024-01-19T05:18:04.515031+0000","last_became_active":"2024-01-19T05:18:03.540116+0000","last_became_peered":"2024-01-19T05:18:03.540116+0000","last_unstale":"2024-01-19T05:18:04.515031+0000","last_undegraded":"2024-01-19T05:18:04.515031+0000","last_fullsized":"2024-01-19T05:18:04.515031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:37.646122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512849+0000","last_change":"2024-01-19T05:18:02.657808+0000","last_active":"2024-01-19T05:18:04.512849+0000","last_peered":"2024-01-19T05:18:04.512849+0000","last_clean":"2024-01-19T05:18:04.512849+0000","last_became_active":"2024-01-19T05:18:02.657357+0000","last_became_peered":"2024-01-19T05:18:02.657357+0000","last_unstale":"2024-01-19T05:18:04.512849+0000","last_undegraded":"2024-01-19T05:18:04.512849+0000","last_fullsized":"2024-01-19T05:18:04.512849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.566199+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.565571+0000","last_became_peered":"2024-01-19T05:18:03.565571+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730213+0000","last_change":"2024-01-19T05:18:02.674805+0000","last_active":"2024-01-19T05:18:04.730213+0000","last_peered":"2024-01-19T05:18:04.730213+0000","last_clean":"2024-01-19T05:18:04.730213+0000","last_became_active":"2024-01-19T05:18:02.674331+0000","last_became_peered":"2024-01-19T05:18:02.674331+0000","last_unstale":"2024-01-19T05:18:04.730213+0000","last_undegraded":"2024-01-19T05:18:04.730213+0000","last_fullsized":"2024-01-19T05:18:04.730213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513263+0000","last_change":"2024-01-19T05:18:03.535625+0000","last_active":"2024-01-19T05:18:04.513263+0000","last_peered":"2024-01-19T05:18:04.513263+0000","last_clean":"2024-01-19T05:18:04.513263+0000","last_became_active":"2024-01-19T05:18:03.534935+0000","last_became_peered":"2024-01-19T05:18:03.534935+0000","last_unstale":"2024-01-19T05:18:04.513263+0000","last_undegraded":"2024-01-19T05:18:04.513263+0000","last_fullsized":"2024-01-19T05:18:04.513263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513329+0000","last_change":"2024-01-19T05:18:02.660485+0000","last_active":"2024-01-19T05:18:04.513329+0000","last_peered":"2024-01-19T05:18:04.513329+0000","last_clean":"2024-01-19T05:18:04.513329+0000","last_became_active":"2024-01-19T05:18:02.660172+0000","last_became_peered":"2024-01-19T05:18:02.660172+0000","last_unstale":"2024-01-19T05:18:04.513329+0000","last_undegraded":"2024-01-19T05:18:04.513329+0000","last_fullsized":"2024-01-19T05:18:04.513329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730089+0000","last_change":"2024-01-19T05:18:03.549395+0000","last_active":"2024-01-19T05:18:04.730089+0000","last_peered":"2024-01-19T05:18:04.730089+0000","last_clean":"2024-01-19T05:18:04.730089+0000","last_became_active":"2024-01-19T05:18:03.548645+0000","last_became_peered":"2024-01-19T05:18:03.548645+0000","last_unstale":"2024-01-19T05:18:04.730089+0000","last_undegraded":"2024-01-19T05:18:04.730089+0000","last_fullsized":"2024-01-19T05:18:04.730089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515120+0000","last_change":"2024-01-19T05:18:02.665544+0000","last_active":"2024-01-19T05:18:04.515120+0000","last_peered":"2024-01-19T05:18:04.515120+0000","last_clean":"2024-01-19T05:18:04.515120+0000","last_became_active":"2024-01-19T05:18:02.665011+0000","last_became_peered":"2024-01-19T05:18:02.665011+0000","last_unstale":"2024-01-19T05:18:04.515120+0000","last_undegraded":"2024-01-19T05:18:04.515120+0000","last_fullsized":"2024-01-19T05:18:04.515120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728406+0000","last_change":"2024-01-19T05:18:03.546972+0000","last_active":"2024-01-19T05:18:04.728406+0000","last_peered":"2024-01-19T05:18:04.728406+0000","last_clean":"2024-01-19T05:18:04.728406+0000","last_became_active":"2024-01-19T05:18:03.546258+0000","last_became_peered":"2024-01-19T05:18:03.546258+0000","last_unstale":"2024-01-19T05:18:04.728406+0000","last_undegraded":"2024-01-19T05:18:04.728406+0000","last_fullsized":"2024-01-19T05:18:04.728406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728783+0000","last_change":"2024-01-19T05:18:02.668468+0000","last_active":"2024-01-19T05:18:04.728783+0000","last_peered":"2024-01-19T05:18:04.728783+0000","last_clean":"2024-01-19T05:18:04.728783+0000","last_became_active":"2024-01-19T05:18:02.668005+0000","last_became_peered":"2024-01-19T05:18:02.668005+0000","last_unstale":"2024-01-19T05:18:04.728783+0000","last_undegraded":"2024-01-19T05:18:04.728783+0000","last_fullsized":"2024-01-19T05:18:04.728783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514090+0000","last_change":"2024-01-19T05:18:03.545257+0000","last_active":"2024-01-19T05:18:04.514090+0000","last_peered":"2024-01-19T05:18:04.514090+0000","last_clean":"2024-01-19T05:18:04.514090+0000","last_became_active":"2024-01-19T05:18:03.542709+0000","last_became_peered":"2024-01-19T05:18:03.542709+0000","last_unstale":"2024-01-19T05:18:04.514090+0000","last_undegraded":"2024-01-19T05:18:04.514090+0000","last_fullsized":"2024-01-19T05:18:04.514090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:31.698937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512995+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.512995+0000","last_peered":"2024-01-19T05:18:04.512995+0000","last_clean":"2024-01-19T05:18:04.512995+0000","last_became_active":"2024-01-19T05:18:02.664286+0000","last_became_peered":"2024-01-19T05:18:02.664286+0000","last_unstale":"2024-01-19T05:18:04.512995+0000","last_undegraded":"2024-01-19T05:18:04.512995+0000","last_fullsized":"2024-01-19T05:18:04.512995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729156+0000","last_change":"2024-01-19T05:18:03.554862+0000","last_active":"2024-01-19T05:18:04.729156+0000","last_peered":"2024-01-19T05:18:04.729156+0000","last_clean":"2024-01-19T05:18:04.729156+0000","last_became_active":"2024-01-19T05:18:03.550546+0000","last_became_peered":"2024-01-19T05:18:03.550546+0000","last_unstale":"2024-01-19T05:18:04.729156+0000","last_undegraded":"2024-01-19T05:18:04.729156+0000","last_fullsized":"2024-01-19T05:18:04.729156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513140+0000","last_change":"2024-01-19T05:18:02.663145+0000","last_active":"2024-01-19T05:18:04.513140+0000","last_peered":"2024-01-19T05:18:04.513140+0000","last_clean":"2024-01-19T05:18:04.513140+0000","last_became_active":"2024-01-19T05:18:02.662788+0000","last_became_peered":"2024-01-19T05:18:02.662788+0000","last_unstale":"2024-01-19T05:18:04.513140+0000","last_undegraded":"2024-01-19T05:18:04.513140+0000","last_fullsized":"2024-01-19T05:18:04.513140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729679+0000","last_change":"2024-01-19T05:18:03.551324+0000","last_active":"2024-01-19T05:18:04.729679+0000","last_peered":"2024-01-19T05:18:04.729679+0000","last_clean":"2024-01-19T05:18:04.729679+0000","last_became_active":"2024-01-19T05:18:03.549215+0000","last_became_peered":"2024-01-19T05:18:03.549215+0000","last_unstale":"2024-01-19T05:18:04.729679+0000","last_undegraded":"2024-01-19T05:18:04.729679+0000","last_fullsized":"2024-01-19T05:18:04.729679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730060+0000","last_change":"2024-01-19T05:18:02.670360+0000","last_active":"2024-01-19T05:18:04.730060+0000","last_peered":"2024-01-19T05:18:04.730060+0000","last_clean":"2024-01-19T05:18:04.730060+0000","last_became_active":"2024-01-19T05:18:02.669751+0000","last_became_peered":"2024-01-19T05:18:02.669751+0000","last_unstale":"2024-01-19T05:18:04.730060+0000","last_undegraded":"2024-01-19T05:18:04.730060+0000","last_fullsized":"2024-01-19T05:18:04.730060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513640+0000","last_change":"2024-01-19T05:18:03.531197+0000","last_active":"2024-01-19T05:18:04.513640+0000","last_peered":"2024-01-19T05:18:04.513640+0000","last_clean":"2024-01-19T05:18:04.513640+0000","last_became_active":"2024-01-19T05:18:03.530484+0000","last_became_peered":"2024-01-19T05:18:03.530484+0000","last_unstale":"2024-01-19T05:18:04.513640+0000","last_undegraded":"2024-01-19T05:18:04.513640+0000","last_fullsized":"2024-01-19T05:18:04.513640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731287+0000","last_change":"2024-01-19T05:18:03.562891+0000","last_active":"2024-01-19T05:18:04.731287+0000","last_peered":"2024-01-19T05:18:04.731287+0000","last_clean":"2024-01-19T05:18:04.731287+0000","last_became_active":"2024-01-19T05:18:03.558374+0000","last_became_peered":"2024-01-19T05:18:03.558374+0000","last_unstale":"2024-01-19T05:18:04.731287+0000","last_undegraded":"2024-01-19T05:18:04.731287+0000","last_fullsized":"2024-01-19T05:18:04.731287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729394+0000","last_change":"2024-01-19T05:18:02.672001+0000","last_active":"2024-01-19T05:18:04.729394+0000","last_peered":"2024-01-19T05:18:04.729394+0000","last_clean":"2024-01-19T05:18:04.729394+0000","last_became_active":"2024-01-19T05:18:02.671437+0000","last_became_peered":"2024-01-19T05:18:02.671437+0000","last_unstale":"2024-01-19T05:18:04.729394+0000","last_undegraded":"2024-01-19T05:18:04.729394+0000","last_fullsized":"2024-01-19T05:18:04.729394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731196+0000","last_change":"2024-01-19T05:18:03.565321+0000","last_active":"2024-01-19T05:18:04.731196+0000","last_peered":"2024-01-19T05:18:04.731196+0000","last_clean":"2024-01-19T05:18:04.731196+0000","last_became_active":"2024-01-19T05:18:03.563207+0000","last_became_peered":"2024-01-19T05:18:03.563207+0000","last_unstale":"2024-01-19T05:18:04.731196+0000","last_undegraded":"2024-01-19T05:18:04.731196+0000","last_fullsized":"2024-01-19T05:18:04.731196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729996+0000","last_change":"2024-01-19T05:18:02.673614+0000","last_active":"2024-01-19T05:18:04.729996+0000","last_peered":"2024-01-19T05:18:04.729996+0000","last_clean":"2024-01-19T05:18:04.729996+0000","last_became_active":"2024-01-19T05:18:02.673106+0000","last_became_peered":"2024-01-19T05:18:02.673106+0000","last_unstale":"2024-01-19T05:18:04.729996+0000","last_undegraded":"2024-01-19T05:18:04.729996+0000","last_fullsized":"2024-01-19T05:18:04.729996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728334+0000","last_change":"2024-01-19T05:18:03.570972+0000","last_active":"2024-01-19T05:18:04.728334+0000","last_peered":"2024-01-19T05:18:04.728334+0000","last_clean":"2024-01-19T05:18:04.728334+0000","last_became_active":"2024-01-19T05:18:03.570555+0000","last_became_peered":"2024-01-19T05:18:03.570555+0000","last_unstale":"2024-01-19T05:18:04.728334+0000","last_undegraded":"2024-01-19T05:18:04.728334+0000","last_fullsized":"2024-01-19T05:18:04.728334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:41.862758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729948+0000","last_change":"2024-01-19T05:18:02.661127+0000","last_active":"2024-01-19T05:18:04.729948+0000","last_peered":"2024-01-19T05:18:04.729948+0000","last_clean":"2024-01-19T05:18:04.729948+0000","last_became_active":"2024-01-19T05:18:02.660171+0000","last_became_peered":"2024-01-19T05:18:02.660171+0000","last_unstale":"2024-01-19T05:18:04.729948+0000","last_undegraded":"2024-01-19T05:18:04.729948+0000","last_fullsized":"2024-01-19T05:18:04.729948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729899+0000","last_change":"2024-01-19T05:18:03.546643+0000","last_active":"2024-01-19T05:18:04.729899+0000","last_peered":"2024-01-19T05:18:04.729899+0000","last_clean":"2024-01-19T05:18:04.729899+0000","last_became_active":"2024-01-19T05:18:03.545889+0000","last_became_peered":"2024-01-19T05:18:03.545889+0000","last_unstale":"2024-01-19T05:18:04.729899+0000","last_undegraded":"2024-01-19T05:18:04.729899+0000","last_fullsized":"2024-01-19T05:18:04.729899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728691+0000","last_change":"2024-01-19T05:18:02.666057+0000","last_active":"2024-01-19T05:18:04.728691+0000","last_peered":"2024-01-19T05:18:04.728691+0000","last_clean":"2024-01-19T05:18:04.728691+0000","last_became_active":"2024-01-19T05:18:02.665663+0000","last_became_peered":"2024-01-19T05:18:02.665663+0000","last_unstale":"2024-01-19T05:18:04.728691+0000","last_undegraded":"2024-01-19T05:18:04.728691+0000","last_fullsized":"2024-01-19T05:18:04.728691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7150000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:07.410 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-19T05:18:07.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603ef4d640 1 Processor -- start 2024-01-19T05:18:07.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603ef4d640 1 -- start start 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603ef4d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60380b19f0 0x7f603806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603ef4d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6038070680 con 0x7f6038144c70 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603ef4d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6038070410 con 0x7f60380724f0 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603ef4d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6038144790 con 0x7f60380b19f0 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603cce9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60380b19f0 0x7f603806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f6037fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6038144c70 0x7f6038071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42462/0 (socket says 172.21.15.99:42462) 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f6037fff640 1 -- 172.21.15.99:0/1038219496 learned_addr learned my addr 172.21.15.99:0/1038219496 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603cce9640 1 -- 172.21.15.99:0/1038219496 >> v1:172.21.15.157:6789/0 conn(0x7f60380724f0 legacy=0x7f603814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603cce9640 1 -- 172.21.15.99:0/1038219496 >> v1:172.21.15.99:6789/0 conn(0x7f6038144c70 legacy=0x7f6038071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f60377fe640 1 -- 172.21.15.99:0/1038219496 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169617074 0 0) 0x7f6038070680 con 0x7f6038144c70 2024-01-19T05:18:07.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.574+0000 7f603cce9640 1 -- 172.21.15.99:0/1038219496 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603806f2b0 con 0x7f60380b19f0 2024-01-19T05:18:07.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603cce9640 1 --2- 172.21.15.99:0/1038219496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603806ebe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6030009d90 tx=0x7f603001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2404f751f3ff1bf3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f60377fe640 1 -- 172.21.15.99:0/1038219496 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300a59a0 con 0x7f60380b19f0 2024-01-19T05:18:07.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f60377fe640 1 -- 172.21.15.99:0/1038219496 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60300a5b00 con 0x7f60380b19f0 2024-01-19T05:18:07.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f60377fe640 1 -- 172.21.15.99:0/1038219496 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300a5e90 con 0x7f60380b19f0 2024-01-19T05:18:07.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- 172.21.15.99:0/1038219496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 msgr2=0x7f603806ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 --2- 172.21.15.99:0/1038219496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603806ebe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6030009d90 tx=0x7f603001c8c0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- 172.21.15.99:0/1038219496 shutdown_connections 2024-01-19T05:18:07.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 --2- 172.21.15.99:0/1038219496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603806ebe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- 172.21.15.99:0/1038219496 >> 172.21.15.99:0/1038219496 conn(0x7f60380b8080 msgr2=0x7f60380b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:07.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- 172.21.15.99:0/1038219496 shutdown_connections 2024-01-19T05:18:07.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- 172.21.15.99:0/1038219496 wait complete. 2024-01-19T05:18:07.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 Processor -- start 2024-01-19T05:18:07.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- start start 2024-01-19T05:18:07.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60380724f0 0x7f60381defc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603813ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6038144c70 0x7f60380ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603813ef40 con 0x7f60380b19f0 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60381e25b0 con 0x7f60380724f0 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.578+0000 7f603ef4d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60380ae330 con 0x7f6038144c70 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603813ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603813ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55658/0 (socket says 172.21.15.99:55658) 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 -- 172.21.15.99:0/2685671143 learned_addr learned my addr 172.21.15.99:0/2685671143 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f603cce9640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60380724f0 0x7f60381defc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f603d4ea640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6038144c70 0x7f60380ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 -- 172.21.15.99:0/2685671143 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6038144c70 msgr2=0x7f60380ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6038144c70 0x7f60380ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 -- 172.21.15.99:0/2685671143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60380724f0 msgr2=0x7f60381defc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60380724f0 0x7f60381defc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 -- 172.21.15.99:0/2685671143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009a70 con 0x7f60380b19f0 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f6037fff640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603813ca80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f602000c410 tx=0x7f602000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f60357fa640 1 -- 172.21.15.99:0/2685671143 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020005cf0 con 0x7f60380b19f0 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f60357fa640 1 -- 172.21.15.99:0/2685671143 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6020005e50 con 0x7f60380b19f0 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60381e2800 con 0x7f60380b19f0 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f60357fa640 1 -- 172.21.15.99:0/2685671143 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020007310 con 0x7f60380b19f0 2024-01-19T05:18:07.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60381e2dc0 con 0x7f60380b19f0 2024-01-19T05:18:07.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60380696e0 con 0x7f60380b19f0 2024-01-19T05:18:07.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f60357fa640 1 -- 172.21.15.99:0/2685671143 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6020007470 con 0x7f60380b19f0 2024-01-19T05:18:07.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f60357fa640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6018066500 0x7f60180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f603cce9640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6018066500 0x7f60180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f60357fa640 1 -- 172.21.15.99:0/2685671143 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6020083460 con 0x7f60380b19f0 2024-01-19T05:18:07.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.582+0000 7f603cce9640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6018066500 0x7f60180689c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60300af000 tx=0x7f60300a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.586+0000 7f60357fa640 1 -- 172.21.15.99:0/2685671143 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6020050710 con 0x7f60380b19f0 2024-01-19T05:18:07.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.802+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6038139ce0 con 0x7f60380b19f0 2024-01-19T05:18:07.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f60357fa640 1 -- 172.21.15.99:0/2685671143 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1011 (secure 0 0 0) 0x7f6020053d30 con 0x7f60380b19f0 2024-01-19T05:18:07.806 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:{"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1705641469,"num_in_osds":8,"osd_in_since":1705641461,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":241254400,"bytes_avail":772852858880,"bytes_total":773094113280,"write_bytes_sec":2506,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4232}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-01-19T05:17:38.803665+0000","services":{}},"progress_events":{}} 2024-01-19T05:18:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6018066500 msgr2=0x7f60180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6018066500 0x7f60180689c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60300af000 tx=0x7f60300a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 msgr2=0x7f603813ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603813ca80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f602000c410 tx=0x7f602000c8d0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 shutdown_connections 2024-01-19T05:18:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6018066500 0x7f60180689c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6038144c70 0x7f60380ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60380b19f0 0x7f603813ca80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 --2- 172.21.15.99:0/2685671143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60380724f0 0x7f60381defc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 >> 172.21.15.99:0/2685671143 conn(0x7f60380b8080 msgr2=0x7f60380b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 shutdown_connections 2024-01-19T05:18:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.806+0000 7f603ef4d640 1 -- 172.21.15.99:0/2685671143 wait complete. 2024-01-19T05:18:07.824 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-19T05:18:07.825 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:07.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.942+0000 7ff19efdc640 1 Processor -- start 2024-01-19T05:18:07.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.942+0000 7ff19efdc640 1 -- start start 2024-01-19T05:18:07.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19efdc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1980725b0 0x7ff198146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19efdc640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980ae1a0 con 0x7ff1980acad0 2024-01-19T05:18:07.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19efdc640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980aceb0 con 0x7ff1981473f0 2024-01-19T05:18:07.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19efdc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff198141020 con 0x7ff1980725b0 2024-01-19T05:18:07.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19cd78640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff1980acad0 0x7ff1980b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42474/0 (socket says 172.21.15.99:42474) 2024-01-19T05:18:07.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19cd78640 1 -- 172.21.15.99:0/3941621758 learned_addr learned my addr 172.21.15.99:0/3941621758 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982440477 0 0) 0x7ff1980ae1a0 con 0x7ff1980acad0 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff180003530 con 0x7ff1980acad0 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff197fff640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1980725b0 0x7ff198146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622301733 0 0) 0x7ff180003530 con 0x7ff1980acad0 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1980725b0 msgr2=0x7ff198146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1980725b0 0x7ff198146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 >> v1:172.21.15.157:6789/0 conn(0x7ff1981473f0 legacy=0x7ff198151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980aefc0 con 0x7ff1980acad0 2024-01-19T05:18:07.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7ff188001680 con 0x7ff1980acad0 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 >> v1:172.21.15.99:6789/0 conn(0x7ff1980acad0 legacy=0x7ff1980b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1800039b0 0x7ff180003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800047d0 0x7ff180004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff180005150 0x7ff18000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198141020 con 0x7ff1800039b0 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18000bed0 con 0x7ff180005150 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18000c010 con 0x7ff1800047d0 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19cd78640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1800039b0 0x7ff180003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff197fff640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800047d0 0x7ff180004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19cd78640 1 -- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800047d0 msgr2=0x7ff180004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19cd78640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800047d0 0x7ff180004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19cd78640 1 -- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff180005150 msgr2=0x7ff18000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19cd78640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff180005150 0x7ff18000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.946+0000 7ff19cd78640 1 -- 172.21.15.99:0/3941621758 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff180003530 con 0x7ff1800039b0 2024-01-19T05:18:07.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19cd78640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1800039b0 0x7ff180003dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff188001060 tx=0x7ff18801cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65aea89444c22753 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880058e0 con 0x7ff1800039b0 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff188005a40 con 0x7ff1800039b0 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff1977fe640 1 -- 172.21.15.99:0/3941621758 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188005e30 con 0x7ff1800039b0 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- 172.21.15.99:0/3941621758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1800039b0 msgr2=0x7ff180003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 --2- 172.21.15.99:0/3941621758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1800039b0 0x7ff180003dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff188001060 tx=0x7ff18801cb70 comp rx=0 tx=0).stop 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19d579640 1 -- 172.21.15.99:0/3941621758 reap_dead start 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- 172.21.15.99:0/3941621758 shutdown_connections 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- 172.21.15.99:0/3941621758 >> 172.21.15.99:0/3941621758 conn(0x7ff1980b8080 msgr2=0x7ff1980b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- 172.21.15.99:0/3941621758 shutdown_connections 2024-01-19T05:18:07.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- 172.21.15.99:0/3941621758 wait complete. 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 Processor -- start 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- start start 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800039b0 0x7ff1980b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff198142000 0x7ff1981e2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1980af8f0 0x7ff1980afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980b0f00 con 0x7ff198142000 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980b0c90 con 0x7ff1980af8f0 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1981424e0 con 0x7ff1800039b0 2024-01-19T05:18:07.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff198142000 0x7ff1981e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff198142000 0x7ff1981e2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55670/0 (socket says 172.21.15.99:55670) 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 -- 172.21.15.99:0/2438051145 learned_addr learned my addr 172.21.15.99:0/2438051145 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19cd78640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800039b0 0x7ff1980b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19d579640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1980af8f0 0x7ff1980afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 -- 172.21.15.99:0/2438051145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800039b0 msgr2=0x7ff1980b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800039b0 0x7ff1980b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 -- 172.21.15.99:0/2438051145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1980af8f0 msgr2=0x7ff1980afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1980af8f0 0x7ff1980afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 -- 172.21.15.99:0/2438051145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19813dde0 con 0x7ff198142000 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff197fff640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff198142000 0x7ff1981e2160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0108c0 tx=0x7ff18c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff1957fa640 1 -- 172.21.15.99:0/2438051145 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c009630 con 0x7ff198142000 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff1957fa640 1 -- 172.21.15.99:0/2438051145 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c00eb60 con 0x7ff198142000 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19813d060 con 0x7ff198142000 2024-01-19T05:18:07.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff1957fa640 1 -- 172.21.15.99:0/2438051145 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c01c400 con 0x7ff198142000 2024-01-19T05:18:07.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.950+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19814cdc0 con 0x7ff198142000 2024-01-19T05:18:07.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.954+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1980696e0 con 0x7ff198142000 2024-01-19T05:18:07.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.954+0000 7ff1957fa640 1 -- 172.21.15.99:0/2438051145 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff18c01c560 con 0x7ff198142000 2024-01-19T05:18:07.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.954+0000 7ff1957fa640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff184066500 0x7ff1840689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:07.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.954+0000 7ff19cd78640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff184066500 0x7ff1840689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:07.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.954+0000 7ff1957fa640 1 -- 172.21.15.99:0/2438051145 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff18c084350 con 0x7ff198142000 2024-01-19T05:18:07.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.954+0000 7ff19cd78640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff184066500 0x7ff1840689c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1880aa000 tx=0x7ff188001a10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:07.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:07.958+0000 7ff1957fa640 1 -- 172.21.15.99:0/2438051145 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff18c051730 con 0x7ff198142000 2024-01-19T05:18:08.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.110+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff198145c00 con 0x7ff184066500 2024-01-19T05:18:08.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.114+0000 7ff1957fa640 1 -- 172.21.15.99:0/2438051145 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264560 (secure 0 0 0) 0x7ff198145c00 con 0x7ff184066500 2024-01-19T05:18:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:08.122 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.118+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff184066500 msgr2=0x7ff1840689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.118+0000 7ff19efdc640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff184066500 0x7ff1840689c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1880aa000 tx=0x7ff188001a10 comp rx=0 tx=0).stop 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff198142000 msgr2=0x7ff1981e2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff198142000 0x7ff1981e2160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0108c0 tx=0x7ff18c010d80 comp rx=0 tx=0).stop 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 shutdown_connections 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff184066500 0x7ff1840689c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1980af8f0 0x7ff1980afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff198142000 0x7ff1981e2160 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 --2- 172.21.15.99:0/2438051145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff1800039b0 0x7ff1980b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 >> 172.21.15.99:0/2438051145 conn(0x7ff1980b8080 msgr2=0x7ff198146050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 shutdown_connections 2024-01-19T05:18:08.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:08.122+0000 7ff19efdc640 1 -- 172.21.15.99:0/2438051145 wait complete. 2024-01-19T05:18:08.136 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-19T05:18:07.344811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235600,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739120,"statfs":{"total":773094113280,"available":772852858880,"internally_reserved":0,"allocated":2842624,"data_stored":1727636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.718706"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729517+0000","last_change":"2024-01-19T05:18:03.537400+0000","last_active":"2024-01-19T05:18:04.729517+0000","last_peered":"2024-01-19T05:18:04.729517+0000","last_clean":"2024-01-19T05:18:04.729517+0000","last_became_active":"2024-01-19T05:18:03.536533+0000","last_became_peered":"2024-01-19T05:18:03.536533+0000","last_unstale":"2024-01-19T05:18:04.729517+0000","last_undegraded":"2024-01-19T05:18:04.729517+0000","last_fullsized":"2024-01-19T05:18:04.729517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513273+0000","last_change":"2024-01-19T05:18:03.538419+0000","last_active":"2024-01-19T05:18:04.513273+0000","last_peered":"2024-01-19T05:18:04.513273+0000","last_clean":"2024-01-19T05:18:04.513273+0000","last_became_active":"2024-01-19T05:18:03.537715+0000","last_became_peered":"2024-01-19T05:18:03.537715+0000","last_unstale":"2024-01-19T05:18:04.513273+0000","last_undegraded":"2024-01-19T05:18:04.513273+0000","last_fullsized":"2024-01-19T05:18:04.513273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728283+0000","last_change":"2024-01-19T05:18:03.554921+0000","last_active":"2024-01-19T05:18:04.728283+0000","last_peered":"2024-01-19T05:18:04.728283+0000","last_clean":"2024-01-19T05:18:04.728283+0000","last_became_active":"2024-01-19T05:18:03.554270+0000","last_became_peered":"2024-01-19T05:18:03.554270+0000","last_unstale":"2024-01-19T05:18:04.728283+0000","last_undegraded":"2024-01-19T05:18:04.728283+0000","last_fullsized":"2024-01-19T05:18:04.728283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:13.087104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730979+0000","last_change":"2024-01-19T05:18:03.566913+0000","last_active":"2024-01-19T05:18:04.730979+0000","last_peered":"2024-01-19T05:18:04.730979+0000","last_clean":"2024-01-19T05:18:04.730979+0000","last_became_active":"2024-01-19T05:18:03.566063+0000","last_became_peered":"2024-01-19T05:18:03.566063+0000","last_unstale":"2024-01-19T05:18:04.730979+0000","last_undegraded":"2024-01-19T05:18:04.730979+0000","last_fullsized":"2024-01-19T05:18:04.730979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.554926+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.554035+0000","last_became_peered":"2024-01-19T05:18:03.554035+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730556+0000","last_change":"2024-01-19T05:18:03.563300+0000","last_active":"2024-01-19T05:18:04.730556+0000","last_peered":"2024-01-19T05:18:04.730556+0000","last_clean":"2024-01-19T05:18:04.730556+0000","last_became_active":"2024-01-19T05:18:03.562655+0000","last_became_peered":"2024-01-19T05:18:03.562655+0000","last_unstale":"2024-01-19T05:18:04.730556+0000","last_undegraded":"2024-01-19T05:18:04.730556+0000","last_fullsized":"2024-01-19T05:18:04.730556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729148+0000","last_change":"2024-01-19T05:18:03.535107+0000","last_active":"2024-01-19T05:18:04.729148+0000","last_peered":"2024-01-19T05:18:04.729148+0000","last_clean":"2024-01-19T05:18:04.729148+0000","last_became_active":"2024-01-19T05:18:03.534338+0000","last_became_peered":"2024-01-19T05:18:03.534338+0000","last_unstale":"2024-01-19T05:18:04.729148+0000","last_undegraded":"2024-01-19T05:18:04.729148+0000","last_fullsized":"2024-01-19T05:18:04.729148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728969+0000","last_change":"2024-01-19T05:18:03.567466+0000","last_active":"2024-01-19T05:18:04.728969+0000","last_peered":"2024-01-19T05:18:04.728969+0000","last_clean":"2024-01-19T05:18:04.728969+0000","last_became_active":"2024-01-19T05:18:03.566828+0000","last_became_peered":"2024-01-19T05:18:03.566828+0000","last_unstale":"2024-01-19T05:18:04.728969+0000","last_undegraded":"2024-01-19T05:18:04.728969+0000","last_fullsized":"2024-01-19T05:18:04.728969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.573607+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.573072+0000","last_became_peered":"2024-01-19T05:18:03.573072+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515175+0000","last_change":"2024-01-19T05:18:03.560176+0000","last_active":"2024-01-19T05:18:04.515175+0000","last_peered":"2024-01-19T05:18:04.515175+0000","last_clean":"2024-01-19T05:18:04.515175+0000","last_became_active":"2024-01-19T05:18:03.559432+0000","last_became_peered":"2024-01-19T05:18:03.559432+0000","last_unstale":"2024-01-19T05:18:04.515175+0000","last_undegraded":"2024-01-19T05:18:04.515175+0000","last_fullsized":"2024-01-19T05:18:04.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515576+0000","last_change":"2024-01-19T05:18:03.570077+0000","last_active":"2024-01-19T05:18:04.515576+0000","last_peered":"2024-01-19T05:18:04.515576+0000","last_clean":"2024-01-19T05:18:04.515576+0000","last_became_active":"2024-01-19T05:18:03.569528+0000","last_became_peered":"2024-01-19T05:18:03.569528+0000","last_unstale":"2024-01-19T05:18:04.515576+0000","last_undegraded":"2024-01-19T05:18:04.515576+0000","last_fullsized":"2024-01-19T05:18:04.515576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516108+0000","last_change":"2024-01-19T05:18:03.538635+0000","last_active":"2024-01-19T05:18:04.516108+0000","last_peered":"2024-01-19T05:18:04.516108+0000","last_clean":"2024-01-19T05:18:04.516108+0000","last_became_active":"2024-01-19T05:18:03.537778+0000","last_became_peered":"2024-01-19T05:18:03.537778+0000","last_unstale":"2024-01-19T05:18:04.516108+0000","last_undegraded":"2024-01-19T05:18:04.516108+0000","last_fullsized":"2024-01-19T05:18:04.516108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729656+0000","last_change":"2024-01-19T05:18:03.542188+0000","last_active":"2024-01-19T05:18:04.729656+0000","last_peered":"2024-01-19T05:18:04.729656+0000","last_clean":"2024-01-19T05:18:04.729656+0000","last_became_active":"2024-01-19T05:18:03.541504+0000","last_became_peered":"2024-01-19T05:18:03.541504+0000","last_unstale":"2024-01-19T05:18:04.729656+0000","last_undegraded":"2024-01-19T05:18:04.729656+0000","last_fullsized":"2024-01-19T05:18:04.729656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728750+0000","last_change":"2024-01-19T05:18:03.547095+0000","last_active":"2024-01-19T05:18:04.728750+0000","last_peered":"2024-01-19T05:18:04.728750+0000","last_clean":"2024-01-19T05:18:04.728750+0000","last_became_active":"2024-01-19T05:18:03.546466+0000","last_became_peered":"2024-01-19T05:18:03.546466+0000","last_unstale":"2024-01-19T05:18:04.728750+0000","last_undegraded":"2024-01-19T05:18:04.728750+0000","last_fullsized":"2024-01-19T05:18:04.728750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512907+0000","last_change":"2024-01-19T05:18:03.540449+0000","last_active":"2024-01-19T05:18:04.512907+0000","last_peered":"2024-01-19T05:18:04.512907+0000","last_clean":"2024-01-19T05:18:04.512907+0000","last_became_active":"2024-01-19T05:18:03.539616+0000","last_became_peered":"2024-01-19T05:18:03.539616+0000","last_unstale":"2024-01-19T05:18:04.512907+0000","last_undegraded":"2024-01-19T05:18:04.512907+0000","last_fullsized":"2024-01-19T05:18:04.512907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728960+0000","last_change":"2024-01-19T05:18:03.568406+0000","last_active":"2024-01-19T05:18:04.728960+0000","last_peered":"2024-01-19T05:18:04.728960+0000","last_clean":"2024-01-19T05:18:04.728960+0000","last_became_active":"2024-01-19T05:18:03.567759+0000","last_became_peered":"2024-01-19T05:18:03.567759+0000","last_unstale":"2024-01-19T05:18:04.728960+0000","last_undegraded":"2024-01-19T05:18:04.728960+0000","last_fullsized":"2024-01-19T05:18:04.728960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731803+0000","last_change":"2024-01-19T05:18:03.571085+0000","last_active":"2024-01-19T05:18:04.731803+0000","last_peered":"2024-01-19T05:18:04.731803+0000","last_clean":"2024-01-19T05:18:04.731803+0000","last_became_active":"2024-01-19T05:18:03.569878+0000","last_became_peered":"2024-01-19T05:18:03.569878+0000","last_unstale":"2024-01-19T05:18:04.731803+0000","last_undegraded":"2024-01-19T05:18:04.731803+0000","last_fullsized":"2024-01-19T05:18:04.731803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728098+0000","last_change":"2024-01-19T05:18:03.520269+0000","last_active":"2024-01-19T05:18:04.728098+0000","last_peered":"2024-01-19T05:18:04.728098+0000","last_clean":"2024-01-19T05:18:04.728098+0000","last_became_active":"2024-01-19T05:18:03.519676+0000","last_became_peered":"2024-01-19T05:18:03.519676+0000","last_unstale":"2024-01-19T05:18:04.728098+0000","last_undegraded":"2024-01-19T05:18:04.728098+0000","last_fullsized":"2024-01-19T05:18:04.728098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730254+0000","last_change":"2024-01-19T05:18:03.555567+0000","last_active":"2024-01-19T05:18:04.730254+0000","last_peered":"2024-01-19T05:18:04.730254+0000","last_clean":"2024-01-19T05:18:04.730254+0000","last_became_active":"2024-01-19T05:18:03.554832+0000","last_became_peered":"2024-01-19T05:18:03.554832+0000","last_unstale":"2024-01-19T05:18:04.730254+0000","last_undegraded":"2024-01-19T05:18:04.730254+0000","last_fullsized":"2024-01-19T05:18:04.730254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514744+0000","last_change":"2024-01-19T05:18:03.545771+0000","last_active":"2024-01-19T05:18:04.514744+0000","last_peered":"2024-01-19T05:18:04.514744+0000","last_clean":"2024-01-19T05:18:04.514744+0000","last_became_active":"2024-01-19T05:18:03.545003+0000","last_became_peered":"2024-01-19T05:18:03.545003+0000","last_unstale":"2024-01-19T05:18:04.514744+0000","last_undegraded":"2024-01-19T05:18:04.514744+0000","last_fullsized":"2024-01-19T05:18:04.514744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728346+0000","last_change":"2024-01-19T05:18:03.551774+0000","last_active":"2024-01-19T05:18:04.728346+0000","last_peered":"2024-01-19T05:18:04.728346+0000","last_clean":"2024-01-19T05:18:04.728346+0000","last_became_active":"2024-01-19T05:18:03.550788+0000","last_became_peered":"2024-01-19T05:18:03.550788+0000","last_unstale":"2024-01-19T05:18:04.728346+0000","last_undegraded":"2024-01-19T05:18:04.728346+0000","last_fullsized":"2024-01-19T05:18:04.728346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731558+0000","last_change":"2024-01-19T05:18:03.568310+0000","last_active":"2024-01-19T05:18:04.731558+0000","last_peered":"2024-01-19T05:18:04.731558+0000","last_clean":"2024-01-19T05:18:04.731558+0000","last_became_active":"2024-01-19T05:18:03.567678+0000","last_became_peered":"2024-01-19T05:18:03.567678+0000","last_unstale":"2024-01-19T05:18:04.731558+0000","last_undegraded":"2024-01-19T05:18:04.731558+0000","last_fullsized":"2024-01-19T05:18:04.731558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729157+0000","last_change":"2024-01-19T05:18:03.554839+0000","last_active":"2024-01-19T05:18:04.729157+0000","last_peered":"2024-01-19T05:18:04.729157+0000","last_clean":"2024-01-19T05:18:04.729157+0000","last_became_active":"2024-01-19T05:18:03.551361+0000","last_became_peered":"2024-01-19T05:18:03.551361+0000","last_unstale":"2024-01-19T05:18:04.729157+0000","last_undegraded":"2024-01-19T05:18:04.729157+0000","last_fullsized":"2024-01-19T05:18:04.729157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729155+0000","last_change":"2024-01-19T05:18:03.563289+0000","last_active":"2024-01-19T05:18:04.729155+0000","last_peered":"2024-01-19T05:18:04.729155+0000","last_clean":"2024-01-19T05:18:04.729155+0000","last_became_active":"2024-01-19T05:18:03.556561+0000","last_became_peered":"2024-01-19T05:18:03.556561+0000","last_unstale":"2024-01-19T05:18:04.729155+0000","last_undegraded":"2024-01-19T05:18:04.729155+0000","last_fullsized":"2024-01-19T05:18:04.729155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730025+0000","last_change":"2024-01-19T05:18:03.546978+0000","last_active":"2024-01-19T05:18:04.730025+0000","last_peered":"2024-01-19T05:18:04.730025+0000","last_clean":"2024-01-19T05:18:04.730025+0000","last_became_active":"2024-01-19T05:18:03.546276+0000","last_became_peered":"2024-01-19T05:18:03.546276+0000","last_unstale":"2024-01-19T05:18:04.730025+0000","last_undegraded":"2024-01-19T05:18:04.730025+0000","last_fullsized":"2024-01-19T05:18:04.730025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515447+0000","last_change":"2024-01-19T05:18:03.525138+0000","last_active":"2024-01-19T05:18:04.515447+0000","last_peered":"2024-01-19T05:18:04.515447+0000","last_clean":"2024-01-19T05:18:04.515447+0000","last_became_active":"2024-01-19T05:18:03.524523+0000","last_became_peered":"2024-01-19T05:18:03.524523+0000","last_unstale":"2024-01-19T05:18:04.515447+0000","last_undegraded":"2024-01-19T05:18:04.515447+0000","last_fullsized":"2024-01-19T05:18:04.515447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512997+0000","last_change":"2024-01-19T05:18:03.544359+0000","last_active":"2024-01-19T05:18:04.512997+0000","last_peered":"2024-01-19T05:18:04.512997+0000","last_clean":"2024-01-19T05:18:04.512997+0000","last_became_active":"2024-01-19T05:18:03.543559+0000","last_became_peered":"2024-01-19T05:18:03.543559+0000","last_unstale":"2024-01-19T05:18:04.512997+0000","last_undegraded":"2024-01-19T05:18:04.512997+0000","last_fullsized":"2024-01-19T05:18:04.512997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729855+0000","last_change":"2024-01-19T05:18:03.549033+0000","last_active":"2024-01-19T05:18:04.729855+0000","last_peered":"2024-01-19T05:18:04.729855+0000","last_clean":"2024-01-19T05:18:04.729855+0000","last_became_active":"2024-01-19T05:18:03.548292+0000","last_became_peered":"2024-01-19T05:18:03.548292+0000","last_unstale":"2024-01-19T05:18:04.729855+0000","last_undegraded":"2024-01-19T05:18:04.729855+0000","last_fullsized":"2024-01-19T05:18:04.729855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728511+0000","last_change":"2024-01-19T05:18:03.557894+0000","last_active":"2024-01-19T05:18:04.728511+0000","last_peered":"2024-01-19T05:18:04.728511+0000","last_clean":"2024-01-19T05:18:04.728511+0000","last_became_active":"2024-01-19T05:18:03.556934+0000","last_became_peered":"2024-01-19T05:18:03.556934+0000","last_unstale":"2024-01-19T05:18:04.728511+0000","last_undegraded":"2024-01-19T05:18:04.728511+0000","last_fullsized":"2024-01-19T05:18:04.728511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730933+0000","last_change":"2024-01-19T05:18:03.557384+0000","last_active":"2024-01-19T05:18:04.730933+0000","last_peered":"2024-01-19T05:18:04.730933+0000","last_clean":"2024-01-19T05:18:04.730933+0000","last_became_active":"2024-01-19T05:18:03.555960+0000","last_became_peered":"2024-01-19T05:18:03.555960+0000","last_unstale":"2024-01-19T05:18:04.730933+0000","last_undegraded":"2024-01-19T05:18:04.730933+0000","last_fullsized":"2024-01-19T05:18:04.730933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727845+0000","last_change":"2024-01-19T05:18:03.560129+0000","last_active":"2024-01-19T05:18:04.727845+0000","last_peered":"2024-01-19T05:18:04.727845+0000","last_clean":"2024-01-19T05:18:04.727845+0000","last_became_active":"2024-01-19T05:18:03.559502+0000","last_became_peered":"2024-01-19T05:18:03.559502+0000","last_unstale":"2024-01-19T05:18:04.727845+0000","last_undegraded":"2024-01-19T05:18:04.727845+0000","last_fullsized":"2024-01-19T05:18:04.727845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513499+0000","last_change":"2024-01-19T05:18:03.537557+0000","last_active":"2024-01-19T05:18:04.513499+0000","last_peered":"2024-01-19T05:18:04.513499+0000","last_clean":"2024-01-19T05:18:04.513499+0000","last_became_active":"2024-01-19T05:18:03.536744+0000","last_became_peered":"2024-01-19T05:18:03.536744+0000","last_unstale":"2024-01-19T05:18:04.513499+0000","last_undegraded":"2024-01-19T05:18:04.513499+0000","last_fullsized":"2024-01-19T05:18:04.513499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514550+0000","last_change":"2024-01-19T05:18:03.537254+0000","last_active":"2024-01-19T05:18:04.514550+0000","last_peered":"2024-01-19T05:18:04.514550+0000","last_clean":"2024-01-19T05:18:04.514550+0000","last_became_active":"2024-01-19T05:18:03.536484+0000","last_became_peered":"2024-01-19T05:18:03.536484+0000","last_unstale":"2024-01-19T05:18:04.514550+0000","last_undegraded":"2024-01-19T05:18:04.514550+0000","last_fullsized":"2024-01-19T05:18:04.514550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:40.310261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729759+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.729759+0000","last_peered":"2024-01-19T05:18:04.729759+0000","last_clean":"2024-01-19T05:18:04.729759+0000","last_became_active":"2024-01-19T05:18:02.664263+0000","last_became_peered":"2024-01-19T05:18:02.664263+0000","last_unstale":"2024-01-19T05:18:04.729759+0000","last_undegraded":"2024-01-19T05:18:04.729759+0000","last_fullsized":"2024-01-19T05:18:04.729759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728651+0000","last_change":"2024-01-19T05:18:03.544005+0000","last_active":"2024-01-19T05:18:04.728651+0000","last_peered":"2024-01-19T05:18:04.728651+0000","last_clean":"2024-01-19T05:18:04.728651+0000","last_became_active":"2024-01-19T05:18:03.543213+0000","last_became_peered":"2024-01-19T05:18:03.543213+0000","last_unstale":"2024-01-19T05:18:04.728651+0000","last_undegraded":"2024-01-19T05:18:04.728651+0000","last_fullsized":"2024-01-19T05:18:04.728651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515401+0000","last_change":"2024-01-19T05:18:02.657382+0000","last_active":"2024-01-19T05:18:04.515401+0000","last_peered":"2024-01-19T05:18:04.515401+0000","last_clean":"2024-01-19T05:18:04.515401+0000","last_became_active":"2024-01-19T05:18:02.656806+0000","last_became_peered":"2024-01-19T05:18:02.656806+0000","last_unstale":"2024-01-19T05:18:04.515401+0000","last_undegraded":"2024-01-19T05:18:04.515401+0000","last_fullsized":"2024-01-19T05:18:04.515401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729079+0000","last_change":"2024-01-19T05:18:02.653215+0000","last_active":"2024-01-19T05:18:04.729079+0000","last_peered":"2024-01-19T05:18:04.729079+0000","last_clean":"2024-01-19T05:18:04.729079+0000","last_became_active":"2024-01-19T05:18:02.652938+0000","last_became_peered":"2024-01-19T05:18:02.652938+0000","last_unstale":"2024-01-19T05:18:04.729079+0000","last_undegraded":"2024-01-19T05:18:04.729079+0000","last_fullsized":"2024-01-19T05:18:04.729079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729005+0000","last_change":"2024-01-19T05:18:03.541881+0000","last_active":"2024-01-19T05:18:04.729005+0000","last_peered":"2024-01-19T05:18:04.729005+0000","last_clean":"2024-01-19T05:18:04.729005+0000","last_became_active":"2024-01-19T05:18:03.541176+0000","last_became_peered":"2024-01-19T05:18:03.541176+0000","last_unstale":"2024-01-19T05:18:04.729005+0000","last_undegraded":"2024-01-19T05:18:04.729005+0000","last_fullsized":"2024-01-19T05:18:04.729005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730990+0000","last_change":"2024-01-19T05:18:02.657034+0000","last_active":"2024-01-19T05:18:04.730990+0000","last_peered":"2024-01-19T05:18:04.730990+0000","last_clean":"2024-01-19T05:18:04.730990+0000","last_became_active":"2024-01-19T05:18:02.656500+0000","last_became_peered":"2024-01-19T05:18:02.656500+0000","last_unstale":"2024-01-19T05:18:04.730990+0000","last_undegraded":"2024-01-19T05:18:04.730990+0000","last_fullsized":"2024-01-19T05:18:04.730990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512764+0000","last_change":"2024-01-19T05:18:03.544242+0000","last_active":"2024-01-19T05:18:04.512764+0000","last_peered":"2024-01-19T05:18:04.512764+0000","last_clean":"2024-01-19T05:18:04.512764+0000","last_became_active":"2024-01-19T05:18:03.543438+0000","last_became_peered":"2024-01-19T05:18:03.543438+0000","last_unstale":"2024-01-19T05:18:04.512764+0000","last_undegraded":"2024-01-19T05:18:04.512764+0000","last_fullsized":"2024-01-19T05:18:04.512764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515016+0000","last_change":"2024-01-19T05:18:02.653594+0000","last_active":"2024-01-19T05:18:04.515016+0000","last_peered":"2024-01-19T05:18:04.515016+0000","last_clean":"2024-01-19T05:18:04.515016+0000","last_became_active":"2024-01-19T05:18:02.653182+0000","last_became_peered":"2024-01-19T05:18:02.653182+0000","last_unstale":"2024-01-19T05:18:04.515016+0000","last_undegraded":"2024-01-19T05:18:04.515016+0000","last_fullsized":"2024-01-19T05:18:04.515016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730837+0000","last_change":"2024-01-19T05:18:03.562845+0000","last_active":"2024-01-19T05:18:04.730837+0000","last_peered":"2024-01-19T05:18:04.730837+0000","last_clean":"2024-01-19T05:18:04.730837+0000","last_became_active":"2024-01-19T05:18:03.562235+0000","last_became_peered":"2024-01-19T05:18:03.562235+0000","last_unstale":"2024-01-19T05:18:04.730837+0000","last_undegraded":"2024-01-19T05:18:04.730837+0000","last_fullsized":"2024-01-19T05:18:04.730837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731055+0000","last_change":"2024-01-19T05:18:02.660025+0000","last_active":"2024-01-19T05:18:04.731055+0000","last_peered":"2024-01-19T05:18:04.731055+0000","last_clean":"2024-01-19T05:18:04.731055+0000","last_became_active":"2024-01-19T05:18:02.659546+0000","last_became_peered":"2024-01-19T05:18:02.659546+0000","last_unstale":"2024-01-19T05:18:04.731055+0000","last_undegraded":"2024-01-19T05:18:04.731055+0000","last_fullsized":"2024-01-19T05:18:04.731055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:56.624468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728512+0000","last_change":"2024-01-19T05:18:03.568936+0000","last_active":"2024-01-19T05:18:04.728512+0000","last_peered":"2024-01-19T05:18:04.728512+0000","last_clean":"2024-01-19T05:18:04.728512+0000","last_became_active":"2024-01-19T05:18:03.568337+0000","last_became_peered":"2024-01-19T05:18:03.568337+0000","last_unstale":"2024-01-19T05:18:04.728512+0000","last_undegraded":"2024-01-19T05:18:04.728512+0000","last_fullsized":"2024-01-19T05:18:04.728512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513376+0000","last_change":"2024-01-19T05:18:02.661567+0000","last_active":"2024-01-19T05:18:04.513376+0000","last_peered":"2024-01-19T05:18:04.513376+0000","last_clean":"2024-01-19T05:18:04.513376+0000","last_became_active":"2024-01-19T05:18:02.660906+0000","last_became_peered":"2024-01-19T05:18:02.660906+0000","last_unstale":"2024-01-19T05:18:04.513376+0000","last_undegraded":"2024-01-19T05:18:04.513376+0000","last_fullsized":"2024-01-19T05:18:04.513376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516234+0000","last_change":"2024-01-19T05:18:03.548080+0000","last_active":"2024-01-19T05:18:04.516234+0000","last_peered":"2024-01-19T05:18:04.516234+0000","last_clean":"2024-01-19T05:18:04.516234+0000","last_became_active":"2024-01-19T05:18:03.547506+0000","last_became_peered":"2024-01-19T05:18:03.547506+0000","last_unstale":"2024-01-19T05:18:04.516234+0000","last_undegraded":"2024-01-19T05:18:04.516234+0000","last_fullsized":"2024-01-19T05:18:04.516234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514989+0000","last_change":"2024-01-19T05:18:02.660672+0000","last_active":"2024-01-19T05:18:04.514989+0000","last_peered":"2024-01-19T05:18:04.514989+0000","last_clean":"2024-01-19T05:18:04.514989+0000","last_became_active":"2024-01-19T05:18:02.659596+0000","last_became_peered":"2024-01-19T05:18:02.659596+0000","last_unstale":"2024-01-19T05:18:04.514989+0000","last_undegraded":"2024-01-19T05:18:04.514989+0000","last_fullsized":"2024-01-19T05:18:04.514989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729720+0000","last_change":"2024-01-19T05:18:03.550622+0000","last_active":"2024-01-19T05:18:04.729720+0000","last_peered":"2024-01-19T05:18:04.729720+0000","last_clean":"2024-01-19T05:18:04.729720+0000","last_became_active":"2024-01-19T05:18:03.548243+0000","last_became_peered":"2024-01-19T05:18:03.548243+0000","last_unstale":"2024-01-19T05:18:04.729720+0000","last_undegraded":"2024-01-19T05:18:04.729720+0000","last_fullsized":"2024-01-19T05:18:04.729720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728733+0000","last_change":"2024-01-19T05:18:02.653694+0000","last_active":"2024-01-19T05:18:04.728733+0000","last_peered":"2024-01-19T05:18:04.728733+0000","last_clean":"2024-01-19T05:18:04.728733+0000","last_became_active":"2024-01-19T05:18:02.653236+0000","last_became_peered":"2024-01-19T05:18:02.653236+0000","last_unstale":"2024-01-19T05:18:04.728733+0000","last_undegraded":"2024-01-19T05:18:04.728733+0000","last_fullsized":"2024-01-19T05:18:04.728733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728870+0000","last_change":"2024-01-19T05:18:03.541272+0000","last_active":"2024-01-19T05:18:04.728870+0000","last_peered":"2024-01-19T05:18:04.728870+0000","last_clean":"2024-01-19T05:18:04.728870+0000","last_became_active":"2024-01-19T05:18:03.540187+0000","last_became_peered":"2024-01-19T05:18:03.540187+0000","last_unstale":"2024-01-19T05:18:04.728870+0000","last_undegraded":"2024-01-19T05:18:04.728870+0000","last_fullsized":"2024-01-19T05:18:04.728870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731175+0000","last_change":"2024-01-19T05:18:02.662629+0000","last_active":"2024-01-19T05:18:04.731175+0000","last_peered":"2024-01-19T05:18:04.731175+0000","last_clean":"2024-01-19T05:18:04.731175+0000","last_became_active":"2024-01-19T05:18:02.662095+0000","last_became_peered":"2024-01-19T05:18:02.662095+0000","last_unstale":"2024-01-19T05:18:04.731175+0000","last_undegraded":"2024-01-19T05:18:04.731175+0000","last_fullsized":"2024-01-19T05:18:04.731175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:03.589258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729878+0000","last_change":"2024-01-19T05:18:03.543853+0000","last_active":"2024-01-19T05:18:04.729878+0000","last_peered":"2024-01-19T05:18:04.729878+0000","last_clean":"2024-01-19T05:18:04.729878+0000","last_became_active":"2024-01-19T05:18:03.543119+0000","last_became_peered":"2024-01-19T05:18:03.543119+0000","last_unstale":"2024-01-19T05:18:04.729878+0000","last_undegraded":"2024-01-19T05:18:04.729878+0000","last_fullsized":"2024-01-19T05:18:04.729878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513670+0000","last_change":"2024-01-19T05:18:02.657695+0000","last_active":"2024-01-19T05:18:04.513670+0000","last_peered":"2024-01-19T05:18:04.513670+0000","last_clean":"2024-01-19T05:18:04.513670+0000","last_became_active":"2024-01-19T05:18:02.656870+0000","last_became_peered":"2024-01-19T05:18:02.656870+0000","last_unstale":"2024-01-19T05:18:04.513670+0000","last_undegraded":"2024-01-19T05:18:04.513670+0000","last_fullsized":"2024-01-19T05:18:04.513670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513835+0000","last_change":"2024-01-19T05:18:03.534680+0000","last_active":"2024-01-19T05:18:04.513835+0000","last_peered":"2024-01-19T05:18:04.513835+0000","last_clean":"2024-01-19T05:18:04.513835+0000","last_became_active":"2024-01-19T05:18:03.533937+0000","last_became_peered":"2024-01-19T05:18:03.533937+0000","last_unstale":"2024-01-19T05:18:04.513835+0000","last_undegraded":"2024-01-19T05:18:04.513835+0000","last_fullsized":"2024-01-19T05:18:04.513835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727901+0000","last_change":"2024-01-19T05:18:02.650559+0000","last_active":"2024-01-19T05:18:04.727901+0000","last_peered":"2024-01-19T05:18:04.727901+0000","last_clean":"2024-01-19T05:18:04.727901+0000","last_became_active":"2024-01-19T05:18:02.649764+0000","last_became_peered":"2024-01-19T05:18:02.649764+0000","last_unstale":"2024-01-19T05:18:04.727901+0000","last_undegraded":"2024-01-19T05:18:04.727901+0000","last_fullsized":"2024-01-19T05:18:04.727901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729375+0000","last_change":"2024-01-19T05:18:03.550709+0000","last_active":"2024-01-19T05:18:04.729375+0000","last_peered":"2024-01-19T05:18:04.729375+0000","last_clean":"2024-01-19T05:18:04.729375+0000","last_became_active":"2024-01-19T05:18:03.550073+0000","last_became_peered":"2024-01-19T05:18:03.550073+0000","last_unstale":"2024-01-19T05:18:04.729375+0000","last_undegraded":"2024-01-19T05:18:04.729375+0000","last_fullsized":"2024-01-19T05:18:04.729375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516191+0000","last_change":"2024-01-19T05:18:02.655120+0000","last_active":"2024-01-19T05:18:04.516191+0000","last_peered":"2024-01-19T05:18:04.516191+0000","last_clean":"2024-01-19T05:18:04.516191+0000","last_became_active":"2024-01-19T05:18:02.654360+0000","last_became_peered":"2024-01-19T05:18:02.654360+0000","last_unstale":"2024-01-19T05:18:04.516191+0000","last_undegraded":"2024-01-19T05:18:04.516191+0000","last_fullsized":"2024-01-19T05:18:04.516191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:32:02.214385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730500+0000","last_change":"2024-01-19T05:18:03.543739+0000","last_active":"2024-01-19T05:18:04.730500+0000","last_peered":"2024-01-19T05:18:04.730500+0000","last_clean":"2024-01-19T05:18:04.730500+0000","last_became_active":"2024-01-19T05:18:03.543142+0000","last_became_peered":"2024-01-19T05:18:03.543142+0000","last_unstale":"2024-01-19T05:18:04.730500+0000","last_undegraded":"2024-01-19T05:18:04.730500+0000","last_fullsized":"2024-01-19T05:18:04.730500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728061+0000","last_change":"2024-01-19T05:18:02.662915+0000","last_active":"2024-01-19T05:18:04.728061+0000","last_peered":"2024-01-19T05:18:04.728061+0000","last_clean":"2024-01-19T05:18:04.728061+0000","last_became_active":"2024-01-19T05:18:02.662617+0000","last_became_peered":"2024-01-19T05:18:02.662617+0000","last_unstale":"2024-01-19T05:18:04.728061+0000","last_undegraded":"2024-01-19T05:18:04.728061+0000","last_fullsized":"2024-01-19T05:18:04.728061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729905+0000","last_change":"2024-01-19T05:18:03.543521+0000","last_active":"2024-01-19T05:18:04.729905+0000","last_peered":"2024-01-19T05:18:04.729905+0000","last_clean":"2024-01-19T05:18:04.729905+0000","last_became_active":"2024-01-19T05:18:03.542803+0000","last_became_peered":"2024-01-19T05:18:03.542803+0000","last_unstale":"2024-01-19T05:18:04.729905+0000","last_undegraded":"2024-01-19T05:18:04.729905+0000","last_fullsized":"2024-01-19T05:18:04.729905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513101+0000","last_change":"2024-01-19T05:18:02.650642+0000","last_active":"2024-01-19T05:18:04.513101+0000","last_peered":"2024-01-19T05:18:04.513101+0000","last_clean":"2024-01-19T05:18:04.513101+0000","last_became_active":"2024-01-19T05:18:02.650319+0000","last_became_peered":"2024-01-19T05:18:02.650319+0000","last_unstale":"2024-01-19T05:18:04.513101+0000","last_undegraded":"2024-01-19T05:18:04.513101+0000","last_fullsized":"2024-01-19T05:18:04.513101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.565837+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.564725+0000","last_became_peered":"2024-01-19T05:18:03.564725+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727937+0000","last_change":"2024-01-19T05:18:02.656957+0000","last_active":"2024-01-19T05:18:04.727937+0000","last_peered":"2024-01-19T05:18:04.727937+0000","last_clean":"2024-01-19T05:18:04.727937+0000","last_became_active":"2024-01-19T05:18:02.656536+0000","last_became_peered":"2024-01-19T05:18:02.656536+0000","last_unstale":"2024-01-19T05:18:04.727937+0000","last_undegraded":"2024-01-19T05:18:04.727937+0000","last_fullsized":"2024-01-19T05:18:04.727937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729922+0000","last_change":"2024-01-19T05:18:03.571256+0000","last_active":"2024-01-19T05:18:04.729922+0000","last_peered":"2024-01-19T05:18:04.729922+0000","last_clean":"2024-01-19T05:18:04.729922+0000","last_became_active":"2024-01-19T05:18:03.570499+0000","last_became_peered":"2024-01-19T05:18:03.570499+0000","last_unstale":"2024-01-19T05:18:04.729922+0000","last_undegraded":"2024-01-19T05:18:04.729922+0000","last_fullsized":"2024-01-19T05:18:04.729922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-19T05:18:03.520367+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:03.520367+0000","last_peered":"2024-01-19T05:18:03.520367+0000","last_clean":"2024-01-19T05:18:03.520367+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:03.520367+0000","last_undegraded":"2024-01-19T05:18:03.520367+0000","last_fullsized":"2024-01-19T05:18:03.520367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730433+0000","last_change":"2024-01-19T05:18:02.650789+0000","last_active":"2024-01-19T05:18:04.730433+0000","last_peered":"2024-01-19T05:18:04.730433+0000","last_clean":"2024-01-19T05:18:04.730433+0000","last_became_active":"2024-01-19T05:18:02.649923+0000","last_became_peered":"2024-01-19T05:18:02.649923+0000","last_unstale":"2024-01-19T05:18:04.730433+0000","last_undegraded":"2024-01-19T05:18:04.730433+0000","last_fullsized":"2024-01-19T05:18:04.730433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:12.078445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729614+0000","last_change":"2024-01-19T05:18:03.569109+0000","last_active":"2024-01-19T05:18:04.729614+0000","last_peered":"2024-01-19T05:18:04.729614+0000","last_clean":"2024-01-19T05:18:04.729614+0000","last_became_active":"2024-01-19T05:18:03.568602+0000","last_became_peered":"2024-01-19T05:18:03.568602+0000","last_unstale":"2024-01-19T05:18:04.729614+0000","last_undegraded":"2024-01-19T05:18:04.729614+0000","last_fullsized":"2024-01-19T05:18:04.729614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729626+0000","last_change":"2024-01-19T05:18:02.671990+0000","last_active":"2024-01-19T05:18:04.729626+0000","last_peered":"2024-01-19T05:18:04.729626+0000","last_clean":"2024-01-19T05:18:04.729626+0000","last_became_active":"2024-01-19T05:18:02.671477+0000","last_became_peered":"2024-01-19T05:18:02.671477+0000","last_unstale":"2024-01-19T05:18:04.729626+0000","last_undegraded":"2024-01-19T05:18:04.729626+0000","last_fullsized":"2024-01-19T05:18:04.729626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728522+0000","last_change":"2024-01-19T05:18:03.551760+0000","last_active":"2024-01-19T05:18:04.728522+0000","last_peered":"2024-01-19T05:18:04.728522+0000","last_clean":"2024-01-19T05:18:04.728522+0000","last_became_active":"2024-01-19T05:18:03.550881+0000","last_became_peered":"2024-01-19T05:18:03.550881+0000","last_unstale":"2024-01-19T05:18:04.728522+0000","last_undegraded":"2024-01-19T05:18:04.728522+0000","last_fullsized":"2024-01-19T05:18:04.728522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727890+0000","last_change":"2024-01-19T05:18:02.663101+0000","last_active":"2024-01-19T05:18:04.727890+0000","last_peered":"2024-01-19T05:18:04.727890+0000","last_clean":"2024-01-19T05:18:04.727890+0000","last_became_active":"2024-01-19T05:18:02.662604+0000","last_became_peered":"2024-01-19T05:18:02.662604+0000","last_unstale":"2024-01-19T05:18:04.727890+0000","last_undegraded":"2024-01-19T05:18:04.727890+0000","last_fullsized":"2024-01-19T05:18:04.727890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512852+0000","last_change":"2024-01-19T05:18:03.537638+0000","last_active":"2024-01-19T05:18:04.512852+0000","last_peered":"2024-01-19T05:18:04.512852+0000","last_clean":"2024-01-19T05:18:04.512852+0000","last_became_active":"2024-01-19T05:18:03.536862+0000","last_became_peered":"2024-01-19T05:18:03.536862+0000","last_unstale":"2024-01-19T05:18:04.512852+0000","last_undegraded":"2024-01-19T05:18:04.512852+0000","last_fullsized":"2024-01-19T05:18:04.512852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731398+0000","last_change":"2024-01-19T05:18:02.655462+0000","last_active":"2024-01-19T05:18:04.731398+0000","last_peered":"2024-01-19T05:18:04.731398+0000","last_clean":"2024-01-19T05:18:04.731398+0000","last_became_active":"2024-01-19T05:18:02.654363+0000","last_became_peered":"2024-01-19T05:18:02.654363+0000","last_unstale":"2024-01-19T05:18:04.731398+0000","last_undegraded":"2024-01-19T05:18:04.731398+0000","last_fullsized":"2024-01-19T05:18:04.731398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:40.854099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515031+0000","last_change":"2024-01-19T05:18:03.540906+0000","last_active":"2024-01-19T05:18:04.515031+0000","last_peered":"2024-01-19T05:18:04.515031+0000","last_clean":"2024-01-19T05:18:04.515031+0000","last_became_active":"2024-01-19T05:18:03.540116+0000","last_became_peered":"2024-01-19T05:18:03.540116+0000","last_unstale":"2024-01-19T05:18:04.515031+0000","last_undegraded":"2024-01-19T05:18:04.515031+0000","last_fullsized":"2024-01-19T05:18:04.515031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:37.646122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512849+0000","last_change":"2024-01-19T05:18:02.657808+0000","last_active":"2024-01-19T05:18:04.512849+0000","last_peered":"2024-01-19T05:18:04.512849+0000","last_clean":"2024-01-19T05:18:04.512849+0000","last_became_active":"2024-01-19T05:18:02.657357+0000","last_became_peered":"2024-01-19T05:18:02.657357+0000","last_unstale":"2024-01-19T05:18:04.512849+0000","last_undegraded":"2024-01-19T05:18:04.512849+0000","last_fullsized":"2024-01-19T05:18:04.512849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.566199+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.565571+0000","last_became_peered":"2024-01-19T05:18:03.565571+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730213+0000","last_change":"2024-01-19T05:18:02.674805+0000","last_active":"2024-01-19T05:18:04.730213+0000","last_peered":"2024-01-19T05:18:04.730213+0000","last_clean":"2024-01-19T05:18:04.730213+0000","last_became_active":"2024-01-19T05:18:02.674331+0000","last_became_peered":"2024-01-19T05:18:02.674331+0000","last_unstale":"2024-01-19T05:18:04.730213+0000","last_undegraded":"2024-01-19T05:18:04.730213+0000","last_fullsized":"2024-01-19T05:18:04.730213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513263+0000","last_change":"2024-01-19T05:18:03.535625+0000","last_active":"2024-01-19T05:18:04.513263+0000","last_peered":"2024-01-19T05:18:04.513263+0000","last_clean":"2024-01-19T05:18:04.513263+0000","last_became_active":"2024-01-19T05:18:03.534935+0000","last_became_peered":"2024-01-19T05:18:03.534935+0000","last_unstale":"2024-01-19T05:18:04.513263+0000","last_undegraded":"2024-01-19T05:18:04.513263+0000","last_fullsized":"2024-01-19T05:18:04.513263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513329+0000","last_change":"2024-01-19T05:18:02.660485+0000","last_active":"2024-01-19T05:18:04.513329+0000","last_peered":"2024-01-19T05:18:04.513329+0000","last_clean":"2024-01-19T05:18:04.513329+0000","last_became_active":"2024-01-19T05:18:02.660172+0000","last_became_peered":"2024-01-19T05:18:02.660172+0000","last_unstale":"2024-01-19T05:18:04.513329+0000","last_undegraded":"2024-01-19T05:18:04.513329+0000","last_fullsized":"2024-01-19T05:18:04.513329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730089+0000","last_change":"2024-01-19T05:18:03.549395+0000","last_active":"2024-01-19T05:18:04.730089+0000","last_peered":"2024-01-19T05:18:04.730089+0000","last_clean":"2024-01-19T05:18:04.730089+0000","last_became_active":"2024-01-19T05:18:03.548645+0000","last_became_peered":"2024-01-19T05:18:03.548645+0000","last_unstale":"2024-01-19T05:18:04.730089+0000","last_undegraded":"2024-01-19T05:18:04.730089+0000","last_fullsized":"2024-01-19T05:18:04.730089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515120+0000","last_change":"2024-01-19T05:18:02.665544+0000","last_active":"2024-01-19T05:18:04.515120+0000","last_peered":"2024-01-19T05:18:04.515120+0000","last_clean":"2024-01-19T05:18:04.515120+0000","last_became_active":"2024-01-19T05:18:02.665011+0000","last_became_peered":"2024-01-19T05:18:02.665011+0000","last_unstale":"2024-01-19T05:18:04.515120+0000","last_undegraded":"2024-01-19T05:18:04.515120+0000","last_fullsized":"2024-01-19T05:18:04.515120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728406+0000","last_change":"2024-01-19T05:18:03.546972+0000","last_active":"2024-01-19T05:18:04.728406+0000","last_peered":"2024-01-19T05:18:04.728406+0000","last_clean":"2024-01-19T05:18:04.728406+0000","last_became_active":"2024-01-19T05:18:03.546258+0000","last_became_peered":"2024-01-19T05:18:03.546258+0000","last_unstale":"2024-01-19T05:18:04.728406+0000","last_undegraded":"2024-01-19T05:18:04.728406+0000","last_fullsized":"2024-01-19T05:18:04.728406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728783+0000","last_change":"2024-01-19T05:18:02.668468+0000","last_active":"2024-01-19T05:18:04.728783+0000","last_peered":"2024-01-19T05:18:04.728783+0000","last_clean":"2024-01-19T05:18:04.728783+0000","last_became_active":"2024-01-19T05:18:02.668005+0000","last_became_peered":"2024-01-19T05:18:02.668005+0000","last_unstale":"2024-01-19T05:18:04.728783+0000","last_undegraded":"2024-01-19T05:18:04.728783+0000","last_fullsized":"2024-01-19T05:18:04.728783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514090+0000","last_change":"2024-01-19T05:18:03.545257+0000","last_active":"2024-01-19T05:18:04.514090+0000","last_peered":"2024-01-19T05:18:04.514090+0000","last_clean":"2024-01-19T05:18:04.514090+0000","last_became_active":"2024-01-19T05:18:03.542709+0000","last_became_peered":"2024-01-19T05:18:03.542709+0000","last_unstale":"2024-01-19T05:18:04.514090+0000","last_undegraded":"2024-01-19T05:18:04.514090+0000","last_fullsized":"2024-01-19T05:18:04.514090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:31.698937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512995+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.512995+0000","last_peered":"2024-01-19T05:18:04.512995+0000","last_clean":"2024-01-19T05:18:04.512995+0000","last_became_active":"2024-01-19T05:18:02.664286+0000","last_became_peered":"2024-01-19T05:18:02.664286+0000","last_unstale":"2024-01-19T05:18:04.512995+0000","last_undegraded":"2024-01-19T05:18:04.512995+0000","last_fullsized":"2024-01-19T05:18:04.512995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729156+0000","last_change":"2024-01-19T05:18:03.554862+0000","last_active":"2024-01-19T05:18:04.729156+0000","last_peered":"2024-01-19T05:18:04.729156+0000","last_clean":"2024-01-19T05:18:04.729156+0000","last_became_active":"2024-01-19T05:18:03.550546+0000","last_became_peered":"2024-01-19T05:18:03.550546+0000","last_unstale":"2024-01-19T05:18:04.729156+0000","last_undegraded":"2024-01-19T05:18:04.729156+0000","last_fullsized":"2024-01-19T05:18:04.729156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513140+0000","last_change":"2024-01-19T05:18:02.663145+0000","last_active":"2024-01-19T05:18:04.513140+0000","last_peered":"2024-01-19T05:18:04.513140+0000","last_clean":"2024-01-19T05:18:04.513140+0000","last_became_active":"2024-01-19T05:18:02.662788+0000","last_became_peered":"2024-01-19T05:18:02.662788+0000","last_unstale":"2024-01-19T05:18:04.513140+0000","last_undegraded":"2024-01-19T05:18:04.513140+0000","last_fullsized":"2024-01-19T05:18:04.513140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729679+0000","last_change":"2024-01-19T05:18:03.551324+0000","last_active":"2024-01-19T05:18:04.729679+0000","last_peered":"2024-01-19T05:18:04.729679+0000","last_clean":"2024-01-19T05:18:04.729679+0000","last_became_active":"2024-01-19T05:18:03.549215+0000","last_became_peered":"2024-01-19T05:18:03.549215+0000","last_unstale":"2024-01-19T05:18:04.729679+0000","last_undegraded":"2024-01-19T05:18:04.729679+0000","last_fullsized":"2024-01-19T05:18:04.729679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730060+0000","last_change":"2024-01-19T05:18:02.670360+0000","last_active":"2024-01-19T05:18:04.730060+0000","last_peered":"2024-01-19T05:18:04.730060+0000","last_clean":"2024-01-19T05:18:04.730060+0000","last_became_active":"2024-01-19T05:18:02.669751+0000","last_became_peered":"2024-01-19T05:18:02.669751+0000","last_unstale":"2024-01-19T05:18:04.730060+0000","last_undegraded":"2024-01-19T05:18:04.730060+0000","last_fullsized":"2024-01-19T05:18:04.730060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513640+0000","last_change":"2024-01-19T05:18:03.531197+0000","last_active":"2024-01-19T05:18:04.513640+0000","last_peered":"2024-01-19T05:18:04.513640+0000","last_clean":"2024-01-19T05:18:04.513640+0000","last_became_active":"2024-01-19T05:18:03.530484+0000","last_became_peered":"2024-01-19T05:18:03.530484+0000","last_unstale":"2024-01-19T05:18:04.513640+0000","last_undegraded":"2024-01-19T05:18:04.513640+0000","last_fullsized":"2024-01-19T05:18:04.513640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731287+0000","last_change":"2024-01-19T05:18:03.562891+0000","last_active":"2024-01-19T05:18:04.731287+0000","last_peered":"2024-01-19T05:18:04.731287+0000","last_clean":"2024-01-19T05:18:04.731287+0000","last_became_active":"2024-01-19T05:18:03.558374+0000","last_became_peered":"2024-01-19T05:18:03.558374+0000","last_unstale":"2024-01-19T05:18:04.731287+0000","last_undegraded":"2024-01-19T05:18:04.731287+0000","last_fullsized":"2024-01-19T05:18:04.731287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729394+0000","last_change":"2024-01-19T05:18:02.672001+0000","last_active":"2024-01-19T05:18:04.729394+0000","last_peered":"2024-01-19T05:18:04.729394+0000","last_clean":"2024-01-19T05:18:04.729394+0000","last_became_active":"2024-01-19T05:18:02.671437+0000","last_became_peered":"2024-01-19T05:18:02.671437+0000","last_unstale":"2024-01-19T05:18:04.729394+0000","last_undegraded":"2024-01-19T05:18:04.729394+0000","last_fullsized":"2024-01-19T05:18:04.729394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731196+0000","last_change":"2024-01-19T05:18:03.565321+0000","last_active":"2024-01-19T05:18:04.731196+0000","last_peered":"2024-01-19T05:18:04.731196+0000","last_clean":"2024-01-19T05:18:04.731196+0000","last_became_active":"2024-01-19T05:18:03.563207+0000","last_became_peered":"2024-01-19T05:18:03.563207+0000","last_unstale":"2024-01-19T05:18:04.731196+0000","last_undegraded":"2024-01-19T05:18:04.731196+0000","last_fullsized":"2024-01-19T05:18:04.731196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729996+0000","last_change":"2024-01-19T05:18:02.673614+0000","last_active":"2024-01-19T05:18:04.729996+0000","last_peered":"2024-01-19T05:18:04.729996+0000","last_clean":"2024-01-19T05:18:04.729996+0000","last_became_active":"2024-01-19T05:18:02.673106+0000","last_became_peered":"2024-01-19T05:18:02.673106+0000","last_unstale":"2024-01-19T05:18:04.729996+0000","last_undegraded":"2024-01-19T05:18:04.729996+0000","last_fullsized":"2024-01-19T05:18:04.729996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728334+0000","last_change":"2024-01-19T05:18:03.570972+0000","last_active":"2024-01-19T05:18:04.728334+0000","last_peered":"2024-01-19T05:18:04.728334+0000","last_clean":"2024-01-19T05:18:04.728334+0000","last_became_active":"2024-01-19T05:18:03.570555+0000","last_became_peered":"2024-01-19T05:18:03.570555+0000","last_unstale":"2024-01-19T05:18:04.728334+0000","last_undegraded":"2024-01-19T05:18:04.728334+0000","last_fullsized":"2024-01-19T05:18:04.728334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:41.862758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729948+0000","last_change":"2024-01-19T05:18:02.661127+0000","last_active":"2024-01-19T05:18:04.729948+0000","last_peered":"2024-01-19T05:18:04.729948+0000","last_clean":"2024-01-19T05:18:04.729948+0000","last_became_active":"2024-01-19T05:18:02.660171+0000","last_became_peered":"2024-01-19T05:18:02.660171+0000","last_unstale":"2024-01-19T05:18:04.729948+0000","last_undegraded":"2024-01-19T05:18:04.729948+0000","last_fullsized":"2024-01-19T05:18:04.729948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729899+0000","last_change":"2024-01-19T05:18:03.546643+0000","last_active":"2024-01-19T05:18:04.729899+0000","last_peered":"2024-01-19T05:18:04.729899+0000","last_clean":"2024-01-19T05:18:04.729899+0000","last_became_active":"2024-01-19T05:18:03.545889+0000","last_became_peered":"2024-01-19T05:18:03.545889+0000","last_unstale":"2024-01-19T05:18:04.729899+0000","last_undegraded":"2024-01-19T05:18:04.729899+0000","last_fullsized":"2024-01-19T05:18:04.729899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728691+0000","last_change":"2024-01-19T05:18:02.666057+0000","last_active":"2024-01-19T05:18:04.728691+0000","last_peered":"2024-01-19T05:18:04.728691+0000","last_clean":"2024-01-19T05:18:04.728691+0000","last_became_active":"2024-01-19T05:18:02.665663+0000","last_became_peered":"2024-01-19T05:18:02.665663+0000","last_unstale":"2024-01-19T05:18:04.728691+0000","last_undegraded":"2024-01-19T05:18:04.728691+0000","last_fullsized":"2024-01-19T05:18:04.728691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7150000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:08.892 INFO:tasks.ceph.mds.b.smithi157.stderr:2024-01-19T05:18:08.891+0000 7f406c835640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T05:18:11.141 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:11.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.270+0000 7fa9456d0640 1 Processor -- start 2024-01-19T05:18:11.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.270+0000 7fa9456d0640 1 -- start start 2024-01-19T05:18:11.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa9456d0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9400b96f0 0x7fa9400b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa9456d0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9400b87f0 con 0x7fa940140e90 2024-01-19T05:18:11.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa9456d0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9400b9ad0 con 0x7fa9400b7c40 2024-01-19T05:18:11.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa9456d0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400b81e0 con 0x7fa9400b96f0 2024-01-19T05:18:11.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93f7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa940140e90 0x7fa9401511c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42490/0 (socket says 172.21.15.99:42490) 2024-01-19T05:18:11.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93f7fe640 1 -- 172.21.15.99:0/3710262258 learned_addr learned my addr 172.21.15.99:0/3710262258 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:11.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93effd640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9400b96f0 0x7fa9400b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151757974 0 0) 0x7fa9400b87f0 con 0x7fa940140e90 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa928003530 con 0x7fa940140e90 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946521748 0 0) 0x7fa928003530 con 0x7fa940140e90 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9400b96f0 msgr2=0x7fa9400b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9400b96f0 0x7fa9400b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 >> v1:172.21.15.157:6789/0 conn(0x7fa9400b7c40 legacy=0x7fa940140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94006ba20 con 0x7fa940140e90 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fa938001a00 con 0x7fa940140e90 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 >> v1:172.21.15.99:6789/0 conn(0x7fa940140e90 legacy=0x7fa9401511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9400b96f0 0x7fa9280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa928003f30 0x7fa9280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa928004d10 0x7fa928005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400b81e0 con 0x7fa928004d10 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92800ba70 con 0x7fa928003f30 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92800bc30 con 0x7fa9400b96f0 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93f7fe640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa928004d10 0x7fa928005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93effd640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9400b96f0 0x7fa9280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93e7fc640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa928003f30 0x7fa9280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93f7fe640 1 -- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9400b96f0 msgr2=0x7fa9280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93f7fe640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9400b96f0 0x7fa9280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93f7fe640 1 -- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa928003f30 msgr2=0x7fa9280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93f7fe640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa928003f30 0x7fa9280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.274+0000 7fa93f7fe640 1 -- 172.21.15.99:0/3710262258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928003530 con 0x7fa928004d10 2024-01-19T05:18:11.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93f7fe640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa928004d10 0x7fa928005190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa940147a50 tx=0x7fa93801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fec12dda81ca37 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380072d0 con 0x7fa928004d10 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9380a8070 con 0x7fa928004d10 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93dffb640 1 -- 172.21.15.99:0/3710262258 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380076f0 con 0x7fa928004d10 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- 172.21.15.99:0/3710262258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa928004d10 msgr2=0x7fa928005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 --2- 172.21.15.99:0/3710262258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa928004d10 0x7fa928005190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa940147a50 tx=0x7fa93801d2e0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93f7fe640 1 -- 172.21.15.99:0/3710262258 reap_dead start 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- 172.21.15.99:0/3710262258 shutdown_connections 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- 172.21.15.99:0/3710262258 >> 172.21.15.99:0/3710262258 conn(0x7fa94009e600 msgr2=0x7fa9400b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- 172.21.15.99:0/3710262258 shutdown_connections 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- 172.21.15.99:0/3710262258 wait complete. 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 Processor -- start 2024-01-19T05:18:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- start start 2024-01-19T05:18:11.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa940147090 0x7fa940147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa940147a80 0x7fa940148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa940148990 0x7fa94013d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94014ac30 con 0x7fa940147a80 2024-01-19T05:18:11.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9401493f0 con 0x7fa940147090 2024-01-19T05:18:11.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa940148e40 con 0x7fa940148990 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa940147a80 0x7fa940148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa940147a80 0x7fa940148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55692/0 (socket says 172.21.15.99:55692) 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 -- 172.21.15.99:0/1325739436 learned_addr learned my addr 172.21.15.99:0/1325739436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93f7fe640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa940148990 0x7fa94013d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93effd640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa940147090 0x7fa940147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 -- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa940148990 msgr2=0x7fa94013d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa940148990 0x7fa94013d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 -- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa940147090 msgr2=0x7fa940147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa940147090 0x7fa940147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 -- 172.21.15.99:0/1325739436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94014a850 con 0x7fa940147a80 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93f7fe640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa940148990 0x7fa94013d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93effd640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa940147090 0x7fa940147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:11.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa93e7fc640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa940147a80 0x7fa940148450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa93400e4b0 tx=0x7fa93400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9277fe640 1 -- 172.21.15.99:0/1325739436 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340052e0 con 0x7fa940147a80 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9277fe640 1 -- 172.21.15.99:0/1325739436 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934005440 con 0x7fa940147a80 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94014a050 con 0x7fa940147a80 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9277fe640 1 -- 172.21.15.99:0/1325739436 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934003820 con 0x7fa940147a80 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.278+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94014a4e0 con 0x7fa940147a80 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.282+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9400696e0 con 0x7fa940147a80 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.282+0000 7fa9277fe640 1 -- 172.21.15.99:0/1325739436 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa934003980 con 0x7fa940147a80 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.282+0000 7fa9277fe640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa92c066530 0x7fa92c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.282+0000 7fa9277fe640 1 -- 172.21.15.99:0/1325739436 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa934083b30 con 0x7fa940147a80 2024-01-19T05:18:11.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.282+0000 7fa93effd640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa92c066530 0x7fa92c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.282+0000 7fa93effd640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa92c066530 0x7fa92c0689f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa930009a20 tx=0x7fa930008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:11.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.286+0000 7fa9277fe640 1 -- 172.21.15.99:0/1325739436 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa934050e60 con 0x7fa940147a80 2024-01-19T05:18:11.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.438+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9400a1600 con 0x7fa92c066530 2024-01-19T05:18:11.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.446+0000 7fa9277fe640 1 -- 172.21.15.99:0/1325739436 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264449 (secure 0 0 0) 0x7fa930012950 con 0x7fa92c066530 2024-01-19T05:18:11.451 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:11.453 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:11.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa92c066530 msgr2=0x7fa92c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa92c066530 0x7fa92c0689f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa930009a20 tx=0x7fa930008040 comp rx=0 tx=0).stop 2024-01-19T05:18:11.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa940147a80 msgr2=0x7fa940148450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa940147a80 0x7fa940148450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa93400e4b0 tx=0x7fa93400e970 comp rx=0 tx=0).stop 2024-01-19T05:18:11.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 shutdown_connections 2024-01-19T05:18:11.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa92c066530 0x7fa92c0689f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa940148990 0x7fa94013d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa940147a80 0x7fa940148450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 --2- 172.21.15.99:0/1325739436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa940147090 0x7fa940147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.450+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 >> 172.21.15.99:0/1325739436 conn(0x7fa94009e600 msgr2=0x7fa94009a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:11.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.454+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 shutdown_connections 2024-01-19T05:18:11.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.454+0000 7fa9456d0640 1 -- 172.21.15.99:0/1325739436 wait complete. 2024-01-19T05:18:11.470 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-19T05:18:11.346162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235644,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739076,"statfs":{"total":773094113280,"available":772852813824,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729517+0000","last_change":"2024-01-19T05:18:03.537400+0000","last_active":"2024-01-19T05:18:04.729517+0000","last_peered":"2024-01-19T05:18:04.729517+0000","last_clean":"2024-01-19T05:18:04.729517+0000","last_became_active":"2024-01-19T05:18:03.536533+0000","last_became_peered":"2024-01-19T05:18:03.536533+0000","last_unstale":"2024-01-19T05:18:04.729517+0000","last_undegraded":"2024-01-19T05:18:04.729517+0000","last_fullsized":"2024-01-19T05:18:04.729517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513273+0000","last_change":"2024-01-19T05:18:03.538419+0000","last_active":"2024-01-19T05:18:04.513273+0000","last_peered":"2024-01-19T05:18:04.513273+0000","last_clean":"2024-01-19T05:18:04.513273+0000","last_became_active":"2024-01-19T05:18:03.537715+0000","last_became_peered":"2024-01-19T05:18:03.537715+0000","last_unstale":"2024-01-19T05:18:04.513273+0000","last_undegraded":"2024-01-19T05:18:04.513273+0000","last_fullsized":"2024-01-19T05:18:04.513273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728283+0000","last_change":"2024-01-19T05:18:03.554921+0000","last_active":"2024-01-19T05:18:04.728283+0000","last_peered":"2024-01-19T05:18:04.728283+0000","last_clean":"2024-01-19T05:18:04.728283+0000","last_became_active":"2024-01-19T05:18:03.554270+0000","last_became_peered":"2024-01-19T05:18:03.554270+0000","last_unstale":"2024-01-19T05:18:04.728283+0000","last_undegraded":"2024-01-19T05:18:04.728283+0000","last_fullsized":"2024-01-19T05:18:04.728283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:13.087104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730979+0000","last_change":"2024-01-19T05:18:03.566913+0000","last_active":"2024-01-19T05:18:04.730979+0000","last_peered":"2024-01-19T05:18:04.730979+0000","last_clean":"2024-01-19T05:18:04.730979+0000","last_became_active":"2024-01-19T05:18:03.566063+0000","last_became_peered":"2024-01-19T05:18:03.566063+0000","last_unstale":"2024-01-19T05:18:04.730979+0000","last_undegraded":"2024-01-19T05:18:04.730979+0000","last_fullsized":"2024-01-19T05:18:04.730979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.554926+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.554035+0000","last_became_peered":"2024-01-19T05:18:03.554035+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730556+0000","last_change":"2024-01-19T05:18:03.563300+0000","last_active":"2024-01-19T05:18:04.730556+0000","last_peered":"2024-01-19T05:18:04.730556+0000","last_clean":"2024-01-19T05:18:04.730556+0000","last_became_active":"2024-01-19T05:18:03.562655+0000","last_became_peered":"2024-01-19T05:18:03.562655+0000","last_unstale":"2024-01-19T05:18:04.730556+0000","last_undegraded":"2024-01-19T05:18:04.730556+0000","last_fullsized":"2024-01-19T05:18:04.730556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729148+0000","last_change":"2024-01-19T05:18:03.535107+0000","last_active":"2024-01-19T05:18:04.729148+0000","last_peered":"2024-01-19T05:18:04.729148+0000","last_clean":"2024-01-19T05:18:04.729148+0000","last_became_active":"2024-01-19T05:18:03.534338+0000","last_became_peered":"2024-01-19T05:18:03.534338+0000","last_unstale":"2024-01-19T05:18:04.729148+0000","last_undegraded":"2024-01-19T05:18:04.729148+0000","last_fullsized":"2024-01-19T05:18:04.729148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728969+0000","last_change":"2024-01-19T05:18:03.567466+0000","last_active":"2024-01-19T05:18:04.728969+0000","last_peered":"2024-01-19T05:18:04.728969+0000","last_clean":"2024-01-19T05:18:04.728969+0000","last_became_active":"2024-01-19T05:18:03.566828+0000","last_became_peered":"2024-01-19T05:18:03.566828+0000","last_unstale":"2024-01-19T05:18:04.728969+0000","last_undegraded":"2024-01-19T05:18:04.728969+0000","last_fullsized":"2024-01-19T05:18:04.728969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.573607+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.573072+0000","last_became_peered":"2024-01-19T05:18:03.573072+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515175+0000","last_change":"2024-01-19T05:18:03.560176+0000","last_active":"2024-01-19T05:18:04.515175+0000","last_peered":"2024-01-19T05:18:04.515175+0000","last_clean":"2024-01-19T05:18:04.515175+0000","last_became_active":"2024-01-19T05:18:03.559432+0000","last_became_peered":"2024-01-19T05:18:03.559432+0000","last_unstale":"2024-01-19T05:18:04.515175+0000","last_undegraded":"2024-01-19T05:18:04.515175+0000","last_fullsized":"2024-01-19T05:18:04.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515576+0000","last_change":"2024-01-19T05:18:03.570077+0000","last_active":"2024-01-19T05:18:04.515576+0000","last_peered":"2024-01-19T05:18:04.515576+0000","last_clean":"2024-01-19T05:18:04.515576+0000","last_became_active":"2024-01-19T05:18:03.569528+0000","last_became_peered":"2024-01-19T05:18:03.569528+0000","last_unstale":"2024-01-19T05:18:04.515576+0000","last_undegraded":"2024-01-19T05:18:04.515576+0000","last_fullsized":"2024-01-19T05:18:04.515576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516108+0000","last_change":"2024-01-19T05:18:03.538635+0000","last_active":"2024-01-19T05:18:04.516108+0000","last_peered":"2024-01-19T05:18:04.516108+0000","last_clean":"2024-01-19T05:18:04.516108+0000","last_became_active":"2024-01-19T05:18:03.537778+0000","last_became_peered":"2024-01-19T05:18:03.537778+0000","last_unstale":"2024-01-19T05:18:04.516108+0000","last_undegraded":"2024-01-19T05:18:04.516108+0000","last_fullsized":"2024-01-19T05:18:04.516108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729656+0000","last_change":"2024-01-19T05:18:03.542188+0000","last_active":"2024-01-19T05:18:04.729656+0000","last_peered":"2024-01-19T05:18:04.729656+0000","last_clean":"2024-01-19T05:18:04.729656+0000","last_became_active":"2024-01-19T05:18:03.541504+0000","last_became_peered":"2024-01-19T05:18:03.541504+0000","last_unstale":"2024-01-19T05:18:04.729656+0000","last_undegraded":"2024-01-19T05:18:04.729656+0000","last_fullsized":"2024-01-19T05:18:04.729656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728750+0000","last_change":"2024-01-19T05:18:03.547095+0000","last_active":"2024-01-19T05:18:04.728750+0000","last_peered":"2024-01-19T05:18:04.728750+0000","last_clean":"2024-01-19T05:18:04.728750+0000","last_became_active":"2024-01-19T05:18:03.546466+0000","last_became_peered":"2024-01-19T05:18:03.546466+0000","last_unstale":"2024-01-19T05:18:04.728750+0000","last_undegraded":"2024-01-19T05:18:04.728750+0000","last_fullsized":"2024-01-19T05:18:04.728750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512907+0000","last_change":"2024-01-19T05:18:03.540449+0000","last_active":"2024-01-19T05:18:04.512907+0000","last_peered":"2024-01-19T05:18:04.512907+0000","last_clean":"2024-01-19T05:18:04.512907+0000","last_became_active":"2024-01-19T05:18:03.539616+0000","last_became_peered":"2024-01-19T05:18:03.539616+0000","last_unstale":"2024-01-19T05:18:04.512907+0000","last_undegraded":"2024-01-19T05:18:04.512907+0000","last_fullsized":"2024-01-19T05:18:04.512907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728960+0000","last_change":"2024-01-19T05:18:03.568406+0000","last_active":"2024-01-19T05:18:04.728960+0000","last_peered":"2024-01-19T05:18:04.728960+0000","last_clean":"2024-01-19T05:18:04.728960+0000","last_became_active":"2024-01-19T05:18:03.567759+0000","last_became_peered":"2024-01-19T05:18:03.567759+0000","last_unstale":"2024-01-19T05:18:04.728960+0000","last_undegraded":"2024-01-19T05:18:04.728960+0000","last_fullsized":"2024-01-19T05:18:04.728960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731803+0000","last_change":"2024-01-19T05:18:03.571085+0000","last_active":"2024-01-19T05:18:04.731803+0000","last_peered":"2024-01-19T05:18:04.731803+0000","last_clean":"2024-01-19T05:18:04.731803+0000","last_became_active":"2024-01-19T05:18:03.569878+0000","last_became_peered":"2024-01-19T05:18:03.569878+0000","last_unstale":"2024-01-19T05:18:04.731803+0000","last_undegraded":"2024-01-19T05:18:04.731803+0000","last_fullsized":"2024-01-19T05:18:04.731803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728098+0000","last_change":"2024-01-19T05:18:03.520269+0000","last_active":"2024-01-19T05:18:04.728098+0000","last_peered":"2024-01-19T05:18:04.728098+0000","last_clean":"2024-01-19T05:18:04.728098+0000","last_became_active":"2024-01-19T05:18:03.519676+0000","last_became_peered":"2024-01-19T05:18:03.519676+0000","last_unstale":"2024-01-19T05:18:04.728098+0000","last_undegraded":"2024-01-19T05:18:04.728098+0000","last_fullsized":"2024-01-19T05:18:04.728098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730254+0000","last_change":"2024-01-19T05:18:03.555567+0000","last_active":"2024-01-19T05:18:04.730254+0000","last_peered":"2024-01-19T05:18:04.730254+0000","last_clean":"2024-01-19T05:18:04.730254+0000","last_became_active":"2024-01-19T05:18:03.554832+0000","last_became_peered":"2024-01-19T05:18:03.554832+0000","last_unstale":"2024-01-19T05:18:04.730254+0000","last_undegraded":"2024-01-19T05:18:04.730254+0000","last_fullsized":"2024-01-19T05:18:04.730254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514744+0000","last_change":"2024-01-19T05:18:03.545771+0000","last_active":"2024-01-19T05:18:04.514744+0000","last_peered":"2024-01-19T05:18:04.514744+0000","last_clean":"2024-01-19T05:18:04.514744+0000","last_became_active":"2024-01-19T05:18:03.545003+0000","last_became_peered":"2024-01-19T05:18:03.545003+0000","last_unstale":"2024-01-19T05:18:04.514744+0000","last_undegraded":"2024-01-19T05:18:04.514744+0000","last_fullsized":"2024-01-19T05:18:04.514744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728346+0000","last_change":"2024-01-19T05:18:03.551774+0000","last_active":"2024-01-19T05:18:04.728346+0000","last_peered":"2024-01-19T05:18:04.728346+0000","last_clean":"2024-01-19T05:18:04.728346+0000","last_became_active":"2024-01-19T05:18:03.550788+0000","last_became_peered":"2024-01-19T05:18:03.550788+0000","last_unstale":"2024-01-19T05:18:04.728346+0000","last_undegraded":"2024-01-19T05:18:04.728346+0000","last_fullsized":"2024-01-19T05:18:04.728346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731558+0000","last_change":"2024-01-19T05:18:03.568310+0000","last_active":"2024-01-19T05:18:04.731558+0000","last_peered":"2024-01-19T05:18:04.731558+0000","last_clean":"2024-01-19T05:18:04.731558+0000","last_became_active":"2024-01-19T05:18:03.567678+0000","last_became_peered":"2024-01-19T05:18:03.567678+0000","last_unstale":"2024-01-19T05:18:04.731558+0000","last_undegraded":"2024-01-19T05:18:04.731558+0000","last_fullsized":"2024-01-19T05:18:04.731558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729157+0000","last_change":"2024-01-19T05:18:03.554839+0000","last_active":"2024-01-19T05:18:04.729157+0000","last_peered":"2024-01-19T05:18:04.729157+0000","last_clean":"2024-01-19T05:18:04.729157+0000","last_became_active":"2024-01-19T05:18:03.551361+0000","last_became_peered":"2024-01-19T05:18:03.551361+0000","last_unstale":"2024-01-19T05:18:04.729157+0000","last_undegraded":"2024-01-19T05:18:04.729157+0000","last_fullsized":"2024-01-19T05:18:04.729157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729155+0000","last_change":"2024-01-19T05:18:03.563289+0000","last_active":"2024-01-19T05:18:04.729155+0000","last_peered":"2024-01-19T05:18:04.729155+0000","last_clean":"2024-01-19T05:18:04.729155+0000","last_became_active":"2024-01-19T05:18:03.556561+0000","last_became_peered":"2024-01-19T05:18:03.556561+0000","last_unstale":"2024-01-19T05:18:04.729155+0000","last_undegraded":"2024-01-19T05:18:04.729155+0000","last_fullsized":"2024-01-19T05:18:04.729155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730025+0000","last_change":"2024-01-19T05:18:03.546978+0000","last_active":"2024-01-19T05:18:04.730025+0000","last_peered":"2024-01-19T05:18:04.730025+0000","last_clean":"2024-01-19T05:18:04.730025+0000","last_became_active":"2024-01-19T05:18:03.546276+0000","last_became_peered":"2024-01-19T05:18:03.546276+0000","last_unstale":"2024-01-19T05:18:04.730025+0000","last_undegraded":"2024-01-19T05:18:04.730025+0000","last_fullsized":"2024-01-19T05:18:04.730025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515447+0000","last_change":"2024-01-19T05:18:03.525138+0000","last_active":"2024-01-19T05:18:04.515447+0000","last_peered":"2024-01-19T05:18:04.515447+0000","last_clean":"2024-01-19T05:18:04.515447+0000","last_became_active":"2024-01-19T05:18:03.524523+0000","last_became_peered":"2024-01-19T05:18:03.524523+0000","last_unstale":"2024-01-19T05:18:04.515447+0000","last_undegraded":"2024-01-19T05:18:04.515447+0000","last_fullsized":"2024-01-19T05:18:04.515447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512997+0000","last_change":"2024-01-19T05:18:03.544359+0000","last_active":"2024-01-19T05:18:04.512997+0000","last_peered":"2024-01-19T05:18:04.512997+0000","last_clean":"2024-01-19T05:18:04.512997+0000","last_became_active":"2024-01-19T05:18:03.543559+0000","last_became_peered":"2024-01-19T05:18:03.543559+0000","last_unstale":"2024-01-19T05:18:04.512997+0000","last_undegraded":"2024-01-19T05:18:04.512997+0000","last_fullsized":"2024-01-19T05:18:04.512997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729855+0000","last_change":"2024-01-19T05:18:03.549033+0000","last_active":"2024-01-19T05:18:04.729855+0000","last_peered":"2024-01-19T05:18:04.729855+0000","last_clean":"2024-01-19T05:18:04.729855+0000","last_became_active":"2024-01-19T05:18:03.548292+0000","last_became_peered":"2024-01-19T05:18:03.548292+0000","last_unstale":"2024-01-19T05:18:04.729855+0000","last_undegraded":"2024-01-19T05:18:04.729855+0000","last_fullsized":"2024-01-19T05:18:04.729855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728511+0000","last_change":"2024-01-19T05:18:03.557894+0000","last_active":"2024-01-19T05:18:04.728511+0000","last_peered":"2024-01-19T05:18:04.728511+0000","last_clean":"2024-01-19T05:18:04.728511+0000","last_became_active":"2024-01-19T05:18:03.556934+0000","last_became_peered":"2024-01-19T05:18:03.556934+0000","last_unstale":"2024-01-19T05:18:04.728511+0000","last_undegraded":"2024-01-19T05:18:04.728511+0000","last_fullsized":"2024-01-19T05:18:04.728511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730933+0000","last_change":"2024-01-19T05:18:03.557384+0000","last_active":"2024-01-19T05:18:04.730933+0000","last_peered":"2024-01-19T05:18:04.730933+0000","last_clean":"2024-01-19T05:18:04.730933+0000","last_became_active":"2024-01-19T05:18:03.555960+0000","last_became_peered":"2024-01-19T05:18:03.555960+0000","last_unstale":"2024-01-19T05:18:04.730933+0000","last_undegraded":"2024-01-19T05:18:04.730933+0000","last_fullsized":"2024-01-19T05:18:04.730933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727845+0000","last_change":"2024-01-19T05:18:03.560129+0000","last_active":"2024-01-19T05:18:04.727845+0000","last_peered":"2024-01-19T05:18:04.727845+0000","last_clean":"2024-01-19T05:18:04.727845+0000","last_became_active":"2024-01-19T05:18:03.559502+0000","last_became_peered":"2024-01-19T05:18:03.559502+0000","last_unstale":"2024-01-19T05:18:04.727845+0000","last_undegraded":"2024-01-19T05:18:04.727845+0000","last_fullsized":"2024-01-19T05:18:04.727845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513499+0000","last_change":"2024-01-19T05:18:03.537557+0000","last_active":"2024-01-19T05:18:04.513499+0000","last_peered":"2024-01-19T05:18:04.513499+0000","last_clean":"2024-01-19T05:18:04.513499+0000","last_became_active":"2024-01-19T05:18:03.536744+0000","last_became_peered":"2024-01-19T05:18:03.536744+0000","last_unstale":"2024-01-19T05:18:04.513499+0000","last_undegraded":"2024-01-19T05:18:04.513499+0000","last_fullsized":"2024-01-19T05:18:04.513499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514550+0000","last_change":"2024-01-19T05:18:03.537254+0000","last_active":"2024-01-19T05:18:04.514550+0000","last_peered":"2024-01-19T05:18:04.514550+0000","last_clean":"2024-01-19T05:18:04.514550+0000","last_became_active":"2024-01-19T05:18:03.536484+0000","last_became_peered":"2024-01-19T05:18:03.536484+0000","last_unstale":"2024-01-19T05:18:04.514550+0000","last_undegraded":"2024-01-19T05:18:04.514550+0000","last_fullsized":"2024-01-19T05:18:04.514550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:40.310261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729759+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.729759+0000","last_peered":"2024-01-19T05:18:04.729759+0000","last_clean":"2024-01-19T05:18:04.729759+0000","last_became_active":"2024-01-19T05:18:02.664263+0000","last_became_peered":"2024-01-19T05:18:02.664263+0000","last_unstale":"2024-01-19T05:18:04.729759+0000","last_undegraded":"2024-01-19T05:18:04.729759+0000","last_fullsized":"2024-01-19T05:18:04.729759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728651+0000","last_change":"2024-01-19T05:18:03.544005+0000","last_active":"2024-01-19T05:18:04.728651+0000","last_peered":"2024-01-19T05:18:04.728651+0000","last_clean":"2024-01-19T05:18:04.728651+0000","last_became_active":"2024-01-19T05:18:03.543213+0000","last_became_peered":"2024-01-19T05:18:03.543213+0000","last_unstale":"2024-01-19T05:18:04.728651+0000","last_undegraded":"2024-01-19T05:18:04.728651+0000","last_fullsized":"2024-01-19T05:18:04.728651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515401+0000","last_change":"2024-01-19T05:18:02.657382+0000","last_active":"2024-01-19T05:18:04.515401+0000","last_peered":"2024-01-19T05:18:04.515401+0000","last_clean":"2024-01-19T05:18:04.515401+0000","last_became_active":"2024-01-19T05:18:02.656806+0000","last_became_peered":"2024-01-19T05:18:02.656806+0000","last_unstale":"2024-01-19T05:18:04.515401+0000","last_undegraded":"2024-01-19T05:18:04.515401+0000","last_fullsized":"2024-01-19T05:18:04.515401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729079+0000","last_change":"2024-01-19T05:18:02.653215+0000","last_active":"2024-01-19T05:18:04.729079+0000","last_peered":"2024-01-19T05:18:04.729079+0000","last_clean":"2024-01-19T05:18:04.729079+0000","last_became_active":"2024-01-19T05:18:02.652938+0000","last_became_peered":"2024-01-19T05:18:02.652938+0000","last_unstale":"2024-01-19T05:18:04.729079+0000","last_undegraded":"2024-01-19T05:18:04.729079+0000","last_fullsized":"2024-01-19T05:18:04.729079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729005+0000","last_change":"2024-01-19T05:18:03.541881+0000","last_active":"2024-01-19T05:18:04.729005+0000","last_peered":"2024-01-19T05:18:04.729005+0000","last_clean":"2024-01-19T05:18:04.729005+0000","last_became_active":"2024-01-19T05:18:03.541176+0000","last_became_peered":"2024-01-19T05:18:03.541176+0000","last_unstale":"2024-01-19T05:18:04.729005+0000","last_undegraded":"2024-01-19T05:18:04.729005+0000","last_fullsized":"2024-01-19T05:18:04.729005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730990+0000","last_change":"2024-01-19T05:18:02.657034+0000","last_active":"2024-01-19T05:18:04.730990+0000","last_peered":"2024-01-19T05:18:04.730990+0000","last_clean":"2024-01-19T05:18:04.730990+0000","last_became_active":"2024-01-19T05:18:02.656500+0000","last_became_peered":"2024-01-19T05:18:02.656500+0000","last_unstale":"2024-01-19T05:18:04.730990+0000","last_undegraded":"2024-01-19T05:18:04.730990+0000","last_fullsized":"2024-01-19T05:18:04.730990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512764+0000","last_change":"2024-01-19T05:18:03.544242+0000","last_active":"2024-01-19T05:18:04.512764+0000","last_peered":"2024-01-19T05:18:04.512764+0000","last_clean":"2024-01-19T05:18:04.512764+0000","last_became_active":"2024-01-19T05:18:03.543438+0000","last_became_peered":"2024-01-19T05:18:03.543438+0000","last_unstale":"2024-01-19T05:18:04.512764+0000","last_undegraded":"2024-01-19T05:18:04.512764+0000","last_fullsized":"2024-01-19T05:18:04.512764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515016+0000","last_change":"2024-01-19T05:18:02.653594+0000","last_active":"2024-01-19T05:18:04.515016+0000","last_peered":"2024-01-19T05:18:04.515016+0000","last_clean":"2024-01-19T05:18:04.515016+0000","last_became_active":"2024-01-19T05:18:02.653182+0000","last_became_peered":"2024-01-19T05:18:02.653182+0000","last_unstale":"2024-01-19T05:18:04.515016+0000","last_undegraded":"2024-01-19T05:18:04.515016+0000","last_fullsized":"2024-01-19T05:18:04.515016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730837+0000","last_change":"2024-01-19T05:18:03.562845+0000","last_active":"2024-01-19T05:18:04.730837+0000","last_peered":"2024-01-19T05:18:04.730837+0000","last_clean":"2024-01-19T05:18:04.730837+0000","last_became_active":"2024-01-19T05:18:03.562235+0000","last_became_peered":"2024-01-19T05:18:03.562235+0000","last_unstale":"2024-01-19T05:18:04.730837+0000","last_undegraded":"2024-01-19T05:18:04.730837+0000","last_fullsized":"2024-01-19T05:18:04.730837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731055+0000","last_change":"2024-01-19T05:18:02.660025+0000","last_active":"2024-01-19T05:18:04.731055+0000","last_peered":"2024-01-19T05:18:04.731055+0000","last_clean":"2024-01-19T05:18:04.731055+0000","last_became_active":"2024-01-19T05:18:02.659546+0000","last_became_peered":"2024-01-19T05:18:02.659546+0000","last_unstale":"2024-01-19T05:18:04.731055+0000","last_undegraded":"2024-01-19T05:18:04.731055+0000","last_fullsized":"2024-01-19T05:18:04.731055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:56.624468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728512+0000","last_change":"2024-01-19T05:18:03.568936+0000","last_active":"2024-01-19T05:18:04.728512+0000","last_peered":"2024-01-19T05:18:04.728512+0000","last_clean":"2024-01-19T05:18:04.728512+0000","last_became_active":"2024-01-19T05:18:03.568337+0000","last_became_peered":"2024-01-19T05:18:03.568337+0000","last_unstale":"2024-01-19T05:18:04.728512+0000","last_undegraded":"2024-01-19T05:18:04.728512+0000","last_fullsized":"2024-01-19T05:18:04.728512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513376+0000","last_change":"2024-01-19T05:18:02.661567+0000","last_active":"2024-01-19T05:18:04.513376+0000","last_peered":"2024-01-19T05:18:04.513376+0000","last_clean":"2024-01-19T05:18:04.513376+0000","last_became_active":"2024-01-19T05:18:02.660906+0000","last_became_peered":"2024-01-19T05:18:02.660906+0000","last_unstale":"2024-01-19T05:18:04.513376+0000","last_undegraded":"2024-01-19T05:18:04.513376+0000","last_fullsized":"2024-01-19T05:18:04.513376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516234+0000","last_change":"2024-01-19T05:18:03.548080+0000","last_active":"2024-01-19T05:18:04.516234+0000","last_peered":"2024-01-19T05:18:04.516234+0000","last_clean":"2024-01-19T05:18:04.516234+0000","last_became_active":"2024-01-19T05:18:03.547506+0000","last_became_peered":"2024-01-19T05:18:03.547506+0000","last_unstale":"2024-01-19T05:18:04.516234+0000","last_undegraded":"2024-01-19T05:18:04.516234+0000","last_fullsized":"2024-01-19T05:18:04.516234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514989+0000","last_change":"2024-01-19T05:18:02.660672+0000","last_active":"2024-01-19T05:18:04.514989+0000","last_peered":"2024-01-19T05:18:04.514989+0000","last_clean":"2024-01-19T05:18:04.514989+0000","last_became_active":"2024-01-19T05:18:02.659596+0000","last_became_peered":"2024-01-19T05:18:02.659596+0000","last_unstale":"2024-01-19T05:18:04.514989+0000","last_undegraded":"2024-01-19T05:18:04.514989+0000","last_fullsized":"2024-01-19T05:18:04.514989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729720+0000","last_change":"2024-01-19T05:18:03.550622+0000","last_active":"2024-01-19T05:18:04.729720+0000","last_peered":"2024-01-19T05:18:04.729720+0000","last_clean":"2024-01-19T05:18:04.729720+0000","last_became_active":"2024-01-19T05:18:03.548243+0000","last_became_peered":"2024-01-19T05:18:03.548243+0000","last_unstale":"2024-01-19T05:18:04.729720+0000","last_undegraded":"2024-01-19T05:18:04.729720+0000","last_fullsized":"2024-01-19T05:18:04.729720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728733+0000","last_change":"2024-01-19T05:18:02.653694+0000","last_active":"2024-01-19T05:18:04.728733+0000","last_peered":"2024-01-19T05:18:04.728733+0000","last_clean":"2024-01-19T05:18:04.728733+0000","last_became_active":"2024-01-19T05:18:02.653236+0000","last_became_peered":"2024-01-19T05:18:02.653236+0000","last_unstale":"2024-01-19T05:18:04.728733+0000","last_undegraded":"2024-01-19T05:18:04.728733+0000","last_fullsized":"2024-01-19T05:18:04.728733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728870+0000","last_change":"2024-01-19T05:18:03.541272+0000","last_active":"2024-01-19T05:18:04.728870+0000","last_peered":"2024-01-19T05:18:04.728870+0000","last_clean":"2024-01-19T05:18:04.728870+0000","last_became_active":"2024-01-19T05:18:03.540187+0000","last_became_peered":"2024-01-19T05:18:03.540187+0000","last_unstale":"2024-01-19T05:18:04.728870+0000","last_undegraded":"2024-01-19T05:18:04.728870+0000","last_fullsized":"2024-01-19T05:18:04.728870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731175+0000","last_change":"2024-01-19T05:18:02.662629+0000","last_active":"2024-01-19T05:18:04.731175+0000","last_peered":"2024-01-19T05:18:04.731175+0000","last_clean":"2024-01-19T05:18:04.731175+0000","last_became_active":"2024-01-19T05:18:02.662095+0000","last_became_peered":"2024-01-19T05:18:02.662095+0000","last_unstale":"2024-01-19T05:18:04.731175+0000","last_undegraded":"2024-01-19T05:18:04.731175+0000","last_fullsized":"2024-01-19T05:18:04.731175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:03.589258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729878+0000","last_change":"2024-01-19T05:18:03.543853+0000","last_active":"2024-01-19T05:18:04.729878+0000","last_peered":"2024-01-19T05:18:04.729878+0000","last_clean":"2024-01-19T05:18:04.729878+0000","last_became_active":"2024-01-19T05:18:03.543119+0000","last_became_peered":"2024-01-19T05:18:03.543119+0000","last_unstale":"2024-01-19T05:18:04.729878+0000","last_undegraded":"2024-01-19T05:18:04.729878+0000","last_fullsized":"2024-01-19T05:18:04.729878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513670+0000","last_change":"2024-01-19T05:18:02.657695+0000","last_active":"2024-01-19T05:18:04.513670+0000","last_peered":"2024-01-19T05:18:04.513670+0000","last_clean":"2024-01-19T05:18:04.513670+0000","last_became_active":"2024-01-19T05:18:02.656870+0000","last_became_peered":"2024-01-19T05:18:02.656870+0000","last_unstale":"2024-01-19T05:18:04.513670+0000","last_undegraded":"2024-01-19T05:18:04.513670+0000","last_fullsized":"2024-01-19T05:18:04.513670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513835+0000","last_change":"2024-01-19T05:18:03.534680+0000","last_active":"2024-01-19T05:18:04.513835+0000","last_peered":"2024-01-19T05:18:04.513835+0000","last_clean":"2024-01-19T05:18:04.513835+0000","last_became_active":"2024-01-19T05:18:03.533937+0000","last_became_peered":"2024-01-19T05:18:03.533937+0000","last_unstale":"2024-01-19T05:18:04.513835+0000","last_undegraded":"2024-01-19T05:18:04.513835+0000","last_fullsized":"2024-01-19T05:18:04.513835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727901+0000","last_change":"2024-01-19T05:18:02.650559+0000","last_active":"2024-01-19T05:18:04.727901+0000","last_peered":"2024-01-19T05:18:04.727901+0000","last_clean":"2024-01-19T05:18:04.727901+0000","last_became_active":"2024-01-19T05:18:02.649764+0000","last_became_peered":"2024-01-19T05:18:02.649764+0000","last_unstale":"2024-01-19T05:18:04.727901+0000","last_undegraded":"2024-01-19T05:18:04.727901+0000","last_fullsized":"2024-01-19T05:18:04.727901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729375+0000","last_change":"2024-01-19T05:18:03.550709+0000","last_active":"2024-01-19T05:18:04.729375+0000","last_peered":"2024-01-19T05:18:04.729375+0000","last_clean":"2024-01-19T05:18:04.729375+0000","last_became_active":"2024-01-19T05:18:03.550073+0000","last_became_peered":"2024-01-19T05:18:03.550073+0000","last_unstale":"2024-01-19T05:18:04.729375+0000","last_undegraded":"2024-01-19T05:18:04.729375+0000","last_fullsized":"2024-01-19T05:18:04.729375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516191+0000","last_change":"2024-01-19T05:18:02.655120+0000","last_active":"2024-01-19T05:18:04.516191+0000","last_peered":"2024-01-19T05:18:04.516191+0000","last_clean":"2024-01-19T05:18:04.516191+0000","last_became_active":"2024-01-19T05:18:02.654360+0000","last_became_peered":"2024-01-19T05:18:02.654360+0000","last_unstale":"2024-01-19T05:18:04.516191+0000","last_undegraded":"2024-01-19T05:18:04.516191+0000","last_fullsized":"2024-01-19T05:18:04.516191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:32:02.214385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730500+0000","last_change":"2024-01-19T05:18:03.543739+0000","last_active":"2024-01-19T05:18:04.730500+0000","last_peered":"2024-01-19T05:18:04.730500+0000","last_clean":"2024-01-19T05:18:04.730500+0000","last_became_active":"2024-01-19T05:18:03.543142+0000","last_became_peered":"2024-01-19T05:18:03.543142+0000","last_unstale":"2024-01-19T05:18:04.730500+0000","last_undegraded":"2024-01-19T05:18:04.730500+0000","last_fullsized":"2024-01-19T05:18:04.730500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728061+0000","last_change":"2024-01-19T05:18:02.662915+0000","last_active":"2024-01-19T05:18:04.728061+0000","last_peered":"2024-01-19T05:18:04.728061+0000","last_clean":"2024-01-19T05:18:04.728061+0000","last_became_active":"2024-01-19T05:18:02.662617+0000","last_became_peered":"2024-01-19T05:18:02.662617+0000","last_unstale":"2024-01-19T05:18:04.728061+0000","last_undegraded":"2024-01-19T05:18:04.728061+0000","last_fullsized":"2024-01-19T05:18:04.728061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729905+0000","last_change":"2024-01-19T05:18:03.543521+0000","last_active":"2024-01-19T05:18:04.729905+0000","last_peered":"2024-01-19T05:18:04.729905+0000","last_clean":"2024-01-19T05:18:04.729905+0000","last_became_active":"2024-01-19T05:18:03.542803+0000","last_became_peered":"2024-01-19T05:18:03.542803+0000","last_unstale":"2024-01-19T05:18:04.729905+0000","last_undegraded":"2024-01-19T05:18:04.729905+0000","last_fullsized":"2024-01-19T05:18:04.729905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513101+0000","last_change":"2024-01-19T05:18:02.650642+0000","last_active":"2024-01-19T05:18:04.513101+0000","last_peered":"2024-01-19T05:18:04.513101+0000","last_clean":"2024-01-19T05:18:04.513101+0000","last_became_active":"2024-01-19T05:18:02.650319+0000","last_became_peered":"2024-01-19T05:18:02.650319+0000","last_unstale":"2024-01-19T05:18:04.513101+0000","last_undegraded":"2024-01-19T05:18:04.513101+0000","last_fullsized":"2024-01-19T05:18:04.513101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.565837+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.564725+0000","last_became_peered":"2024-01-19T05:18:03.564725+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727937+0000","last_change":"2024-01-19T05:18:02.656957+0000","last_active":"2024-01-19T05:18:04.727937+0000","last_peered":"2024-01-19T05:18:04.727937+0000","last_clean":"2024-01-19T05:18:04.727937+0000","last_became_active":"2024-01-19T05:18:02.656536+0000","last_became_peered":"2024-01-19T05:18:02.656536+0000","last_unstale":"2024-01-19T05:18:04.727937+0000","last_undegraded":"2024-01-19T05:18:04.727937+0000","last_fullsized":"2024-01-19T05:18:04.727937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729922+0000","last_change":"2024-01-19T05:18:03.571256+0000","last_active":"2024-01-19T05:18:04.729922+0000","last_peered":"2024-01-19T05:18:04.729922+0000","last_clean":"2024-01-19T05:18:04.729922+0000","last_became_active":"2024-01-19T05:18:03.570499+0000","last_became_peered":"2024-01-19T05:18:03.570499+0000","last_unstale":"2024-01-19T05:18:04.729922+0000","last_undegraded":"2024-01-19T05:18:04.729922+0000","last_fullsized":"2024-01-19T05:18:04.729922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-19T05:18:03.520367+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:03.520367+0000","last_peered":"2024-01-19T05:18:03.520367+0000","last_clean":"2024-01-19T05:18:03.520367+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:03.520367+0000","last_undegraded":"2024-01-19T05:18:03.520367+0000","last_fullsized":"2024-01-19T05:18:03.520367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730433+0000","last_change":"2024-01-19T05:18:02.650789+0000","last_active":"2024-01-19T05:18:04.730433+0000","last_peered":"2024-01-19T05:18:04.730433+0000","last_clean":"2024-01-19T05:18:04.730433+0000","last_became_active":"2024-01-19T05:18:02.649923+0000","last_became_peered":"2024-01-19T05:18:02.649923+0000","last_unstale":"2024-01-19T05:18:04.730433+0000","last_undegraded":"2024-01-19T05:18:04.730433+0000","last_fullsized":"2024-01-19T05:18:04.730433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:12.078445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729614+0000","last_change":"2024-01-19T05:18:03.569109+0000","last_active":"2024-01-19T05:18:04.729614+0000","last_peered":"2024-01-19T05:18:04.729614+0000","last_clean":"2024-01-19T05:18:04.729614+0000","last_became_active":"2024-01-19T05:18:03.568602+0000","last_became_peered":"2024-01-19T05:18:03.568602+0000","last_unstale":"2024-01-19T05:18:04.729614+0000","last_undegraded":"2024-01-19T05:18:04.729614+0000","last_fullsized":"2024-01-19T05:18:04.729614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729626+0000","last_change":"2024-01-19T05:18:02.671990+0000","last_active":"2024-01-19T05:18:04.729626+0000","last_peered":"2024-01-19T05:18:04.729626+0000","last_clean":"2024-01-19T05:18:04.729626+0000","last_became_active":"2024-01-19T05:18:02.671477+0000","last_became_peered":"2024-01-19T05:18:02.671477+0000","last_unstale":"2024-01-19T05:18:04.729626+0000","last_undegraded":"2024-01-19T05:18:04.729626+0000","last_fullsized":"2024-01-19T05:18:04.729626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728522+0000","last_change":"2024-01-19T05:18:03.551760+0000","last_active":"2024-01-19T05:18:04.728522+0000","last_peered":"2024-01-19T05:18:04.728522+0000","last_clean":"2024-01-19T05:18:04.728522+0000","last_became_active":"2024-01-19T05:18:03.550881+0000","last_became_peered":"2024-01-19T05:18:03.550881+0000","last_unstale":"2024-01-19T05:18:04.728522+0000","last_undegraded":"2024-01-19T05:18:04.728522+0000","last_fullsized":"2024-01-19T05:18:04.728522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727890+0000","last_change":"2024-01-19T05:18:02.663101+0000","last_active":"2024-01-19T05:18:04.727890+0000","last_peered":"2024-01-19T05:18:04.727890+0000","last_clean":"2024-01-19T05:18:04.727890+0000","last_became_active":"2024-01-19T05:18:02.662604+0000","last_became_peered":"2024-01-19T05:18:02.662604+0000","last_unstale":"2024-01-19T05:18:04.727890+0000","last_undegraded":"2024-01-19T05:18:04.727890+0000","last_fullsized":"2024-01-19T05:18:04.727890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512852+0000","last_change":"2024-01-19T05:18:03.537638+0000","last_active":"2024-01-19T05:18:04.512852+0000","last_peered":"2024-01-19T05:18:04.512852+0000","last_clean":"2024-01-19T05:18:04.512852+0000","last_became_active":"2024-01-19T05:18:03.536862+0000","last_became_peered":"2024-01-19T05:18:03.536862+0000","last_unstale":"2024-01-19T05:18:04.512852+0000","last_undegraded":"2024-01-19T05:18:04.512852+0000","last_fullsized":"2024-01-19T05:18:04.512852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731398+0000","last_change":"2024-01-19T05:18:02.655462+0000","last_active":"2024-01-19T05:18:04.731398+0000","last_peered":"2024-01-19T05:18:04.731398+0000","last_clean":"2024-01-19T05:18:04.731398+0000","last_became_active":"2024-01-19T05:18:02.654363+0000","last_became_peered":"2024-01-19T05:18:02.654363+0000","last_unstale":"2024-01-19T05:18:04.731398+0000","last_undegraded":"2024-01-19T05:18:04.731398+0000","last_fullsized":"2024-01-19T05:18:04.731398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:40.854099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515031+0000","last_change":"2024-01-19T05:18:03.540906+0000","last_active":"2024-01-19T05:18:04.515031+0000","last_peered":"2024-01-19T05:18:04.515031+0000","last_clean":"2024-01-19T05:18:04.515031+0000","last_became_active":"2024-01-19T05:18:03.540116+0000","last_became_peered":"2024-01-19T05:18:03.540116+0000","last_unstale":"2024-01-19T05:18:04.515031+0000","last_undegraded":"2024-01-19T05:18:04.515031+0000","last_fullsized":"2024-01-19T05:18:04.515031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:37.646122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512849+0000","last_change":"2024-01-19T05:18:02.657808+0000","last_active":"2024-01-19T05:18:04.512849+0000","last_peered":"2024-01-19T05:18:04.512849+0000","last_clean":"2024-01-19T05:18:04.512849+0000","last_became_active":"2024-01-19T05:18:02.657357+0000","last_became_peered":"2024-01-19T05:18:02.657357+0000","last_unstale":"2024-01-19T05:18:04.512849+0000","last_undegraded":"2024-01-19T05:18:04.512849+0000","last_fullsized":"2024-01-19T05:18:04.512849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.566199+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.565571+0000","last_became_peered":"2024-01-19T05:18:03.565571+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730213+0000","last_change":"2024-01-19T05:18:02.674805+0000","last_active":"2024-01-19T05:18:04.730213+0000","last_peered":"2024-01-19T05:18:04.730213+0000","last_clean":"2024-01-19T05:18:04.730213+0000","last_became_active":"2024-01-19T05:18:02.674331+0000","last_became_peered":"2024-01-19T05:18:02.674331+0000","last_unstale":"2024-01-19T05:18:04.730213+0000","last_undegraded":"2024-01-19T05:18:04.730213+0000","last_fullsized":"2024-01-19T05:18:04.730213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513263+0000","last_change":"2024-01-19T05:18:03.535625+0000","last_active":"2024-01-19T05:18:04.513263+0000","last_peered":"2024-01-19T05:18:04.513263+0000","last_clean":"2024-01-19T05:18:04.513263+0000","last_became_active":"2024-01-19T05:18:03.534935+0000","last_became_peered":"2024-01-19T05:18:03.534935+0000","last_unstale":"2024-01-19T05:18:04.513263+0000","last_undegraded":"2024-01-19T05:18:04.513263+0000","last_fullsized":"2024-01-19T05:18:04.513263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:05.378485+0000","last_change":"2024-01-19T05:18:02.660485+0000","last_active":"2024-01-19T05:18:05.378485+0000","last_peered":"2024-01-19T05:18:05.378485+0000","last_clean":"2024-01-19T05:18:05.378485+0000","last_became_active":"2024-01-19T05:18:02.660172+0000","last_became_peered":"2024-01-19T05:18:02.660172+0000","last_unstale":"2024-01-19T05:18:05.378485+0000","last_undegraded":"2024-01-19T05:18:05.378485+0000","last_fullsized":"2024-01-19T05:18:05.378485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730089+0000","last_change":"2024-01-19T05:18:03.549395+0000","last_active":"2024-01-19T05:18:04.730089+0000","last_peered":"2024-01-19T05:18:04.730089+0000","last_clean":"2024-01-19T05:18:04.730089+0000","last_became_active":"2024-01-19T05:18:03.548645+0000","last_became_peered":"2024-01-19T05:18:03.548645+0000","last_unstale":"2024-01-19T05:18:04.730089+0000","last_undegraded":"2024-01-19T05:18:04.730089+0000","last_fullsized":"2024-01-19T05:18:04.730089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515120+0000","last_change":"2024-01-19T05:18:02.665544+0000","last_active":"2024-01-19T05:18:04.515120+0000","last_peered":"2024-01-19T05:18:04.515120+0000","last_clean":"2024-01-19T05:18:04.515120+0000","last_became_active":"2024-01-19T05:18:02.665011+0000","last_became_peered":"2024-01-19T05:18:02.665011+0000","last_unstale":"2024-01-19T05:18:04.515120+0000","last_undegraded":"2024-01-19T05:18:04.515120+0000","last_fullsized":"2024-01-19T05:18:04.515120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728406+0000","last_change":"2024-01-19T05:18:03.546972+0000","last_active":"2024-01-19T05:18:04.728406+0000","last_peered":"2024-01-19T05:18:04.728406+0000","last_clean":"2024-01-19T05:18:04.728406+0000","last_became_active":"2024-01-19T05:18:03.546258+0000","last_became_peered":"2024-01-19T05:18:03.546258+0000","last_unstale":"2024-01-19T05:18:04.728406+0000","last_undegraded":"2024-01-19T05:18:04.728406+0000","last_fullsized":"2024-01-19T05:18:04.728406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728783+0000","last_change":"2024-01-19T05:18:02.668468+0000","last_active":"2024-01-19T05:18:04.728783+0000","last_peered":"2024-01-19T05:18:04.728783+0000","last_clean":"2024-01-19T05:18:04.728783+0000","last_became_active":"2024-01-19T05:18:02.668005+0000","last_became_peered":"2024-01-19T05:18:02.668005+0000","last_unstale":"2024-01-19T05:18:04.728783+0000","last_undegraded":"2024-01-19T05:18:04.728783+0000","last_fullsized":"2024-01-19T05:18:04.728783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514090+0000","last_change":"2024-01-19T05:18:03.545257+0000","last_active":"2024-01-19T05:18:04.514090+0000","last_peered":"2024-01-19T05:18:04.514090+0000","last_clean":"2024-01-19T05:18:04.514090+0000","last_became_active":"2024-01-19T05:18:03.542709+0000","last_became_peered":"2024-01-19T05:18:03.542709+0000","last_unstale":"2024-01-19T05:18:04.514090+0000","last_undegraded":"2024-01-19T05:18:04.514090+0000","last_fullsized":"2024-01-19T05:18:04.514090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:31.698937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512995+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.512995+0000","last_peered":"2024-01-19T05:18:04.512995+0000","last_clean":"2024-01-19T05:18:04.512995+0000","last_became_active":"2024-01-19T05:18:02.664286+0000","last_became_peered":"2024-01-19T05:18:02.664286+0000","last_unstale":"2024-01-19T05:18:04.512995+0000","last_undegraded":"2024-01-19T05:18:04.512995+0000","last_fullsized":"2024-01-19T05:18:04.512995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729156+0000","last_change":"2024-01-19T05:18:03.554862+0000","last_active":"2024-01-19T05:18:04.729156+0000","last_peered":"2024-01-19T05:18:04.729156+0000","last_clean":"2024-01-19T05:18:04.729156+0000","last_became_active":"2024-01-19T05:18:03.550546+0000","last_became_peered":"2024-01-19T05:18:03.550546+0000","last_unstale":"2024-01-19T05:18:04.729156+0000","last_undegraded":"2024-01-19T05:18:04.729156+0000","last_fullsized":"2024-01-19T05:18:04.729156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513140+0000","last_change":"2024-01-19T05:18:02.663145+0000","last_active":"2024-01-19T05:18:04.513140+0000","last_peered":"2024-01-19T05:18:04.513140+0000","last_clean":"2024-01-19T05:18:04.513140+0000","last_became_active":"2024-01-19T05:18:02.662788+0000","last_became_peered":"2024-01-19T05:18:02.662788+0000","last_unstale":"2024-01-19T05:18:04.513140+0000","last_undegraded":"2024-01-19T05:18:04.513140+0000","last_fullsized":"2024-01-19T05:18:04.513140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729679+0000","last_change":"2024-01-19T05:18:03.551324+0000","last_active":"2024-01-19T05:18:04.729679+0000","last_peered":"2024-01-19T05:18:04.729679+0000","last_clean":"2024-01-19T05:18:04.729679+0000","last_became_active":"2024-01-19T05:18:03.549215+0000","last_became_peered":"2024-01-19T05:18:03.549215+0000","last_unstale":"2024-01-19T05:18:04.729679+0000","last_undegraded":"2024-01-19T05:18:04.729679+0000","last_fullsized":"2024-01-19T05:18:04.729679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730060+0000","last_change":"2024-01-19T05:18:02.670360+0000","last_active":"2024-01-19T05:18:04.730060+0000","last_peered":"2024-01-19T05:18:04.730060+0000","last_clean":"2024-01-19T05:18:04.730060+0000","last_became_active":"2024-01-19T05:18:02.669751+0000","last_became_peered":"2024-01-19T05:18:02.669751+0000","last_unstale":"2024-01-19T05:18:04.730060+0000","last_undegraded":"2024-01-19T05:18:04.730060+0000","last_fullsized":"2024-01-19T05:18:04.730060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513640+0000","last_change":"2024-01-19T05:18:03.531197+0000","last_active":"2024-01-19T05:18:04.513640+0000","last_peered":"2024-01-19T05:18:04.513640+0000","last_clean":"2024-01-19T05:18:04.513640+0000","last_became_active":"2024-01-19T05:18:03.530484+0000","last_became_peered":"2024-01-19T05:18:03.530484+0000","last_unstale":"2024-01-19T05:18:04.513640+0000","last_undegraded":"2024-01-19T05:18:04.513640+0000","last_fullsized":"2024-01-19T05:18:04.513640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731287+0000","last_change":"2024-01-19T05:18:03.562891+0000","last_active":"2024-01-19T05:18:04.731287+0000","last_peered":"2024-01-19T05:18:04.731287+0000","last_clean":"2024-01-19T05:18:04.731287+0000","last_became_active":"2024-01-19T05:18:03.558374+0000","last_became_peered":"2024-01-19T05:18:03.558374+0000","last_unstale":"2024-01-19T05:18:04.731287+0000","last_undegraded":"2024-01-19T05:18:04.731287+0000","last_fullsized":"2024-01-19T05:18:04.731287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729394+0000","last_change":"2024-01-19T05:18:02.672001+0000","last_active":"2024-01-19T05:18:04.729394+0000","last_peered":"2024-01-19T05:18:04.729394+0000","last_clean":"2024-01-19T05:18:04.729394+0000","last_became_active":"2024-01-19T05:18:02.671437+0000","last_became_peered":"2024-01-19T05:18:02.671437+0000","last_unstale":"2024-01-19T05:18:04.729394+0000","last_undegraded":"2024-01-19T05:18:04.729394+0000","last_fullsized":"2024-01-19T05:18:04.729394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731196+0000","last_change":"2024-01-19T05:18:03.565321+0000","last_active":"2024-01-19T05:18:04.731196+0000","last_peered":"2024-01-19T05:18:04.731196+0000","last_clean":"2024-01-19T05:18:04.731196+0000","last_became_active":"2024-01-19T05:18:03.563207+0000","last_became_peered":"2024-01-19T05:18:03.563207+0000","last_unstale":"2024-01-19T05:18:04.731196+0000","last_undegraded":"2024-01-19T05:18:04.731196+0000","last_fullsized":"2024-01-19T05:18:04.731196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729996+0000","last_change":"2024-01-19T05:18:02.673614+0000","last_active":"2024-01-19T05:18:04.729996+0000","last_peered":"2024-01-19T05:18:04.729996+0000","last_clean":"2024-01-19T05:18:04.729996+0000","last_became_active":"2024-01-19T05:18:02.673106+0000","last_became_peered":"2024-01-19T05:18:02.673106+0000","last_unstale":"2024-01-19T05:18:04.729996+0000","last_undegraded":"2024-01-19T05:18:04.729996+0000","last_fullsized":"2024-01-19T05:18:04.729996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728334+0000","last_change":"2024-01-19T05:18:03.570972+0000","last_active":"2024-01-19T05:18:04.728334+0000","last_peered":"2024-01-19T05:18:04.728334+0000","last_clean":"2024-01-19T05:18:04.728334+0000","last_became_active":"2024-01-19T05:18:03.570555+0000","last_became_peered":"2024-01-19T05:18:03.570555+0000","last_unstale":"2024-01-19T05:18:04.728334+0000","last_undegraded":"2024-01-19T05:18:04.728334+0000","last_fullsized":"2024-01-19T05:18:04.728334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:41.862758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729948+0000","last_change":"2024-01-19T05:18:02.661127+0000","last_active":"2024-01-19T05:18:04.729948+0000","last_peered":"2024-01-19T05:18:04.729948+0000","last_clean":"2024-01-19T05:18:04.729948+0000","last_became_active":"2024-01-19T05:18:02.660171+0000","last_became_peered":"2024-01-19T05:18:02.660171+0000","last_unstale":"2024-01-19T05:18:04.729948+0000","last_undegraded":"2024-01-19T05:18:04.729948+0000","last_fullsized":"2024-01-19T05:18:04.729948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729899+0000","last_change":"2024-01-19T05:18:03.546643+0000","last_active":"2024-01-19T05:18:04.729899+0000","last_peered":"2024-01-19T05:18:04.729899+0000","last_clean":"2024-01-19T05:18:04.729899+0000","last_became_active":"2024-01-19T05:18:03.545889+0000","last_became_peered":"2024-01-19T05:18:03.545889+0000","last_unstale":"2024-01-19T05:18:04.729899+0000","last_undegraded":"2024-01-19T05:18:04.729899+0000","last_fullsized":"2024-01-19T05:18:04.729899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728691+0000","last_change":"2024-01-19T05:18:02.666057+0000","last_active":"2024-01-19T05:18:04.728691+0000","last_peered":"2024-01-19T05:18:04.728691+0000","last_clean":"2024-01-19T05:18:04.728691+0000","last_became_active":"2024-01-19T05:18:02.665663+0000","last_became_peered":"2024-01-19T05:18:02.665663+0000","last_unstale":"2024-01-19T05:18:04.728691+0000","last_undegraded":"2024-01-19T05:18:04.728691+0000","last_fullsized":"2024-01-19T05:18:04.728691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:11.474 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T05:18:11.474 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-19T05:18:11.474 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-19T05:18:11.475 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-19T05:18:11.475 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-19T05:18:11.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.630+0000 7f696f987640 1 Processor -- start 2024-01-19T05:18:11.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.630+0000 7f696f987640 1 -- start start 2024-01-19T05:18:11.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696f987640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696806a940 0x7f696809e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696f987640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f696809d6c0 0x7f696813e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696f987640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f696809db20 0x7f696813ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696f987640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69680b4180 con 0x7f696809d6c0 2024-01-19T05:18:11.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696f987640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69680b49e0 con 0x7f696809db20 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696f987640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696809cc50 con 0x7f696806a940 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696cf22640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f696809d6c0 0x7f696813e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696cf22640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f696809d6c0 0x7f696813e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55700/0 (socket says 172.21.15.99:55700) 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696cf22640 1 -- 172.21.15.99:0/3109378829 learned_addr learned my addr 172.21.15.99:0/3109378829 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696df24640 1 --2- 172.21.15.99:0/3109378829 >> v2:172.21.15.157:3300/0 conn(0x7f696809db20 0x7f696813ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696d723640 1 --2- 172.21.15.99:0/3109378829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696806a940 0x7f696809e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696cf22640 1 -- 172.21.15.99:0/3109378829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696806a940 msgr2=0x7f696809e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696cf22640 1 --2- 172.21.15.99:0/3109378829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696806a940 0x7f696809e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696cf22640 1 -- 172.21.15.99:0/3109378829 >> v2:172.21.15.157:3300/0 conn(0x7f696809db20 msgr2=0x7f696813ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696cf22640 1 --2- 172.21.15.99:0/3109378829 >> v2:172.21.15.157:3300/0 conn(0x7f696809db20 0x7f696813ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696cf22640 1 -- 172.21.15.99:0/3109378829 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696806ad20 con 0x7f696809d6c0 2024-01-19T05:18:11.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.634+0000 7f696df24640 1 --2- 172.21.15.99:0/3109378829 >> v2:172.21.15.157:3300/0 conn(0x7f696809db20 0x7f696813ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:11.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696cf22640 1 --2- 172.21.15.99:0/3109378829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809d6c0 0x7f696813e540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69680ba0d0 tx=0x7f696401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f6a8f71dc4eb2e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:11.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f695ffff640 1 -- 172.21.15.99:0/3109378829 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640ab600 con 0x7f696809d6c0 2024-01-19T05:18:11.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f695ffff640 1 -- 172.21.15.99:0/3109378829 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640ab760 con 0x7f696809d6c0 2024-01-19T05:18:11.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f695ffff640 1 -- 172.21.15.99:0/3109378829 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640abaf0 con 0x7f696809d6c0 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- 172.21.15.99:0/3109378829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809d6c0 msgr2=0x7f696813e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 --2- 172.21.15.99:0/3109378829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809d6c0 0x7f696813e540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69680ba0d0 tx=0x7f696401c440 comp rx=0 tx=0).stop 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- 172.21.15.99:0/3109378829 shutdown_connections 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 --2- 172.21.15.99:0/3109378829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809d6c0 0x7f696813e540 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 --2- 172.21.15.99:0/3109378829 >> v2:172.21.15.157:3300/0 conn(0x7f696809db20 0x7f696813ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 --2- 172.21.15.99:0/3109378829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696806a940 0x7f696809e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- 172.21.15.99:0/3109378829 >> 172.21.15.99:0/3109378829 conn(0x7f6968066ef0 msgr2=0x7f69680b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- 172.21.15.99:0/3109378829 shutdown_connections 2024-01-19T05:18:11.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- 172.21.15.99:0/3109378829 wait complete. 2024-01-19T05:18:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 Processor -- start 2024-01-19T05:18:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- start start 2024-01-19T05:18:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f696806a940 0x7f6968135760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696809d6c0 0x7f6968137190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809db20 0x7f69681dfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69681e0ce0 con 0x7f696809db20 2024-01-19T05:18:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69681e02a0 con 0x7f696806a940 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696f987640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696812f5f0 con 0x7f696809d6c0 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809db20 0x7f69681dfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809db20 0x7f69681dfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55710/0 (socket says 172.21.15.99:55710) 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 -- 172.21.15.99:0/3963602537 learned_addr learned my addr 172.21.15.99:0/3963602537 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696d723640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f696806a940 0x7f6968135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696cf22640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696809d6c0 0x7f6968137190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 -- 172.21.15.99:0/3963602537 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696809d6c0 msgr2=0x7f6968137190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696809d6c0 0x7f6968137190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 -- 172.21.15.99:0/3963602537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f696806a940 msgr2=0x7f6968135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f696806a940 0x7f6968135760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 -- 172.21.15.99:0/3963602537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640094d0 con 0x7f696809db20 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f696df24640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809db20 0x7f69681dfd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f696000cdb0 tx=0x7f696000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.638+0000 7f695dffb640 1 -- 172.21.15.99:0/3963602537 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000f680 con 0x7f696809db20 2024-01-19T05:18:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f695dffb640 1 -- 172.21.15.99:0/3963602537 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696000f800 con 0x7f696809db20 2024-01-19T05:18:11.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6968131aa0 con 0x7f696809db20 2024-01-19T05:18:11.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f695dffb640 1 -- 172.21.15.99:0/3963602537 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000fbb0 con 0x7f696809db20 2024-01-19T05:18:11.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69680b89c0 con 0x7f696809db20 2024-01-19T05:18:11.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69681318e0 con 0x7f696809db20 2024-01-19T05:18:11.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f695dffb640 1 -- 172.21.15.99:0/3963602537 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f696000b040 con 0x7f696809db20 2024-01-19T05:18:11.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f695dffb640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f694c066530 0x7f694c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f696d723640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f694c066530 0x7f694c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f695dffb640 1 -- 172.21.15.99:0/3963602537 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6960084740 con 0x7f696809db20 2024-01-19T05:18:11.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.642+0000 7f696d723640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f694c066530 0x7f694c0689f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f695800b9d0 tx=0x7f6958008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:11.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.646+0000 7f695dffb640 1 -- 172.21.15.99:0/3963602537 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6960051a70 con 0x7f696809db20 2024-01-19T05:18:11.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.846+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f69680696e0 con 0x7f696809db20 2024-01-19T05:18:11.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f695dffb640 1 -- 172.21.15.99:0/3963602537 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164169 (secure 0 0 0) 0x7f6960055090 con 0x7f696809db20 2024-01-19T05:18:11.851 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f694c066530 msgr2=0x7f694c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f694c066530 0x7f694c0689f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f695800b9d0 tx=0x7f6958008040 comp rx=0 tx=0).stop 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809db20 msgr2=0x7f69681dfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809db20 0x7f69681dfd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f696000cdb0 tx=0x7f696000a650 comp rx=0 tx=0).stop 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 shutdown_connections 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f694c066530 0x7f694c0689f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f696809db20 0x7f69681dfd60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f696809d6c0 0x7f6968137190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 --2- 172.21.15.99:0/3963602537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f696806a940 0x7f6968135760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 >> 172.21.15.99:0/3963602537 conn(0x7f6968066ef0 msgr2=0x7f6968146ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 shutdown_connections 2024-01-19T05:18:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.850+0000 7f696f987640 1 -- 172.21.15.99:0/3963602537 wait complete. 2024-01-19T05:18:11.867 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":5,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2084845362},{"type":"v1","addr":"172.21.15.99:6833","nonce":2084845362}]},"active_addr":"172.21.15.99:6833/2084845362","active_change":"2024-01-19T05:17:43.332036+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3296909119}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":2606849043}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1723842478}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1735090958}]}]} 2024-01-19T05:18:11.871 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-19T05:18:11.871 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-19T05:18:11.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:11.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f0676666640 1 Processor -- start 2024-01-19T05:18:11.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f0676666640 1 -- start start 2024-01-19T05:18:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f0676666640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06700acad0 0x7f06700b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f0676666640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06700ae1a0 con 0x7f06700b22b0 2024-01-19T05:18:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f0676666640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06700aceb0 con 0x7f06700725b0 2024-01-19T05:18:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f0676666640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0670141020 con 0x7f06700acad0 2024-01-19T05:18:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f066ffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06700acad0 0x7f06700b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f0674c03640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f06700b22b0 0x7f0670151090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33234/0 (socket says 172.21.15.99:33234) 2024-01-19T05:18:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f0674c03640 1 -- 172.21.15.99:0/3503630410 learned_addr learned my addr 172.21.15.99:0/3503630410 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f066ffff640 1 -- 172.21.15.99:0/3503630410 >> v1:172.21.15.157:6789/0 conn(0x7f06700725b0 legacy=0x7f0670146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f066ffff640 1 -- 172.21.15.99:0/3503630410 >> v1:172.21.15.99:6789/0 conn(0x7f06700b22b0 legacy=0x7f0670151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f066effd640 1 -- 172.21.15.99:0/3503630410 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216220310 0 0) 0x7f06700ae1a0 con 0x7f06700b22b0 2024-01-19T05:18:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.990+0000 7f066ffff640 1 -- 172.21.15.99:0/3503630410 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700aefc0 con 0x7f06700acad0 2024-01-19T05:18:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f066ffff640 1 --2- 172.21.15.99:0/3503630410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06700acad0 0x7f06700b1d70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06600097c0 tx=0x7f066001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa3467da045ebef server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f066effd640 1 -- 172.21.15.99:0/3503630410 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06600ab650 con 0x7f06700acad0 2024-01-19T05:18:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f066effd640 1 -- 172.21.15.99:0/3503630410 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06600ab7b0 con 0x7f06700acad0 2024-01-19T05:18:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f066effd640 1 -- 172.21.15.99:0/3503630410 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06600abb40 con 0x7f06700acad0 2024-01-19T05:18:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 -- 172.21.15.99:0/3503630410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06700acad0 msgr2=0x7f06700b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 --2- 172.21.15.99:0/3503630410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06700acad0 0x7f06700b1d70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06600097c0 tx=0x7f066001c450 comp rx=0 tx=0).stop 2024-01-19T05:18:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 -- 172.21.15.99:0/3503630410 shutdown_connections 2024-01-19T05:18:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 --2- 172.21.15.99:0/3503630410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06700acad0 0x7f06700b1d70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 -- 172.21.15.99:0/3503630410 >> 172.21.15.99:0/3503630410 conn(0x7f06700b8080 msgr2=0x7f06700b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:11.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 -- 172.21.15.99:0/3503630410 shutdown_connections 2024-01-19T05:18:11.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 -- 172.21.15.99:0/3503630410 wait complete. 2024-01-19T05:18:11.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 Processor -- start 2024-01-19T05:18:11.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.994+0000 7f0676666640 1 -- start start 2024-01-19T05:18:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06700acad0 0x7f06701383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06700b22b0 0x7f06700b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0670148420 0x7f06701e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0670148000 con 0x7f0670148420 2024-01-19T05:18:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0670149920 con 0x7f06700acad0 2024-01-19T05:18:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0670149b90 con 0x7f06700b22b0 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0670148420 0x7f06701e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0670148420 0x7f06701e1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54904/0 (socket says 172.21.15.99:54904) 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 -- 172.21.15.99:0/620957185 learned_addr learned my addr 172.21.15.99:0/620957185 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066ffff640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06700acad0 0x7f06701383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 -- 172.21.15.99:0/620957185 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06700b22b0 msgr2=0x7f06700b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06700b22b0 0x7f06700b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 -- 172.21.15.99:0/620957185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06700acad0 msgr2=0x7f06701383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06700acad0 0x7f06701383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 -- 172.21.15.99:0/620957185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660009420 con 0x7f0670148420 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0674c03640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0670148420 0x7f06701e1ed0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f066800c7b0 tx=0x7f066800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066cff9640 1 -- 172.21.15.99:0/620957185 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800a640 con 0x7f0670148420 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066cff9640 1 -- 172.21.15.99:0/620957185 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800a7a0 con 0x7f0670148420 2024-01-19T05:18:12.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067014a300 con 0x7f0670148420 2024-01-19T05:18:12.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066cff9640 1 -- 172.21.15.99:0/620957185 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800ab90 con 0x7f0670148420 2024-01-19T05:18:12.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067014a8c0 con 0x7f0670148420 2024-01-19T05:18:12.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0670148140 con 0x7f0670148420 2024-01-19T05:18:12.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066cff9640 1 -- 172.21.15.99:0/620957185 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f066800acf0 con 0x7f0670148420 2024-01-19T05:18:12.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066cff9640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f065c066500 0x7f065c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066ffff640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f065c066500 0x7f065c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066cff9640 1 -- 172.21.15.99:0/620957185 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0668083580 con 0x7f0670148420 2024-01-19T05:18:12.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:11.998+0000 7f066ffff640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f065c066500 0x7f065c0689c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06600af000 tx=0x7f06600a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.002+0000 7f066cff9640 1 -- 172.21.15.99:0/620957185 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0670148140 con 0x7f0670148420 2024-01-19T05:18:12.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.145+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0670148140 con 0x7f0670148420 2024-01-19T05:18:12.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f066cff9640 1 -- 172.21.15.99:0/620957185 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f0670148140 con 0x7f0670148420 2024-01-19T05:18:12.151 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:12.151 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:12.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f065c066500 msgr2=0x7f065c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f065c066500 0x7f065c0689c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f06600af000 tx=0x7f06600a7000 comp rx=0 tx=0).stop 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0670148420 msgr2=0x7f06701e1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0670148420 0x7f06701e1ed0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f066800c7b0 tx=0x7f066800cc70 comp rx=0 tx=0).stop 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 shutdown_connections 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f065c066500 0x7f065c0689c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0670148420 0x7f06701e1ed0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06700b22b0 0x7f06700b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 --2- 172.21.15.99:0/620957185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06700acad0 0x7f06701383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 >> 172.21.15.99:0/620957185 conn(0x7f06700b8080 msgr2=0x7f06700b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 shutdown_connections 2024-01-19T05:18:12.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.149+0000 7f0676666640 1 -- 172.21.15.99:0/620957185 wait complete. 2024-01-19T05:18:12.169 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-19T05:18:12.169 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:12.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.277+0000 7fb12e54c640 1 Processor -- start 2024-01-19T05:18:12.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.277+0000 7fb12e54c640 1 -- start start 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb12e54c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b3310 0x7fb1280b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb12e54c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb1280b36f0 0x7fb1280b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb12e54c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12806ed10 con 0x7fb1280b1120 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb12e54c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280b22b0 con 0x7fb1280b36f0 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb12e54c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b16d0 con 0x7fb1280b3310 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb1277fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb1280b36f0 0x7fb1280b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb1277fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb1280b36f0 0x7fb1280b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54920/0 (socket says 172.21.15.99:54920) 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb1277fe640 1 -- 172.21.15.99:0/315273629 learned_addr learned my addr 172.21.15.99:0/315273629 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb127fff640 1 --2- 172.21.15.99:0/315273629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b3310 0x7fb1280b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb1277fe640 1 -- 172.21.15.99:0/315273629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b3310 msgr2=0x7fb1280b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb1277fe640 1 --2- 172.21.15.99:0/315273629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b3310 0x7fb1280b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb1277fe640 1 -- 172.21.15.99:0/315273629 >> v1:172.21.15.157:6789/0 conn(0x7fb1280b1120 legacy=0x7fb128146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb1277fe640 1 -- 172.21.15.99:0/315273629 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280721c0 con 0x7fb1280b36f0 2024-01-19T05:18:12.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb1277fe640 1 --2- 172.21.15.99:0/315273629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1280b4330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb11800d150 tx=0x7fb11801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4f5e35aa2845f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb126ffd640 1 -- 172.21.15.99:0/315273629 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180a7bf0 con 0x7fb1280b36f0 2024-01-19T05:18:12.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb126ffd640 1 -- 172.21.15.99:0/315273629 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1180ab070 con 0x7fb1280b36f0 2024-01-19T05:18:12.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.281+0000 7fb126ffd640 1 -- 172.21.15.99:0/315273629 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180b1400 con 0x7fb1280b36f0 2024-01-19T05:18:12.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- 172.21.15.99:0/315273629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 msgr2=0x7fb1280b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 --2- 172.21.15.99:0/315273629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1280b4330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb11800d150 tx=0x7fb11801eb80 comp rx=0 tx=0).stop 2024-01-19T05:18:12.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- 172.21.15.99:0/315273629 shutdown_connections 2024-01-19T05:18:12.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 --2- 172.21.15.99:0/315273629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1280b4330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 --2- 172.21.15.99:0/315273629 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b3310 0x7fb1280b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- 172.21.15.99:0/315273629 >> 172.21.15.99:0/315273629 conn(0x7fb1280b8080 msgr2=0x7fb1280b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- 172.21.15.99:0/315273629 shutdown_connections 2024-01-19T05:18:12.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- 172.21.15.99:0/315273629 wait complete. 2024-01-19T05:18:12.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 Processor -- start 2024-01-19T05:18:12.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- start start 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b1120 0x7fb12813f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1280b3310 0x7fb1281daec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1281ddbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1281daa30 con 0x7fb1280b36f0 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128142de0 con 0x7fb1280b3310 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1281430c0 con 0x7fb1280b1120 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1281ddbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1281ddbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54932/0 (socket says 172.21.15.99:54932) 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 -- 172.21.15.99:0/2715572637 learned_addr learned my addr 172.21.15.99:0/2715572637 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb1277fe640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1280b3310 0x7fb1281daec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb127fff640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b1120 0x7fb12813f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 -- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b1120 msgr2=0x7fb12813f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b1120 0x7fb12813f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 -- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1280b3310 msgr2=0x7fb1281daec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1280b3310 0x7fb1281daec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 -- 172.21.15.99:0/2715572637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11800bd40 con 0x7fb1280b36f0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb1277fe640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1280b3310 0x7fb1281daec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12cae9640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1281ddbc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c370 tx=0x7fb12000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb124ff9640 1 -- 172.21.15.99:0/2715572637 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120005220 con 0x7fb1280b36f0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb124ff9640 1 -- 172.21.15.99:0/2715572637 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120005380 con 0x7fb1280b36f0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb128146290 con 0x7fb1280b36f0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb124ff9640 1 -- 172.21.15.99:0/2715572637 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120007270 con 0x7fb1280b36f0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb128140db0 con 0x7fb1280b36f0 2024-01-19T05:18:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.285+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1281dabe0 con 0x7fb1280b36f0 2024-01-19T05:18:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.289+0000 7fb124ff9640 1 -- 172.21.15.99:0/2715572637 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb1200073d0 con 0x7fb1280b36f0 2024-01-19T05:18:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.289+0000 7fb124ff9640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb108066500 0x7fb1080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.289+0000 7fb124ff9640 1 -- 172.21.15.99:0/2715572637 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb120083350 con 0x7fb1280b36f0 2024-01-19T05:18:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.289+0000 7fb127fff640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb108066500 0x7fb1080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.289+0000 7fb127fff640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb108066500 0x7fb1080689c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb128140b30 tx=0x7fb110008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.293+0000 7fb124ff9640 1 -- 172.21.15.99:0/2715572637 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb120050680 con 0x7fb1280b36f0 2024-01-19T05:18:12.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.445+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1280696e0 con 0x7fb1280b36f0 2024-01-19T05:18:12.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.445+0000 7fb124ff9640 1 -- 172.21.15.99:0/2715572637 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fb120053ca0 con 0x7fb1280b36f0 2024-01-19T05:18:12.449 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:12.449 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb108066500 msgr2=0x7fb1080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb108066500 0x7fb1080689c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb128140b30 tx=0x7fb110008040 comp rx=0 tx=0).stop 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 msgr2=0x7fb1281ddbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1281ddbc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c370 tx=0x7fb12000c830 comp rx=0 tx=0).stop 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 shutdown_connections 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb108066500 0x7fb1080689c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1280b36f0 0x7fb1281ddbc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1280b3310 0x7fb1281daec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 --2- 172.21.15.99:0/2715572637 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb1280b1120 0x7fb12813f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 >> 172.21.15.99:0/2715572637 conn(0x7fb1280b8080 msgr2=0x7fb1280b6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 shutdown_connections 2024-01-19T05:18:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.449+0000 7fb12e54c640 1 -- 172.21.15.99:0/2715572637 wait complete. 2024-01-19T05:18:12.467 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-19T05:18:12.468 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-19T05:18:12.468 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-19T05:18:12.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-19T05:18:12.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-19T05:18:12.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-19T05:18:12.470 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-19T05:18:12.470 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab3fff640 1 Processor -- start 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab3fff640 1 -- start start 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab406ca60 0x7feab40b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab3fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feab414eae0 0x7feab4155620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab3fff640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab40b2c90 con 0x7feab40b3660 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab3fff640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab40ad0f0 con 0x7feab414eae0 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab3fff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab40af4d0 con 0x7feab406ca60 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab27fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7feab40b3660 0x7feab414e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33250/0 (socket says 172.21.15.99:33250) 2024-01-19T05:18:12.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab27fc640 1 -- 172.21.15.99:0/2132617716 learned_addr learned my addr 172.21.15.99:0/2132617716 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb14145b640 1 Processor -- start 2024-01-19T05:18:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb14145b640 1 -- start start 2024-01-19T05:18:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27fcbe5640 1 Processor -- start 2024-01-19T05:18:12.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27fcbe5640 1 -- start start 2024-01-19T05:18:12.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab2ffd640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab406ca60 0x7feab40b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881342973 0 0) 0x7feab40b2c90 con 0x7feab40b3660 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea9c003530 con 0x7feab40b3660 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287165282 0 0) 0x7fea9c003530 con 0x7feab40b3660 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab406ca60 msgr2=0x7feab40b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab406ca60 0x7feab40b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 >> v2:172.21.15.157:3300/0 conn(0x7feab414eae0 msgr2=0x7feab4155620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 --2- 172.21.15.99:0/2132617716 >> v2:172.21.15.157:3300/0 conn(0x7feab414eae0 0x7feab4155620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40b3ae0 con 0x7feab40b3660 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7feaa8001680 con 0x7feab40b3660 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 >> v1:172.21.15.99:6789/0 conn(0x7feab40b3660 legacy=0x7feab414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea9c0039b0 0x7fea9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7fea9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab406ca60 0x7fea9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab40ad0f0 con 0x7fea9c0047d0 2024-01-19T05:18:12.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb14145b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb13c0b6090 0x7fb13c143420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab40af4d0 con 0x7fea9c0039b0 2024-01-19T05:18:12.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c005590 con 0x7feab406ca60 2024-01-19T05:18:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb14145b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb13c0711a0 0x7fb13c06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab27fc640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7fea9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27fcbe5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f80ad380 0x7f27f8144f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27fcbe5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f27f806cb60 0x7f27f81454b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27fcbe5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80ae260 con 0x7f27f8145f00 2024-01-19T05:18:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27fcbe5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80af970 con 0x7f27f806cb60 2024-01-19T05:18:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27fcbe5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80acda0 con 0x7f27f80ad380 2024-01-19T05:18:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb13b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb13c0711a0 0x7fb13c06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb13b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb13c0711a0 0x7fb13c06fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54962/0 (socket says 172.21.15.99:54962) 2024-01-19T05:18:12.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27f77fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f27f8145f00 0x7f27f81462e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:33266/0 (socket says 172.21.15.99:33266) 2024-01-19T05:18:12.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27f77fe640 1 -- 172.21.15.99:0/1051230384 learned_addr learned my addr 172.21.15.99:0/1051230384 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:12.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb13b7fe640 1 -- 172.21.15.99:0/4292005417 learned_addr learned my addr 172.21.15.99:0/4292005417 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb14145b640 1 --2- 172.21.15.99:0/4292005417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13c070000 0x7fb13c13d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab27fc640 1 -- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab406ca60 msgr2=0x7fea9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab27fc640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab406ca60 0x7fea9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab27fc640 1 -- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea9c0039b0 msgr2=0x7fea9c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb14145b640 1 -- 172.21.15.99:0/4292005417 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0718d0 con 0x7fb13c0711a0 2024-01-19T05:18:12.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f5e5f59e640 1 Processor -- start 2024-01-19T05:18:12.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb14145b640 1 -- 172.21.15.99:0/4292005417 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c070d10 con 0x7fb13c0b6090 2024-01-19T05:18:12.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f27f7fff640 1 --2- 172.21.15.99:0/1051230384 >> v2:172.21.15.157:3300/0 conn(0x7f27f806cb60 0x7f27f81454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7fb14145b640 1 -- 172.21.15.99:0/4292005417 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0709e0 con 0x7fb13c070000 2024-01-19T05:18:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7f5e5f59e640 1 -- start start 2024-01-19T05:18:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f27f6ffd640 1 --2- 172.21.15.99:0/1051230384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f80ad380 0x7f27f8144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab27fc640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea9c0039b0 0x7fea9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.641+0000 7feab27fc640 1 -- 172.21.15.99:0/2132617716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40b3ae0 con 0x7fea9c0047d0 2024-01-19T05:18:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43bac8d640 1 Processor -- start 2024-01-19T05:18:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43bac8d640 1 -- start start 2024-01-19T05:18:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fb140c5a640 1 --2- 172.21.15.99:0/4292005417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13c070000 0x7fb13c13d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fb13b7fe640 1 -- 172.21.15.99:0/4292005417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13c070000 msgr2=0x7fb13c13d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fb13b7fe640 1 --2- 172.21.15.99:0/4292005417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13c070000 0x7fb13c13d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fb13b7fe640 1 -- 172.21.15.99:0/4292005417 >> v2:172.21.15.157:3300/0 conn(0x7fb13c0b6090 msgr2=0x7fb13c143420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-19T05:18:12.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fb13b7fe640 1 --2- 172.21.15.99:0/4292005417 >> v2:172.21.15.157:3300/0 conn(0x7fb13c0b6090 0x7fb13c143420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fb13b7fe640 1 -- 172.21.15.99:0/4292005417 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0b6470 con 0x7fb13c0711a0 2024-01-19T05:18:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f27f67fc640 1 -- 172.21.15.99:0/1051230384 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679472874 0 0) 0x7f27f80ae260 con 0x7f27f8145f00 2024-01-19T05:18:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f27f67fc640 1 -- 172.21.15.99:0/1051230384 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e0003530 con 0x7f27f8145f00 2024-01-19T05:18:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f27f6ffd640 1 -- 172.21.15.99:0/1051230384 >> v2:172.21.15.157:3300/0 conn(0x7f27f806cb60 msgr2=0x7f27f81454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f27f6ffd640 1 --2- 172.21.15.99:0/1051230384 >> v2:172.21.15.157:3300/0 conn(0x7f27f806cb60 0x7f27f81454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f27f6ffd640 1 -- 172.21.15.99:0/1051230384 >> v1:172.21.15.157:6789/0 conn(0x7f27f8145f00 legacy=0x7f27f81462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f27f6ffd640 1 -- 172.21.15.99:0/1051230384 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80ad080 con 0x7f27f80ad380 2024-01-19T05:18:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5f59e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5e600b5fa0 0x7f5e600718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5f59e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5e600b45e0 0x7f5e600b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5f59e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e60071410 con 0x7f5e600701a0 2024-01-19T05:18:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5f59e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e600725c0 con 0x7f5e600b45e0 2024-01-19T05:18:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5f59e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e60071de0 con 0x7f5e600b5fa0 2024-01-19T05:18:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5e59c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5e600b5fa0 0x7f5e600718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5e59c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5e600b5fa0 0x7f5e600718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:46958/0 (socket says 172.21.15.99:46958) 2024-01-19T05:18:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5e59c640 1 -- 172.21.15.99:0/188169659 learned_addr learned my addr 172.21.15.99:0/188169659 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43bac8d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac039ab0 0x7f43ac006cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43bac8d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f43ac007210 0x7f43ac0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43bac8d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f43ac0ce100 0x7f43ac038290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43bac8d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac03c130 con 0x7f43ac007210 2024-01-19T05:18:12.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43bac8d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac03b530 con 0x7f43ac0ce100 2024-01-19T05:18:12.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43bac8d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0ce590 con 0x7f43ac039ab0 2024-01-19T05:18:12.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0c03de640 1 Processor -- start 2024-01-19T05:18:12.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0c03de640 1 -- start start 2024-01-19T05:18:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761716515 0 0) 0x7f5e60071410 con 0x7f5e600701a0 2024-01-19T05:18:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5ed9d640 1 --2- 172.21.15.99:0/188169659 >> v2:172.21.15.99:3300/0 conn(0x7f5e600b45e0 0x7f5e600b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7feab27fc640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7fea9c004c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feaa800c290 tx=0x7feaa801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413ffb779a2e2092 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f075ab9a640 1 Processor -- start 2024-01-19T05:18:12.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa80a5b80 con 0x7fea9c0047d0 2024-01-19T05:18:12.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa80a5ce0 con 0x7fea9c0047d0 2024-01-19T05:18:12.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7feab1ffb640 1 -- 172.21.15.99:0/2132617716 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8005b00 con 0x7fea9c0047d0 2024-01-19T05:18:12.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e48003530 con 0x7f5e600701a0 2024-01-19T05:18:12.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f075ab9a640 1 -- start start 2024-01-19T05:18:12.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f075ab9a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f075406b780 0x7f07540b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f075ab9a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f075406e9c0 0x7f07540b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f075ab9a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07540acda0 con 0x7f075406bb60 2024-01-19T05:18:12.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f075ab9a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0754072510 con 0x7f075406e9c0 2024-01-19T05:18:12.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f075ab9a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07540ad640 con 0x7f075406b780 2024-01-19T05:18:12.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0c03de640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 0x7fd0b0036f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0c03de640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd0b00379b0 0x7fd0b00ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0c03de640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b0035850 con 0x7fd0b0037550 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0c03de640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b00363d0 con 0x7fd0b00379b0 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0c03de640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00d0ca0 con 0x7fd0b0035ff0 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0be97b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd0b00379b0 0x7fd0b00ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0be97b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd0b00379b0 0x7fd0b00ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54996/0 (socket says 172.21.15.99:54996) 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0be97b640 1 -- 172.21.15.99:0/3505766067 learned_addr learned my addr 172.21.15.99:0/3505766067 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0be17a640 1 --2- 172.21.15.99:0/3505766067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 0x7fd0b0036f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0be97b640 1 -- 172.21.15.99:0/3505766067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 msgr2=0x7fd0b0036f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0be97b640 1 --2- 172.21.15.99:0/3505766067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 0x7fd0b0036f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0be97b640 1 -- 172.21.15.99:0/3505766067 >> v1:172.21.15.99:6789/0 conn(0x7fd0b0037550 legacy=0x7fd0b00d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fd0be97b640 1 -- 172.21.15.99:0/3505766067 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00d18d0 con 0x7fd0b00379b0 2024-01-19T05:18:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7feab3fff640 1 -- 172.21.15.99:0/2132617716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 msgr2=0x7fea9c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7feab3fff640 1 --2- 172.21.15.99:0/2132617716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7fea9c004c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feaa800c290 tx=0x7feaa801cca0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7feab37fe640 1 -- 172.21.15.99:0/2132617716 reap_dead start 2024-01-19T05:18:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7fb13b7fe640 1 --2- 172.21.15.99:0/4292005417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0711a0 0x7fb13c06fac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0b9ee0 tx=0x7fb1300208b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c422725c5288418 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7feab3fff640 1 -- 172.21.15.99:0/2132617716 shutdown_connections 2024-01-19T05:18:12.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7feab3fff640 1 -- 172.21.15.99:0/2132617716 >> 172.21.15.99:0/2132617716 conn(0x7feab40b4880 msgr2=0x7feab40b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f0758936640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f075406b780 0x7f07540b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b9c8b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac039ab0 0x7f43ac006cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f0753fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f075406e9c0 0x7f07540b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f0758936640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f075406b780 0x7f07540b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:46986/0 (socket says 172.21.15.99:46986) 2024-01-19T05:18:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f0758936640 1 -- 172.21.15.99:0/1205511651 learned_addr learned my addr 172.21.15.99:0/1205511651 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b9c8b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac039ab0 0x7f43ac006cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:45888/0 (socket says 172.21.15.99:45888) 2024-01-19T05:18:12.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b9c8b640 1 -- 172.21.15.99:0/1728764057 learned_addr learned my addr 172.21.15.99:0/1728764057 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43ba48c640 1 --2- 172.21.15.99:0/1728764057 >> v2:172.21.15.157:3300/0 conn(0x7f43ac0ce100 0x7f43ac038290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b948a640 1 --2- 172.21.15.99:0/1728764057 >> v2:172.21.15.99:3300/0 conn(0x7f43ac007210 0x7f43ac0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27f6ffd640 1 --2- 172.21.15.99:0/1051230384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f80ad380 0x7f27f8144f70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009d90 tx=0x7f27f001c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ee2a8feaa001a84 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b948a640 1 -- 172.21.15.99:0/1728764057 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac039ab0 msgr2=0x7f43ac006cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b948a640 1 --2- 172.21.15.99:0/1728764057 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac039ab0 0x7f43ac006cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b948a640 1 -- 172.21.15.99:0/1728764057 >> v2:172.21.15.157:3300/0 conn(0x7f43ac0ce100 msgr2=0x7f43ac038290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb13affd640 1 -- 172.21.15.99:0/4292005417 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300a9740 con 0x7fb13c0711a0 2024-01-19T05:18:12.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb13affd640 1 -- 172.21.15.99:0/4292005417 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1300a98a0 con 0x7fb13c0711a0 2024-01-19T05:18:12.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb13affd640 1 -- 172.21.15.99:0/4292005417 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300a9c30 con 0x7fb13c0711a0 2024-01-19T05:18:12.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b948a640 1 --2- 172.21.15.99:0/1728764057 >> v2:172.21.15.157:3300/0 conn(0x7f43ac0ce100 0x7f43ac038290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f43b948a640 1 -- 172.21.15.99:0/1728764057 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac039e90 con 0x7f43ac007210 2024-01-19T05:18:12.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc66c0a640 1 Processor -- start 2024-01-19T05:18:12.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27f67fc640 1 -- 172.21.15.99:0/1051230384 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00a5870 con 0x7f27f80ad380 2024-01-19T05:18:12.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f0753fff640 1 -- 172.21.15.99:0/1205511651 >> v2:172.21.15.157:3300/0 conn(0x7f075406b780 msgr2=0x7f07540b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f0753fff640 1 --2- 172.21.15.99:0/1205511651 >> v2:172.21.15.157:3300/0 conn(0x7f075406b780 0x7f07540b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27f67fc640 1 -- 172.21.15.99:0/1051230384 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f00a59d0 con 0x7f27f80ad380 2024-01-19T05:18:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f0753fff640 1 -- 172.21.15.99:0/1205511651 >> v1:172.21.15.99:6789/0 conn(0x7f075406bb60 legacy=0x7f07540b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f0753fff640 1 -- 172.21.15.99:0/1205511651 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540ae290 con 0x7f075406e9c0 2024-01-19T05:18:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb14145b640 1 -- 172.21.15.99:0/4292005417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0711a0 msgr2=0x7fb13c06fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb14145b640 1 --2- 172.21.15.99:0/4292005417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0711a0 0x7fb13c06fac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0b9ee0 tx=0x7fb1300208b0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2983827952 0 0) 0x7f5e48003530 con 0x7f5e600701a0 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 >> v2:172.21.15.157:3300/0 conn(0x7f5e600b5fa0 msgr2=0x7f5e600718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 --2- 172.21.15.99:0/188169659 >> v2:172.21.15.157:3300/0 conn(0x7f5e600b5fa0 0x7f5e600718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 >> v2:172.21.15.99:3300/0 conn(0x7f5e600b45e0 msgr2=0x7f5e600b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 --2- 172.21.15.99:0/188169659 >> v2:172.21.15.99:3300/0 conn(0x7f5e600b45e0 0x7f5e600b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60145200 con 0x7f5e600701a0 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.645+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f5e54001680 con 0x7f5e600701a0 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 >> v1:172.21.15.99:6789/0 conn(0x7f5e600701a0 legacy=0x7f5e60144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5d59a640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48003980 0x7f5e48003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5d59a640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e480047d0 0x7f5e48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5d59a640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e48005190 0x7f5e4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600725c0 con 0x7f5e480047d0 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60071de0 con 0x7f5e48005190 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4800c0b0 con 0x7f5e48003980 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 --2- 172.21.15.99:0/188169659 >> v2:172.21.15.99:3300/0 conn(0x7f5e600b45e0 0x7f5e600b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5e59c640 1 --2- 172.21.15.99:0/188169659 >> v2:172.21.15.157:3300/0 conn(0x7f5e600b5fa0 0x7f5e600718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e48005190 0x7f5e4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5e59c640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48003980 0x7f5e48003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 -- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48003980 msgr2=0x7f5e48003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48003980 0x7f5e48003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 -- 172.21.15.99:0/188169659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e480047d0 msgr2=0x7f5e48004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T05:18:12.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e480047d0 0x7f5e48004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 -- 172.21.15.99:0/188169659 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60145200 con 0x7f5e48005190 2024-01-19T05:18:12.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27f67fc640 1 -- 172.21.15.99:0/1051230384 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00a5d40 con 0x7f27f80ad380 2024-01-19T05:18:12.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1051230384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f80ad380 msgr2=0x7f27f8144f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27fcbe5640 1 --2- 172.21.15.99:0/1051230384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f80ad380 0x7f27f8144f70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009d90 tx=0x7f27f001c8d0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7feab3fff640 1 -- 172.21.15.99:0/2132617716 shutdown_connections 2024-01-19T05:18:12.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7feab3fff640 1 -- 172.21.15.99:0/2132617716 wait complete. 2024-01-19T05:18:12.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc66c0a640 1 -- start start 2024-01-19T05:18:12.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc66c0a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbc60144fd0 0x7fbc600702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc66c0a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60071eb0 0x7fbc60072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc66c0a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6006abf0 con 0x7fbc600b5670 2024-01-19T05:18:12.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc66c0a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600709c0 con 0x7fbc60144fd0 2024-01-19T05:18:12.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc66c0a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b5a50 con 0x7fbc60071eb0 2024-01-19T05:18:12.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43b948a640 1 --2- 172.21.15.99:0/1728764057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ac007210 0x7f43ac0cdbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0094a0 tx=0x7f43b001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e868a012b8309e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc659a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60071eb0 0x7fbc60072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc5ffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbc60144fd0 0x7fbc600702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fd0be97b640 1 --2- 172.21.15.99:0/3505766067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b00379b0 0x7fd0b00ca5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd0b802cf80 tx=0x7fd0b8096a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4573f9146c29abc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc649a6640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbc600b5670 0x7fbc601448c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:33270/0 (socket says 172.21.15.99:33270) 2024-01-19T05:18:12.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc649a6640 1 -- 172.21.15.99:0/731119435 learned_addr learned my addr 172.21.15.99:0/731119435 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:12.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43b8c89640 1 -- 172.21.15.99:0/1728764057 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00ab600 con 0x7f43ac007210 2024-01-19T05:18:12.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43b8c89640 1 -- 172.21.15.99:0/1728764057 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00a7050 con 0x7f43ac007210 2024-01-19T05:18:12.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43b8c89640 1 -- 172.21.15.99:0/1728764057 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00ab980 con 0x7f43ac007210 2024-01-19T05:18:12.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc5ffff640 1 -- 172.21.15.99:0/731119435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60071eb0 msgr2=0x7fbc60072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc5ffff640 1 --2- 172.21.15.99:0/731119435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60071eb0 0x7fbc60072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc5ffff640 1 -- 172.21.15.99:0/731119435 >> v1:172.21.15.157:6789/0 conn(0x7fbc600b5670 legacy=0x7fbc601448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc5f7fe640 1 -- 172.21.15.99:0/731119435 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028325793 0 0) 0x7fbc6006abf0 con 0x7fbc600b5670 2024-01-19T05:18:12.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fbc5ffff640 1 -- 172.21.15.99:0/731119435 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6006a880 con 0x7fbc60144fd0 2024-01-19T05:18:12.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fd0bd178640 1 -- 172.21.15.99:0/3505766067 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80672f0 con 0x7fd0b00379b0 2024-01-19T05:18:12.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fd0bd178640 1 -- 172.21.15.99:0/3505766067 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b811f640 con 0x7fd0b00379b0 2024-01-19T05:18:12.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fd0bd178640 1 -- 172.21.15.99:0/3505766067 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b811fa70 con 0x7fd0b00379b0 2024-01-19T05:18:12.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb14145b640 1 -- 172.21.15.99:0/4292005417 shutdown_connections 2024-01-19T05:18:12.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb14145b640 1 --2- 172.21.15.99:0/4292005417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0711a0 0x7fb13c06fac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb14145b640 1 --2- 172.21.15.99:0/4292005417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13c070000 0x7fb13c13d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb14145b640 1 --2- 172.21.15.99:0/4292005417 >> v2:172.21.15.157:3300/0 conn(0x7fb13c0b6090 0x7fb13c143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb14145b640 1 -- 172.21.15.99:0/4292005417 >> 172.21.15.99:0/4292005417 conn(0x7fb13c0667f0 msgr2=0x7fb13c066c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1051230384 shutdown_connections 2024-01-19T05:18:12.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27fcbe5640 1 --2- 172.21.15.99:0/1051230384 >> v2:172.21.15.157:3300/0 conn(0x7f27f806cb60 0x7f27f81454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27fcbe5640 1 --2- 172.21.15.99:0/1051230384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f80ad380 0x7f27f8144f70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1051230384 >> 172.21.15.99:0/1051230384 conn(0x7f27f80b4880 msgr2=0x7f27f80b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 -- 172.21.15.99:0/188169659 reap_dead start 2024-01-19T05:18:12.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7fb14145b640 1 -- 172.21.15.99:0/4292005417 shutdown_connections 2024-01-19T05:18:12.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1051230384 shutdown_connections 2024-01-19T05:18:12.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43bac8d640 1 -- 172.21.15.99:0/1728764057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ac007210 msgr2=0x7f43ac0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43bac8d640 1 --2- 172.21.15.99:0/1728764057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ac007210 0x7f43ac0cdbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0094a0 tx=0x7f43b001c350 comp rx=0 tx=0).stop 2024-01-19T05:18:12.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1051230384 wait complete. 2024-01-19T05:18:12.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7feab3fff640 1 Processor -- start 2024-01-19T05:18:12.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43bac8d640 1 -- 172.21.15.99:0/1728764057 shutdown_connections 2024-01-19T05:18:12.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43bac8d640 1 --2- 172.21.15.99:0/1728764057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ac007210 0x7f43ac0cdbc0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0094a0 tx=0x7f43b001c350 comp rx=0 tx=0).stop 2024-01-19T05:18:12.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43bac8d640 1 --2- 172.21.15.99:0/1728764057 >> v2:172.21.15.157:3300/0 conn(0x7f43ac0ce100 0x7f43ac038290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43bac8d640 1 --2- 172.21.15.99:0/1728764057 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac039ab0 0x7f43ac006cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f43bac8d640 1 -- 172.21.15.99:0/1728764057 >> 172.21.15.99:0/1728764057 conn(0x7f43ac0061b0 msgr2=0x7f43ac0065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 -- start start 2024-01-19T05:18:12.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- 172.21.15.99:0/3505766067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b00379b0 msgr2=0x7fd0b00ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 --2- 172.21.15.99:0/3505766067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b00379b0 0x7fd0b00ca5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd0b802cf80 tx=0x7fd0b8096a00 comp rx=0 tx=0).stop 2024-01-19T05:18:12.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.649+0000 7f5e5ed9d640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e48005190 0x7f5e4800b990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000aaa0 tx=0x7f5e5001c6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a190c3acc7fc8847 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- 172.21.15.99:0/3505766067 shutdown_connections 2024-01-19T05:18:12.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 --2- 172.21.15.99:0/3505766067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b00379b0 0x7fd0b00ca5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 --2- 172.21.15.99:0/3505766067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 0x7fd0b0036f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- 172.21.15.99:0/3505766067 >> 172.21.15.99:0/3505766067 conn(0x7fd0b003a890 msgr2=0x7fd0b003aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- 172.21.15.99:0/3505766067 shutdown_connections 2024-01-19T05:18:12.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 -- 172.21.15.99:0/4292005417 wait complete. 2024-01-19T05:18:12.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f0753fff640 1 --2- 172.21.15.99:0/1205511651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f075406e9c0 0x7f07540b2cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f075406c8c0 tx=0x7f074801c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a859af5c8eb6c70 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500ad070 con 0x7f5e48005190 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e500a8400 con 0x7f5e48005190 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5d59a640 1 -- 172.21.15.99:0/188169659 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500a87d0 con 0x7f5e48005190 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7feab4135720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab409b040 0x7feab4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab4070fb0 0x7feab409ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab409a5b0 con 0x7fea9c0047d0 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab4071460 con 0x7feab4070fb0 2024-01-19T05:18:12.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab4143990 con 0x7feab409b040 2024-01-19T05:18:12.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f43bac8d640 1 -- 172.21.15.99:0/1728764057 shutdown_connections 2024-01-19T05:18:12.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- 172.21.15.99:0/3505766067 wait complete. 2024-01-19T05:18:12.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27fcbe5640 1 Processor -- start 2024-01-19T05:18:12.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5f59e640 1 -- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e48005190 msgr2=0x7f5e4800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5f59e640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e48005190 0x7f5e4800b990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000aaa0 tx=0x7f5e5001c6b0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 Processor -- start 2024-01-19T05:18:12.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7feab4135720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7feab4135720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55016/0 (socket says 172.21.15.99:55016) 2024-01-19T05:18:12.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 -- 172.21.15.99:0/274402490 learned_addr learned my addr 172.21.15.99:0/274402490 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab27fc640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab409b040 0x7feab4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 Processor -- start 2024-01-19T05:18:12.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f07537fe640 1 -- 172.21.15.99:0/1205511651 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480a8630 con 0x7f075406e9c0 2024-01-19T05:18:12.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f07537fe640 1 -- 172.21.15.99:0/1205511651 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480a8790 con 0x7f075406e9c0 2024-01-19T05:18:12.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f07537fe640 1 -- 172.21.15.99:0/1205511651 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480a8b20 con 0x7f075406e9c0 2024-01-19T05:18:12.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab37fe640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab4070fb0 0x7feab409ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5f59e640 1 -- 172.21.15.99:0/188169659 shutdown_connections 2024-01-19T05:18:12.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5f59e640 1 --2- 172.21.15.99:0/188169659 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e48005190 0x7f5e4800b990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5f59e640 1 -- 172.21.15.99:0/188169659 >> 172.21.15.99:0/188169659 conn(0x7f5e600667f0 msgr2=0x7f5e60066c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- start start 2024-01-19T05:18:12.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 -- 172.21.15.99:0/274402490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab409b040 msgr2=0x7feab4070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feab409b040 0x7feab4070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 -- 172.21.15.99:0/274402490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab4070fb0 msgr2=0x7feab409ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feab4070fb0 0x7feab409ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 -- 172.21.15.99:0/274402490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab409b7c0 con 0x7fea9c0047d0 2024-01-19T05:18:12.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fbc5ffff640 1 --2- 172.21.15.99:0/731119435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc60144fd0 0x7fbc600702f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbc480097c0 tx=0x7fbc4801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f417f203cfc7cdac server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5f59e640 1 -- 172.21.15.99:0/188169659 shutdown_connections 2024-01-19T05:18:12.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27fcbe5640 1 -- start start 2024-01-19T05:18:12.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27fcbe5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f806cb60 0x7f27f80712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f43bac8d640 1 -- 172.21.15.99:0/1728764057 wait complete. 2024-01-19T05:18:12.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27fcbe5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f80ad380 0x7f27f813eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27fcbe5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f8145f00 0x7f27f809bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27fcbe5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f809b960 con 0x7f27f80ad380 2024-01-19T05:18:12.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27fcbe5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f809d0e0 con 0x7f27f806cb60 2024-01-19T05:18:12.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27fcbe5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f813f820 con 0x7f27f8145f00 2024-01-19T05:18:12.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f43bac8d640 1 Processor -- start 2024-01-19T05:18:12.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f075ab9a640 1 -- 172.21.15.99:0/1205511651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f075406e9c0 msgr2=0x7f07540b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f075ab9a640 1 --2- 172.21.15.99:0/1205511651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f075406e9c0 0x7f07540b2cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f075406c8c0 tx=0x7f074801c610 comp rx=0 tx=0).stop 2024-01-19T05:18:12.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 -- start start 2024-01-19T05:18:12.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb13c070000 0x7fb13c131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13c0711a0 0x7fb13c137910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0b6090 0x7fb13c137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c13a380 con 0x7fb13c0b6090 2024-01-19T05:18:12.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c1398c0 con 0x7fb13c070000 2024-01-19T05:18:12.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb14145b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c139fc0 con 0x7fb13c0711a0 2024-01-19T05:18:12.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f806cb60 0x7f27f80712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f77fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f806cb60 0x7f27f80712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47026/0 (socket says 172.21.15.99:47026) 2024-01-19T05:18:12.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f77fe640 1 -- 172.21.15.99:0/1533928775 learned_addr learned my addr 172.21.15.99:0/1533928775 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab2ffd640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7feab4135720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feaac007e70 tx=0x7feaac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f7fff640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f8145f00 0x7f27f809bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 0x7fd0b00be8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b0037550 0x7fd0b00bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0b00379b0 0x7fd0b00c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00bf830 con 0x7fd0b0037550 2024-01-19T05:18:12.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00bf560 con 0x7fd0b00379b0 2024-01-19T05:18:12.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0c03de640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00c38a0 con 0x7fd0b0035ff0 2024-01-19T05:18:12.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb140c5a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0b6090 0x7fb13c137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb140c5a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0b6090 0x7fb13c137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55032/0 (socket says 172.21.15.99:55032) 2024-01-19T05:18:12.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb140c5a640 1 -- 172.21.15.99:0/1901441701 learned_addr learned my addr 172.21.15.99:0/1901441701 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fbc5f7fe640 1 -- 172.21.15.99:0/731119435 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc480ab600 con 0x7fbc60144fd0 2024-01-19T05:18:12.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f075ab9a640 1 -- 172.21.15.99:0/1205511651 shutdown_connections 2024-01-19T05:18:12.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f075ab9a640 1 --2- 172.21.15.99:0/1205511651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f075406e9c0 0x7f07540b2cc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f075ab9a640 1 --2- 172.21.15.99:0/1205511651 >> v2:172.21.15.157:3300/0 conn(0x7f075406b780 0x7f07540b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f075ab9a640 1 -- 172.21.15.99:0/1205511651 >> 172.21.15.99:0/1205511651 conn(0x7f07540b7d80 msgr2=0x7f07540b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f6ffd640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f80ad380 0x7f27f813eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fb13bfff640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb13c070000 0x7fb13c131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac014620 con 0x7fea9c0047d0 2024-01-19T05:18:12.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac014780 con 0x7fea9c0047d0 2024-01-19T05:18:12.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0be97b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0b00379b0 0x7fd0b00c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac014b30 con 0x7fea9c0047d0 2024-01-19T05:18:12.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0be97b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0b00379b0 0x7fd0b00c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47040/0 (socket says 172.21.15.99:47040) 2024-01-19T05:18:12.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0be97b640 1 -- 172.21.15.99:0/2757993712 learned_addr learned my addr 172.21.15.99:0/2757993712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab406fd00 con 0x7fea9c0047d0 2024-01-19T05:18:12.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab409b4e0 con 0x7fea9c0047d0 2024-01-19T05:18:12.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f6ffd640 1 -- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f8145f00 msgr2=0x7f27f809bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f6ffd640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f8145f00 0x7f27f809bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f6ffd640 1 -- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f806cb60 msgr2=0x7f27f80712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f6ffd640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f806cb60 0x7f27f80712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f27f6ffd640 1 -- 172.21.15.99:0/1533928775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0009a70 con 0x7f27f80ad380 2024-01-19T05:18:12.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fd0bd979640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b0037550 0x7fd0b00bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7f5e5f59e640 1 -- 172.21.15.99:0/188169659 wait complete. 2024-01-19T05:18:12.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 Processor -- start 2024-01-19T05:18:12.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0be17a640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 0x7fd0b00be8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f27f6ffd640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f80ad380 0x7f27f813eff0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27f00ac000 tx=0x7f27f0019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.653+0000 7fbc5f7fe640 1 -- 172.21.15.99:0/731119435 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc480a7050 con 0x7fbc60144fd0 2024-01-19T05:18:12.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 -- 172.21.15.99:0/731119435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc60144fd0 msgr2=0x7fbc600702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fb140c5a640 1 -- 172.21.15.99:0/1901441701 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13c0711a0 msgr2=0x7fb13c137910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-19T05:18:12.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fb140c5a640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb13c0711a0 0x7fb13c137910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fb140c5a640 1 -- 172.21.15.99:0/1901441701 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb13c070000 msgr2=0x7fb13c131da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fb140c5a640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb13c070000 0x7fb13c131da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fb140c5a640 1 -- 172.21.15.99:0/1901441701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300094d0 con 0x7fb13c0b6090 2024-01-19T05:18:12.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0be97b640 1 -- 172.21.15.99:0/2757993712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 msgr2=0x7fd0b00be8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0be97b640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0b0035ff0 0x7fd0b00be8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0be97b640 1 -- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b0037550 msgr2=0x7fd0b00bdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0be97b640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b0037550 0x7fd0b00bdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00a5830 con 0x7f27f80ad380 2024-01-19T05:18:12.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc5f7fe640 1 -- 172.21.15.99:0/731119435 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc480ab600 con 0x7fbc60144fd0 2024-01-19T05:18:12.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0be97b640 1 -- 172.21.15.99:0/2757993712 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b804f910 con 0x7fd0b00379b0 2024-01-19T05:18:12.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feab40acda0 con 0x7fea9c0047d0 2024-01-19T05:18:12.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 --2- 172.21.15.99:0/731119435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc60144fd0 0x7fbc600702f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbc480097c0 tx=0x7fbc4801c360 comp rx=0 tx=0).stop 2024-01-19T05:18:12.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7feaac014c90 con 0x7fea9c0047d0 2024-01-19T05:18:12.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fea9b7fe640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feaa00665d0 0x7feaa0068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feaac0847d0 con 0x7fea9c0047d0 2024-01-19T05:18:12.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fea9b7fe640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7feaa006e770 0x7feaa0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 --> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feaa0071240 con 0x7feaa006e770 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7feab27fc640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feaa00665d0 0x7feaa0068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7feab37fe640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7feaa006e770 0x7feaa0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7feab37fe640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7feaa006e770 0x7feaa0070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7feab27fc640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feaa00665d0 0x7feaa0068a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feaa80ab000 tx=0x7feaa80a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43bac8d640 1 -- start start 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43bac8d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43ac039ab0 0x7f43ac0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43bac8d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ac0ce100 0x7f43ac16c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43bac8d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac0cba60 0x7f43ac16cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43bac8d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0d1970 con 0x7f43ac0ce100 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43bac8d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac169320 con 0x7f43ac039ab0 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43bac8d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0cbfb0 con 0x7f43ac0cba60 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac0cba60 0x7f43ac16cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac0cba60 0x7f43ac16cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:45988/0 (socket says 172.21.15.99:45988) 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 -- 172.21.15.99:0/4197467154 learned_addr learned my addr 172.21.15.99:0/4197467154 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 -- 172.21.15.99:0/4197467154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43ac039ab0 msgr2=0x7f43ac0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43ac039ab0 0x7f43ac0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 -- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ac0ce100 msgr2=0x7f43ac16c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ac0ce100 0x7f43ac16c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 -- 172.21.15.99:0/4197467154 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b0009420 con 0x7f43ac0cba60 2024-01-19T05:18:12.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43ba48c640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac0cba60 0x7f43ac16cdd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43b404ff70 tx=0x7f43b40681b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4067b00 con 0x7f43ac0cba60 2024-01-19T05:18:12.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4093440 con 0x7f43ac0cba60 2024-01-19T05:18:12.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40937f0 con 0x7f43ac0cba60 2024-01-19T05:18:12.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f43bac8d640 1 -- 172.21.15.99:0/4197467154 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac0d1690 con 0x7f43ac0cba60 2024-01-19T05:18:12.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f43bac8d640 1 -- 172.21.15.99:0/4197467154 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac1698c0 con 0x7f43ac0cba60 2024-01-19T05:18:12.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f43bac8d640 1 -- 172.21.15.99:0/4197467154 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43ac03a7f0 con 0x7f43ac0cba60 2024-01-19T05:18:12.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0be97b640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0b00379b0 0x7fd0b00c57b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80641b0 tx=0x7fd0b8093840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0aeffd640 1 -- 172.21.15.99:0/2757993712 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b812d070 con 0x7fd0b00379b0 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0aeffd640 1 -- 172.21.15.99:0/2757993712 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8067300 con 0x7fd0b00379b0 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0aeffd640 1 -- 172.21.15.99:0/2757993712 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8128670 con 0x7fd0b00379b0 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0c03de640 1 -- 172.21.15.99:0/2757993712 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b00c5040 con 0x7fd0b00379b0 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fd0c03de640 1 -- 172.21.15.99:0/2757993712 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b00be1a0 con 0x7fd0b00379b0 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fd0aeffd640 1 -- 172.21.15.99:0/2757993712 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd0b8125070 con 0x7fd0b00379b0 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fd0aeffd640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd09c066500 0x7fd09c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fd0aeffd640 1 -- 172.21.15.99:0/2757993712 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0b8197680 con 0x7fd0b00379b0 2024-01-19T05:18:12.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fd0be17a640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd09c066500 0x7fd09c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fb140c5a640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0b6090 0x7fb13c137e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb134007e10 tx=0x7fb13400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134014620 con 0x7fb13c0b6090 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134014780 con 0x7fb13c0b6090 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134014b30 con 0x7fb13c0b6090 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fb14145b640 1 -- 172.21.15.99:0/1901441701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c132a50 con 0x7fb13c0b6090 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fb14145b640 1 -- 172.21.15.99:0/1901441701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c1327a0 con 0x7fb13c0b6090 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fb14145b640 1 -- 172.21.15.99:0/1901441701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb11c001040 con 0x7fb13c0b6090 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 -- start start 2024-01-19T05:18:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48005190 0x7f5e600b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e600b2730 0x7f5e6014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e6014c900 0x7f5e601db0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600b1f30 con 0x7f5e600b2730 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e601427c0 con 0x7f5e6014c900 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600b1aa0 con 0x7f5e48005190 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48005190 0x7f5e600b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48005190 0x7f5e600b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:45974/0 (socket says 172.21.15.99:45974) 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 -- 172.21.15.99:0/2000335078 learned_addr learned my addr 172.21.15.99:0/2000335078 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 -- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e6014c900 msgr2=0x7f5e601db0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e6014c900 0x7f5e601db0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 -- 172.21.15.99:0/2000335078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e600b2730 msgr2=0x7f5e6014c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e600b2730 0x7f5e6014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 -- 172.21.15.99:0/2000335078 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60142a10 con 0x7f5e48005190 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5e59c640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48005190 0x7f5e600b11e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800f430 tx=0x7f5e5800f8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800e040 con 0x7f5e48005190 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5800f040 con 0x7f5e48005190 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580092d0 con 0x7f5e48005190 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e600b2bf0 con 0x7f5e48005190 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6014e2c0 con 0x7f5e48005190 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e601448c0 con 0x7f5e48005190 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5e58003ba0 con 0x7f5e48005190 2024-01-19T05:18:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e4effd640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e40066500 0x7f5e400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e58084d30 con 0x7f5e48005190 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e4effd640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f5e4006e720 0x7f5e40070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 --> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e400711f0 con 0x7f5e4006e720 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e580850e0 con 0x7f5e48005190 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e5dd9b640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e40066500 0x7f5e400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f075ab9a640 1 -- 172.21.15.99:0/1205511651 shutdown_connections 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f075ab9a640 1 -- 172.21.15.99:0/1205511651 wait complete. 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f075ab9a640 1 Processor -- start 2024-01-19T05:18:12.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 -- start start 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f075406b780 0x7f0754153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f075406bb60 0x7f07541ebe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f075406e9c0 0x7f075409c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07541eba20 con 0x7f075406e9c0 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075414cc60 con 0x7f075406b780 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075409d0b0 con 0x7f075406bb60 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f075406b780 0x7f0754153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f075406b780 0x7f0754153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47082/0 (socket says 172.21.15.99:47082) 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 -- 172.21.15.99:0/3248523772 learned_addr learned my addr 172.21.15.99:0/3248523772 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f809d320 con 0x7f27f80ad380 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f813f530 con 0x7f27f80ad380 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27f809d840 con 0x7f27f80ad380 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f00b9660 con 0x7f27f80ad380 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00b9a10 con 0x7f27f80ad380 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 -- 172.21.15.99:0/731119435 shutdown_connections 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 --2- 172.21.15.99:0/731119435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60071eb0 0x7fbc60072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 --2- 172.21.15.99:0/731119435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc60144fd0 0x7fbc600702f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 -- 172.21.15.99:0/731119435 >> 172.21.15.99:0/731119435 conn(0x7fbc60066e30 msgr2=0x7fbc600b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 -- 172.21.15.99:0/731119435 shutdown_connections 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 -- 172.21.15.99:0/731119435 wait complete. 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 Processor -- start 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.657+0000 7fbc66c0a640 1 -- start start 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc66c0a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc60071eb0 0x7fbc60148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc66c0a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc600b5670 0x7fbc60148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc66c0a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60144fd0 0x7fbc60149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc66c0a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601475f0 con 0x7fbc60071eb0 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc66c0a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6014b630 con 0x7fbc600b5670 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc66c0a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6014a5b0 con 0x7fbc60144fd0 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60144fd0 0x7fbc60149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc5ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc600b5670 0x7fbc60148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60144fd0 0x7fbc60149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:45998/0 (socket says 172.21.15.99:45998) 2024-01-19T05:18:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 -- 172.21.15.99:0/151459424 learned_addr learned my addr 172.21.15.99:0/151459424 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc5ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc600b5670 0x7fbc60148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47076/0 (socket says 172.21.15.99:47076) 2024-01-19T05:18:12.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 -- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc600b5670 msgr2=0x7fbc60148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc600b5670 0x7fbc60148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 -- 172.21.15.99:0/151459424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc60071eb0 msgr2=0x7fbc60148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc60071eb0 0x7fbc60148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 -- 172.21.15.99:0/151459424 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc48009420 con 0x7fbc60144fd0 2024-01-19T05:18:12.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fbc659a8640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60144fd0 0x7fbc60149130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800e930 tx=0x7fbc5800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e5ed9d640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f5e4006e720 0x7f5e40070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fd0be17a640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd09c066500 0x7fd09c0689c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009a40 tx=0x7fd0b4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e5dd9b640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e40066500 0x7f5e400689c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e60143ad0 tx=0x7f5e54001630 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f5e5ed9d640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f5e4006e720 0x7f5e40070b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0753fff640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f075406bb60 0x7f07541ebe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 -- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f075406bb60 msgr2=0x7f07541ebe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f075406bb60 0x7f07541ebe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 -- 172.21.15.99:0/3248523772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f075406e9c0 msgr2=0x7f075409c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f075406e9c0 0x7f075409c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 -- 172.21.15.99:0/3248523772 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009420 con 0x7f075406b780 2024-01-19T05:18:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f0758936640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f075406b780 0x7f0754153cc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f074c00efc0 tx=0x7f074c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c009b60 con 0x7f075406b780 2024-01-19T05:18:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07540add00 con 0x7f075406b780 2024-01-19T05:18:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0754154a80 con 0x7f075406b780 2024-01-19T05:18:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c00f040 con 0x7f075406b780 2024-01-19T05:18:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0039a0 con 0x7f075406b780 2024-01-19T05:18:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f27f00b9b70 con 0x7f27f80ad380 2024-01-19T05:18:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f43b40923e0 con 0x7f43ac0cba60 2024-01-19T05:18:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fd0c03de640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7fd0a0001660 0x7fd0a0003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.661+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 <== osd.0 v2:172.21.15.99:6800/131365086 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7feaa0071240 con 0x7feaa006e770 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43aa7fc640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4398066530 0x7f43980689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43b40fe9b0 con 0x7f43ac0cba60 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43b9c8b640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4398066530 0x7f43980689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43aa7fc640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f439806e5e0 0x7f4398070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 --> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43980710b0 con 0x7f439806e5e0 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43b40fed60 con 0x7f43ac0cba60 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43b948a640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f439806e5e0 0x7f4398070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43b948a640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f439806e5e0 0x7f4398070a00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 <== osd.1 v2:172.21.15.99:6812/2851887188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f43980710b0 con 0x7f439806e5e0 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fd0bd979640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7fd0a0001660 0x7fd0a0003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fd0c03de640 1 -- 172.21.15.99:0/2757993712 --> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0a0006bc0 con 0x7fd0a0001660 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fd0bd979640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7fd0a0001660 0x7fd0a0003b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fd0aeffd640 1 -- 172.21.15.99:0/2757993712 <== osd.2 v2:172.21.15.99:6824/296546613 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd0a0006bc0 con 0x7fd0a0001660 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb134014c90 con 0x7fb13c0b6090 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb138ff9640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb1280665d0 0x7fb128068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1340854e0 con 0x7fb13c0b6090 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb138ff9640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7fb12806e7f0 0x7fb128070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 --> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1280712c0 con 0x7fb12806e7f0 2024-01-19T05:18:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb134085890 con 0x7fb13c0b6090 2024-01-19T05:18:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb13b7fe640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7fb12806e7f0 0x7fb128070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb13b7fe640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7fb12806e7f0 0x7fb128070c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb13bfff640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb1280665d0 0x7fb128068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 <== osd.3 v2:172.21.15.99:6808/3419007009 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb1280712c0 con 0x7fb12806e7f0 2024-01-19T05:18:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fb13bfff640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb1280665d0 0x7fb128068a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0b93a0 tx=0x7fb12c009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 <== osd.4 v2:172.21.15.157:6809/888701730 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5e400711f0 con 0x7f5e4006e720 2024-01-19T05:18:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0734001040 con 0x7f075406b780 2024-01-19T05:18:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27dffff640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e40665d0 0x7f27e4068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27f011f280 con 0x7f27f80ad380 2024-01-19T05:18:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27dffff640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7f27e406e680 0x7f27e4070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 --> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27e4071150 con 0x7f27e406e680 2024-01-19T05:18:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27f011f630 con 0x7f27f80ad380 2024-01-19T05:18:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27f7fff640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7f27e406e680 0x7f27e4070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27f77fe640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e40665d0 0x7f27e4068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27f77fe640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e40665d0 0x7f27e4068a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27e80049e0 tx=0x7f27e8006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc580096b0 con 0x7fbc60144fd0 2024-01-19T05:18:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800c9a0 con 0x7fbc60144fd0 2024-01-19T05:18:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800cd30 con 0x7fbc60144fd0 2024-01-19T05:18:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc601478d0 con 0x7fbc60144fd0 2024-01-19T05:18:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6014b8b0 con 0x7fbc60144fd0 2024-01-19T05:18:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc600b5f20 con 0x7fbc60144fd0 2024-01-19T05:18:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f27f7fff640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7f27e406e680 0x7f27e4070aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f074c003b00 con 0x7f075406b780 2024-01-19T05:18:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f07517fa640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0740066500 0x7f07400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f074c085210 con 0x7f075406b780 2024-01-19T05:18:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f07517fa640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f074006e720 0x7f0740070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 --> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07400711f0 con 0x7f074006e720 2024-01-19T05:18:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.665+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f074c0855c0 con 0x7f075406b780 2024-01-19T05:18:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaac051ae0 con 0x7fea9c0047d0 2024-01-19T05:18:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7f43b9c8b640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4398066530 0x7f43980689f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009770 tx=0x7f43a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbc58013470 con 0x7fbc60144fd0 2024-01-19T05:18:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 <== osd.6 v2:172.21.15.157:6808/536345226 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f27e4071150 con 0x7f27e406e680 2024-01-19T05:18:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc5d7fa640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbc400665d0 0x7fbc40068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc649a6640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbc400665d0 0x7fbc40068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc649a6640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbc400665d0 0x7fbc40068a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc50000f90 tx=0x7fbc50007c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc580843e0 con 0x7fbc60144fd0 2024-01-19T05:18:12.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc5d7fa640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fbc4006e7f0 0x7fbc40070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 --> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc400712c0 con 0x7fbc4006e7f0 2024-01-19T05:18:12.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc58084790 con 0x7fbc60144fd0 2024-01-19T05:18:12.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc5ffff640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fbc4006e7f0 0x7fbc40070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.669+0000 7fbc5ffff640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fbc4006e7f0 0x7fbc40070c10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.673+0000 7f0759137640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f074006e720 0x7f0740070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.673+0000 7f0753fff640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0740066500 0x7f07400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.673+0000 7f0753fff640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0740066500 0x7f07400689c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07480af000 tx=0x7f0748008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.673+0000 7f0759137640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f074006e720 0x7f0740070b40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.677+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 <== osd.5 v2:172.21.15.157:6807/3649552388 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f07400711f0 con 0x7f074006e720 2024-01-19T05:18:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.685+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 <== osd.7 v2:172.21.15.157:6800/2904682777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbc400712c0 con 0x7fbc4006e7f0 2024-01-19T05:18:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7f43bac8d640 1 -- 172.21.15.99:0/4197467154 --> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f43ac0057f0 con 0x7f439806e5e0 2024-01-19T05:18:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 --> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feab40b2920 con 0x7feaa006e770 2024-01-19T05:18:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7fea9b7fe640 1 -- 172.21.15.99:0/274402490 <== osd.0 v2:172.21.15.99:6800/131365086 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feaa400b1f0 con 0x7feaa006e770 2024-01-19T05:18:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7f43aa7fc640 1 -- 172.21.15.99:0/4197467154 <== osd.1 v2:172.21.15.99:6812/2851887188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f43ac0057f0 con 0x7f439806e5e0 2024-01-19T05:18:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7fd0c03de640 1 -- 172.21.15.99:0/2757993712 --> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0a0005ca0 con 0x7fd0a0001660 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7feaa006e770 msgr2=0x7feaa0070b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7feaa006e770 0x7feaa0070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feaa00665d0 msgr2=0x7feaa0068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feaa00665d0 0x7feaa0068a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feaa80ab000 tx=0x7feaa80a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 msgr2=0x7feab4135720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 --2- 172.21.15.99:0/274402490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c0047d0 0x7feab4135720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feaac007e70 tx=0x7feaac00e4b0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab37fe640 1 -- 172.21.15.99:0/274402490 reap_dead start 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 shutdown_connections 2024-01-19T05:18:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 >> 172.21.15.99:0/274402490 conn(0x7feab40b4880 msgr2=0x7feab40b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 shutdown_connections 2024-01-19T05:18:12.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.693+0000 7feab3fff640 1 -- 172.21.15.99:0/274402490 wait complete. 2024-01-19T05:18:12.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0aeffd640 1 -- 172.21.15.99:0/2757993712 <== osd.2 v2:172.21.15.99:6824/296546613 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd0a0005ca0 con 0x7fd0a0001660 2024-01-19T05:18:12.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 -- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f439806e5e0 msgr2=0x7f4398070a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f439806e5e0 0x7f4398070a00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 -- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4398066530 msgr2=0x7f43980689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4398066530 0x7f43980689f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009770 tx=0x7f43a4008040 comp rx=0 tx=0).stop 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 -- 172.21.15.99:0/4197467154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac0cba60 msgr2=0x7f43ac16cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 --2- 172.21.15.99:0/4197467154 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43ac0cba60 0x7f43ac16cdd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43b404ff70 tx=0x7f43b40681b0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f43ba48c640 1 -- 172.21.15.99:0/4197467154 reap_dead start 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 -- 172.21.15.99:0/4197467154 shutdown_connections 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 -- 172.21.15.99:0/4197467154 >> 172.21.15.99:0/4197467154 conn(0x7f43ac0061b0 msgr2=0x7f43ac0c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb14145b640 1 -- 172.21.15.99:0/1901441701 --> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb11c002d40 con 0x7fb12806e7f0 2024-01-19T05:18:12.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 --> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e600b8a20 con 0x7f5e4006e720 2024-01-19T05:18:12.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 -- 172.21.15.99:0/4197467154 shutdown_connections 2024-01-19T05:18:12.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 -- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7fd0a0001660 msgr2=0x7fd0a0003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f4397fff640 1 -- 172.21.15.99:0/4197467154 wait complete. 2024-01-19T05:18:12.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7fd0a0001660 0x7fd0a0003b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb138ff9640 1 -- 172.21.15.99:0/1901441701 <== osd.3 v2:172.21.15.99:6808/3419007009 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb11c002d40 con 0x7fb12806e7f0 2024-01-19T05:18:12.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e4effd640 1 -- 172.21.15.99:0/2000335078 <== osd.4 v2:172.21.15.157:6809/888701730 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e600b8a20 con 0x7f5e4006e720 2024-01-19T05:18:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 -- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd09c066500 msgr2=0x7fd09c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd09c066500 0x7fd09c0689c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009a40 tx=0x7fd0b4009190 comp rx=0 tx=0).stop 2024-01-19T05:18:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 -- 172.21.15.99:0/2757993712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0b00379b0 msgr2=0x7fd0b00c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 --2- 172.21.15.99:0/2757993712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd0b00379b0 0x7fd0b00c57b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80641b0 tx=0x7fd0b8093840 comp rx=0 tx=0).stop 2024-01-19T05:18:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0be97b640 1 -- 172.21.15.99:0/2757993712 reap_dead start 2024-01-19T05:18:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 -- 172.21.15.99:0/2757993712 shutdown_connections 2024-01-19T05:18:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 -- 172.21.15.99:0/2757993712 >> 172.21.15.99:0/2757993712 conn(0x7fd0b003a890 msgr2=0x7fd0b00cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 -- 172.21.15.99:0/2757993712 shutdown_connections 2024-01-19T05:18:12.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 -- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7fb12806e7f0 msgr2=0x7fb128070c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7fb12806e7f0 0x7fb128070c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fd0acff9640 1 -- 172.21.15.99:0/2757993712 wait complete. 2024-01-19T05:18:12.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f5e4006e720 msgr2=0x7f5e40070b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 -- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb1280665d0 msgr2=0x7fb128068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb1280665d0 0x7fb128068a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0b93a0 tx=0x7fb12c009060 comp rx=0 tx=0).stop 2024-01-19T05:18:12.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 -- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0b6090 msgr2=0x7fb13c137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 --2- 172.21.15.99:0/1901441701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb13c0b6090 0x7fb13c137e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb134007e10 tx=0x7fb13400e4b0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb140c5a640 1 -- 172.21.15.99:0/1901441701 reap_dead start 2024-01-19T05:18:12.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 -- 172.21.15.99:0/1901441701 shutdown_connections 2024-01-19T05:18:12.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 -- 172.21.15.99:0/1901441701 >> 172.21.15.99:0/1901441701 conn(0x7fb13c0667f0 msgr2=0x7fb13c1336d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 -- 172.21.15.99:0/1901441701 shutdown_connections 2024-01-19T05:18:12.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7fb1227fc640 1 -- 172.21.15.99:0/1901441701 wait complete. 2024-01-19T05:18:12.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 --> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0734002d40 con 0x7f074006e720 2024-01-19T05:18:12.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f5e4006e720 0x7f5e40070b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e40066500 msgr2=0x7f5e400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e40066500 0x7f5e400689c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e60143ad0 tx=0x7f5e54001630 comp rx=0 tx=0).stop 2024-01-19T05:18:12.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48005190 msgr2=0x7f5e600b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 --2- 172.21.15.99:0/2000335078 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e48005190 0x7f5e600b11e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800f430 tx=0x7f5e5800f8f0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5ed9d640 1 -- 172.21.15.99:0/2000335078 reap_dead start 2024-01-19T05:18:12.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 shutdown_connections 2024-01-19T05:18:12.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 >> 172.21.15.99:0/2000335078 conn(0x7f5e600667f0 msgr2=0x7f5e600735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 shutdown_connections 2024-01-19T05:18:12.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f5e5f59e640 1 -- 172.21.15.99:0/2000335078 wait complete. 2024-01-19T05:18:12.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f07517fa640 1 -- 172.21.15.99:0/3248523772 <== osd.5 v2:172.21.15.157:6807/3649552388 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0734002d40 con 0x7f074006e720 2024-01-19T05:18:12.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f074006e720 msgr2=0x7f0740070b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.697+0000 7f075ab9a640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f074006e720 0x7f0740070b40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0740066500 msgr2=0x7f07400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f075ab9a640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0740066500 0x7f07400689c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07480af000 tx=0x7f0748008040 comp rx=0 tx=0).stop 2024-01-19T05:18:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f075406b780 msgr2=0x7f0754153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f075ab9a640 1 --2- 172.21.15.99:0/3248523772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f075406b780 0x7f0754153cc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f074c00efc0 tx=0x7f074c00c490 comp rx=0 tx=0).stop 2024-01-19T05:18:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f0759137640 1 -- 172.21.15.99:0/3248523772 reap_dead start 2024-01-19T05:18:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 shutdown_connections 2024-01-19T05:18:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 >> 172.21.15.99:0/3248523772 conn(0x7f07540b7d80 msgr2=0x7f07540b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 shutdown_connections 2024-01-19T05:18:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f075ab9a640 1 -- 172.21.15.99:0/3248523772 wait complete. 2024-01-19T05:18:12.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 --> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27f8069560 con 0x7f27e406e680 2024-01-19T05:18:12.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27dffff640 1 -- 172.21.15.99:0/1533928775 <== osd.6 v2:172.21.15.157:6808/536345226 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f27f8069560 con 0x7f27e406e680 2024-01-19T05:18:12.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7f27e406e680 msgr2=0x7f27e4070aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7f27e406e680 0x7f27e4070aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e40665d0 msgr2=0x7f27e4068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e40665d0 0x7f27e4068a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27e80049e0 tx=0x7f27e8006040 comp rx=0 tx=0).stop 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f80ad380 msgr2=0x7f27f813eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 --2- 172.21.15.99:0/1533928775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f80ad380 0x7f27f813eff0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27f00ac000 tx=0x7f27f0019670 comp rx=0 tx=0).stop 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27f7fff640 1 -- 172.21.15.99:0/1533928775 reap_dead start 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 shutdown_connections 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 >> 172.21.15.99:0/1533928775 conn(0x7f27f80b4880 msgr2=0x7f27f806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 shutdown_connections 2024-01-19T05:18:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.701+0000 7f27fcbe5640 1 -- 172.21.15.99:0/1533928775 wait complete. 2024-01-19T05:18:12.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 --> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc60141e30 con 0x7fbc4006e7f0 2024-01-19T05:18:12.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc5d7fa640 1 -- 172.21.15.99:0/151459424 <== osd.7 v2:172.21.15.157:6800/2904682777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc60141e30 con 0x7fbc4006e7f0 2024-01-19T05:18:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fbc4006e7f0 msgr2=0x7fbc40070c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fbc4006e7f0 0x7fbc40070c10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbc400665d0 msgr2=0x7fbc40068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbc400665d0 0x7fbc40068a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc50000f90 tx=0x7fbc50007c90 comp rx=0 tx=0).stop 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60144fd0 msgr2=0x7fbc60149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 --2- 172.21.15.99:0/151459424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc60144fd0 0x7fbc60149130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800e930 tx=0x7fbc5800edf0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc659a8640 1 -- 172.21.15.99:0/151459424 reap_dead start 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 shutdown_connections 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 >> 172.21.15.99:0/151459424 conn(0x7fbc60066e30 msgr2=0x7fbc60140870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 shutdown_connections 2024-01-19T05:18:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.709+0000 7fbc66c0a640 1 -- 172.21.15.99:0/151459424 wait complete. 2024-01-19T05:18:12.754 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:12.754 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-19T05:18:12.755 INFO:teuthology.orchestra.run.smithi099.stdout:55834574856 2024-01-19T05:18:12.755 INFO:teuthology.orchestra.run.smithi099.stdout:55834574856 2024-01-19T05:18:12.756 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:12.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-19T05:18:12.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-19T05:18:12.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-19T05:18:12.758 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:12.759 INFO:teuthology.orchestra.run.smithi099.stdout:55834574856 2024-01-19T05:18:12.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-19T05:18:12.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-19T05:18:12.761 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-01-19T05:18:12.761 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-19T05:18:12.762 INFO:teuthology.orchestra.run.smithi099.stdout:55834574856 2024-01-19T05:18:12.762 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-19T05:18:12.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7ff6dc85b640 1 Processor -- start 2024-01-19T05:18:12.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7ff6dc85b640 1 -- start start 2024-01-19T05:18:12.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7f2ac8d21640 1 Processor -- start 2024-01-19T05:18:12.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7fb8c2755640 1 Processor -- start 2024-01-19T05:18:12.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7fb8c2755640 1 -- start start 2024-01-19T05:18:12.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7f0de5e64640 1 Processor -- start 2024-01-19T05:18:12.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7f618410f640 1 Processor -- start 2024-01-19T05:18:12.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7f618410f640 1 -- start start 2024-01-19T05:18:12.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7ff6dc85b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff6d806ba80 0x7ff6d806be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7ff6dc85b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d814a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7ff6dc85b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6d80b7670 0x7ff6d80b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7ff6dc85b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d80b6e70 con 0x7ff6d80b7670 2024-01-19T05:18:12.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7ff6dc85b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d814ac60 con 0x7ff6d806ba80 2024-01-19T05:18:12.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7ff6dc85b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80b7050 con 0x7ff6d814a2d0 2024-01-19T05:18:12.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7f2ac8d21640 1 -- start start 2024-01-19T05:18:12.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7f5724e95640 1 Processor -- start 2024-01-19T05:18:12.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7f0de5e64640 1 -- start start 2024-01-19T05:18:12.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d759e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6d80b7670 0x7ff6d80b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d759e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6d80b7670 0x7ff6d80b7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55074/0 (socket says 172.21.15.99:55074) 2024-01-19T05:18:12.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d759e640 1 -- 172.21.15.99:0/2336409902 learned_addr learned my addr 172.21.15.99:0/2336409902 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d659c640 1 --2- 172.21.15.99:0/2336409902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d6d9d640 1 --2- 172.21.15.99:0/2336409902 >> v2:172.21.15.157:3300/0 conn(0x7ff6d806ba80 0x7ff6d806be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56c572640 1 Processor -- start 2024-01-19T05:18:12.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f5724e95640 1 -- start start 2024-01-19T05:18:12.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7fb8c2755640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0b38b0 0x7fb8bc0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7fb8c2755640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb8bc0ae910 0x7fb8bc1427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7fb8c2755640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc0b3420 con 0x7fb8bc0ae4b0 2024-01-19T05:18:12.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7fb8c2755640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8bc0722d0 con 0x7fb8bc0ae910 2024-01-19T05:18:12.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.965+0000 7fb8c2755640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0b56f0 con 0x7fb8bc0b38b0 2024-01-19T05:18:12.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facb6fdc640 1 Processor -- start 2024-01-19T05:18:12.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac8d21640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2abc039e30 0x7f2abc0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac8d21640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2abc01b8c0 0x7f2abc0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac8d21640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc01d2e0 con 0x7f2abc006490 2024-01-19T05:18:12.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac8d21640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc01c920 con 0x7f2abc01b8c0 2024-01-19T05:18:12.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac8d21640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc01d880 con 0x7f2abc039e30 2024-01-19T05:18:12.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facb6fdc640 1 -- start start 2024-01-19T05:18:12.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac37fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2abc006490 0x7f2abc031560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:33276/0 (socket says 172.21.15.99:33276) 2024-01-19T05:18:12.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac37fe640 1 -- 172.21.15.99:0/1782574154 learned_addr learned my addr 172.21.15.99:0/1782574154 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:12.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56c572640 1 -- start start 2024-01-19T05:18:12.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f618410f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0af7e0 0x7f617c0b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac2ffd640 1 --2- 172.21.15.99:0/1782574154 >> v2:172.21.15.157:3300/0 conn(0x7f2abc039e30 0x7f2abc0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac3fff640 1 --2- 172.21.15.99:0/1782574154 >> v2:172.21.15.99:3300/0 conn(0x7f2abc01b8c0 0x7f2abc0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f618410f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f617c0ae9e0 0x7f617c0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de5e64640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd80cb050 0x7f0dd8036880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de5e64640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0dd8036dc0 0x7f0dd80d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de4e62640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0dd80cac70 0x7f0dd8038130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33284/0 (socket says 172.21.15.99:33284) 2024-01-19T05:18:12.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de4e62640 1 -- 172.21.15.99:0/3286323638 learned_addr learned my addr 172.21.15.99:0/3286323638 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:12.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de5e64640 1 -- 172.21.15.99:0/3286323638 --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd8038840 con 0x7f0dd80cac70 2024-01-19T05:18:12.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213025911 0 0) 0x7f0dd8038840 con 0x7f0dd80cac70 2024-01-19T05:18:12.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de5e64640 1 -- 172.21.15.99:0/3286323638 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80d0bc0 con 0x7f0dd8036dc0 2024-01-19T05:18:12.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de5e64640 1 -- 172.21.15.99:0/3286323638 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8039bd0 con 0x7f0dd80cb050 2024-01-19T05:18:12.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d659c640 1 -- 172.21.15.99:0/2336409902 >> v2:172.21.15.157:3300/0 conn(0x7ff6d806ba80 msgr2=0x7ff6d806be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d659c640 1 --2- 172.21.15.99:0/2336409902 >> v2:172.21.15.157:3300/0 conn(0x7ff6d806ba80 0x7ff6d806be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d659c640 1 -- 172.21.15.99:0/2336409902 >> v2:172.21.15.99:3300/0 conn(0x7ff6d80b7670 msgr2=0x7ff6d80b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d659c640 1 --2- 172.21.15.99:0/2336409902 >> v2:172.21.15.99:3300/0 conn(0x7ff6d80b7670 0x7ff6d80b7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7ff6d659c640 1 -- 172.21.15.99:0/2336409902 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80b7330 con 0x7ff6d814a2d0 2024-01-19T05:18:12.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f5724e95640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5720072100 0x7f572014e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f5724e95640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200b3730 con 0x7f572006b9e0 2024-01-19T05:18:12.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f5724e95640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200725b0 con 0x7f57200ae300 2024-01-19T05:18:12.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f5724e95640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200ae770 con 0x7f5720072100 2024-01-19T05:18:12.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f571ed9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5720072100 0x7f572014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f571ed9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5720072100 0x7f572014e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55106/0 (socket says 172.21.15.99:55106) 2024-01-19T05:18:12.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f571ed9d640 1 -- 172.21.15.99:0/2125539511 learned_addr learned my addr 172.21.15.99:0/2125539511 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb8c1f54640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb8bc0ae910 0x7fb8bc1427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb8c1f54640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb8bc0ae910 0x7fb8bc1427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47118/0 (socket says 172.21.15.99:47118) 2024-01-19T05:18:12.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb8c1f54640 1 -- 172.21.15.99:0/3738657458 learned_addr learned my addr 172.21.15.99:0/3738657458 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb8c1753640 1 --2- 172.21.15.99:0/3738657458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0b38b0 0x7fb8bc0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f618410f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c0b0a40 con 0x7f617c0ae600 2024-01-19T05:18:12.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f618410f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c0af0b0 con 0x7f617c0ae9e0 2024-01-19T05:18:12.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f618410f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0b3130 con 0x7f617c0af7e0 2024-01-19T05:18:12.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f61826ac640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f617c0ae9e0 0x7f617c0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f6181eab640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f617c0ae600 0x7f617c1434c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:33288/0 (socket says 172.21.15.99:33288) 2024-01-19T05:18:12.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f6181eab640 1 -- 172.21.15.99:0/580425194 learned_addr learned my addr 172.21.15.99:0/580425194 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:12.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f61816aa640 1 --2- 172.21.15.99:0/580425194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0af7e0 0x7f617c0b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56c572640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5640ba960 0x7fb564071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56c572640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb56409cc30 0x7fb5641415d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56c572640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640723f0 con 0x7fb564147a70 2024-01-19T05:18:12.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56c572640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640717b0 con 0x7fb56409cc30 2024-01-19T05:18:12.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56c572640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640bad40 con 0x7fb5640ba960 2024-01-19T05:18:12.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd0003530 con 0x7f0dd80cac70 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddffff640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd80cb050 0x7f0dd8036880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de5663640 1 --2- 172.21.15.99:0/3286323638 >> v2:172.21.15.99:3300/0 conn(0x7f0dd8036dc0 0x7f0dd80d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2354730643 0 0) 0x7f0dd0003530 con 0x7f0dd80cac70 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd80cb050 msgr2=0x7f0dd8036880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd80cb050 0x7f0dd8036880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 >> v2:172.21.15.99:3300/0 conn(0x7f0dd8036dc0 msgr2=0x7f0dd80d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 --2- 172.21.15.99:0/3286323638 >> v2:172.21.15.99:3300/0 conn(0x7f0dd8036dc0 0x7f0dd80d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8037250 con 0x7f0dd80cac70 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f0dd40016a0 con 0x7f0dd80cac70 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 >> v1:172.21.15.99:6789/0 conn(0x7f0dd80cac70 legacy=0x7f0dd8038130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00047d0 0x7f0dd0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd0005190 0x7f0dd001c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80d0bc0 con 0x7f0dd00047d0 2024-01-19T05:18:12.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8039bd0 con 0x7f0dd0003980 2024-01-19T05:18:12.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd001cfe0 con 0x7f0dd0005190 2024-01-19T05:18:12.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac2ffd640 1 -- 172.21.15.99:0/1782574154 >> v2:172.21.15.99:3300/0 conn(0x7f2abc01b8c0 msgr2=0x7f2abc0d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac2ffd640 1 --2- 172.21.15.99:0/1782574154 >> v2:172.21.15.99:3300/0 conn(0x7f2abc01b8c0 0x7f2abc0d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac2ffd640 1 -- 172.21.15.99:0/1782574154 >> v1:172.21.15.157:6789/0 conn(0x7f2abc006490 legacy=0x7f2abc031560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f2ac2ffd640 1 -- 172.21.15.99:0/1782574154 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc01cb70 con 0x7f2abc039e30 2024-01-19T05:18:12.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facb6fdc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb006b9e0 0x7facb00ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facb6fdc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7facb00b2780 0x7facb00b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:12.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de5663640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd0005190 0x7f0dd001c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de4e62640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facb6fdc640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00b4230 con 0x7facb00b3140 2024-01-19T05:18:12.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facb6fdc640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb00b4480 con 0x7facb00b2780 2024-01-19T05:18:12.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facb6fdc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb009d3c0 con 0x7facb006b9e0 2024-01-19T05:18:12.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f61826ac640 1 -- 172.21.15.99:0/580425194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0af7e0 msgr2=0x7f617c0b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f61826ac640 1 --2- 172.21.15.99:0/580425194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0af7e0 0x7f617c0b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f61826ac640 1 -- 172.21.15.99:0/580425194 >> v1:172.21.15.157:6789/0 conn(0x7f617c0ae600 legacy=0x7f617c1434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f61826ac640 1 -- 172.21.15.99:0/580425194 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0af2c0 con 0x7f617c0ae9e0 2024-01-19T05:18:12.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f571ed9d640 1 -- 172.21.15.99:0/2125539511 >> v1:172.21.15.157:6789/0 conn(0x7f57200ae300 legacy=0x7f57200719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f571ed9d640 1 -- 172.21.15.99:0/2125539511 >> v1:172.21.15.99:6789/0 conn(0x7f572006b9e0 legacy=0x7f57200b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f571ed9d640 1 -- 172.21.15.99:0/2125539511 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572006bdc0 con 0x7f5720072100 2024-01-19T05:18:12.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facaffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7facb00b2780 0x7facb00b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facaffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7facb00b2780 0x7facb00b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55118/0 (socket says 172.21.15.99:55118) 2024-01-19T05:18:12.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facaffff640 1 -- 172.21.15.99:0/3690241331 learned_addr learned my addr 172.21.15.99:0/3690241331 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56a30e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5640ba960 0x7fb564071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56a30e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5640ba960 0x7fb564071eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:46074/0 (socket says 172.21.15.99:46074) 2024-01-19T05:18:12.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56a30e640 1 -- 172.21.15.99:0/2575369583 learned_addr learned my addr 172.21.15.99:0/2575369583 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:12.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facaffff640 1 -- 172.21.15.99:0/3690241331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb006b9e0 msgr2=0x7facb00ad1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-19T05:18:12.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facaffff640 1 --2- 172.21.15.99:0/3690241331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb006b9e0 0x7facb00ad1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facaffff640 1 -- 172.21.15.99:0/3690241331 >> v1:172.21.15.99:6789/0 conn(0x7facb00b3140 legacy=0x7facb0149fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T05:18:12.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7facaffff640 1 -- 172.21.15.99:0/3690241331 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00b35d0 con 0x7facb00b2780 2024-01-19T05:18:12.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb569b0d640 1 --2- 172.21.15.99:0/2575369583 >> v2:172.21.15.99:3300/0 conn(0x7fb56409cc30 0x7fb5641415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0ddffff640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00047d0 0x7f0dd0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:12.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de4e62640 1 -- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd0005190 msgr2=0x7f0dd001c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56a30e640 1 -- 172.21.15.99:0/2575369583 >> v2:172.21.15.99:3300/0 conn(0x7fb56409cc30 msgr2=0x7fb5641415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de4e62640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd0005190 0x7f0dd001c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de4e62640 1 -- 172.21.15.99:0/3286323638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00047d0 msgr2=0x7f0dd0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de4e62640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00047d0 0x7f0dd0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7f0de4e62640 1 -- 172.21.15.99:0/3286323638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8037250 con 0x7f0dd0003980 2024-01-19T05:18:12.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6d659c640 1 --2- 172.21.15.99:0/2336409902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d814a720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6d806d4a0 tx=0x7ff6cc01c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaabb168316d42e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f0ddffff640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd00047d0 0x7f0dd0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:12.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb8c1f54640 1 -- 172.21.15.99:0/3738657458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0b38b0 msgr2=0x7fb8bc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb8c1f54640 1 --2- 172.21.15.99:0/3738657458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0b38b0 0x7fb8bc0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb8c1f54640 1 -- 172.21.15.99:0/3738657458 >> v1:172.21.15.99:6789/0 conn(0x7fb8bc0ae4b0 legacy=0x7fb8bc1420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:12.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb8c1f54640 1 -- 172.21.15.99:0/3738657458 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc0afb20 con 0x7fb8bc0ae910 2024-01-19T05:18:12.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6d5d9b640 1 -- 172.21.15.99:0/2336409902 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0ab600 con 0x7ff6d814a2d0 2024-01-19T05:18:12.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56a30e640 1 --2- 172.21.15.99:0/2575369583 >> v2:172.21.15.99:3300/0 conn(0x7fb56409cc30 0x7fb5641415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56a30e640 1 -- 172.21.15.99:0/2575369583 >> v1:172.21.15.157:6789/0 conn(0x7fb564147a70 legacy=0x7fb56406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.969+0000 7fb56a30e640 1 -- 172.21.15.99:0/2575369583 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640b5580 con 0x7fb5640ba960 2024-01-19T05:18:12.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7fb569b0d640 1 --2- 172.21.15.99:0/2575369583 >> v2:172.21.15.99:3300/0 conn(0x7fb56409cc30 0x7fb5641415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:12.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac2ffd640 1 --2- 172.21.15.99:0/1782574154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc039e30 0x7f2abc0d00e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2abc007e00 tx=0x7f2ab001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6db75d370bb5cfaf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac27fc640 1 -- 172.21.15.99:0/1782574154 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00ab600 con 0x7f2abc039e30 2024-01-19T05:18:12.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac27fc640 1 -- 172.21.15.99:0/1782574154 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00a7050 con 0x7f2abc039e30 2024-01-19T05:18:12.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac27fc640 1 -- 172.21.15.99:0/1782574154 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00ab980 con 0x7f2abc039e30 2024-01-19T05:18:12.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6d5d9b640 1 -- 172.21.15.99:0/2336409902 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc0a7050 con 0x7ff6d814a2d0 2024-01-19T05:18:12.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f571ed9d640 1 --2- 172.21.15.99:0/2125539511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5720072100 0x7f572014e070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f571800d370 tx=0x7f571801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1debe1685abcd5b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f571d59a640 1 -- 172.21.15.99:0/2125539511 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180a7bd0 con 0x7f5720072100 2024-01-19T05:18:12.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f571d59a640 1 -- 172.21.15.99:0/2125539511 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57180ab070 con 0x7f5720072100 2024-01-19T05:18:12.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f571d59a640 1 -- 172.21.15.99:0/2125539511 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180b1400 con 0x7f5720072100 2024-01-19T05:18:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f61826ac640 1 --2- 172.21.15.99:0/580425194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0ae9e0 0x7f617c0b2720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f617800ba60 tx=0x7f617801eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c29f871ae442f548 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f6180ea9640 1 -- 172.21.15.99:0/580425194 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780a7ab0 con 0x7f617c0ae9e0 2024-01-19T05:18:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f6180ea9640 1 -- 172.21.15.99:0/580425194 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61780a7c10 con 0x7f617c0ae9e0 2024-01-19T05:18:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f6180ea9640 1 -- 172.21.15.99:0/580425194 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780af440 con 0x7f617c0ae9e0 2024-01-19T05:18:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7facaffff640 1 --2- 172.21.15.99:0/3690241331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00b2780 0x7facb00b2c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faca00098a0 tx=0x7faca001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94e4f3da3326d31 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7facaf7fe640 1 -- 172.21.15.99:0/3690241331 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00ab600 con 0x7facb00b2780 2024-01-19T05:18:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7facaf7fe640 1 -- 172.21.15.99:0/3690241331 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca00a7050 con 0x7facb00b2780 2024-01-19T05:18:12.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7facaf7fe640 1 -- 172.21.15.99:0/3690241331 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00ab980 con 0x7facb00b2780 2024-01-19T05:18:12.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 -- 172.21.15.99:0/2336409902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 msgr2=0x7ff6d814a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/2336409902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d814a720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6d806d4a0 tx=0x7ff6cc01c310 comp rx=0 tx=0).stop 2024-01-19T05:18:12.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac8d21640 1 -- 172.21.15.99:0/1782574154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc039e30 msgr2=0x7f2abc0d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac8d21640 1 --2- 172.21.15.99:0/1782574154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc039e30 0x7f2abc0d00e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2abc007e00 tx=0x7f2ab001c370 comp rx=0 tx=0).stop 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac8d21640 1 -- 172.21.15.99:0/1782574154 shutdown_connections 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac8d21640 1 --2- 172.21.15.99:0/1782574154 >> v2:172.21.15.99:3300/0 conn(0x7f2abc01b8c0 0x7f2abc0d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac8d21640 1 --2- 172.21.15.99:0/1782574154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc039e30 0x7f2abc0d00e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac8d21640 1 -- 172.21.15.99:0/1782574154 >> 172.21.15.99:0/1782574154 conn(0x7f2abc009c10 msgr2=0x7f2abc00a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac8d21640 1 -- 172.21.15.99:0/1782574154 shutdown_connections 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 -- 172.21.15.99:0/2336409902 shutdown_connections 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/2336409902 >> v2:172.21.15.99:3300/0 conn(0x7ff6d80b7670 0x7ff6d80b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/2336409902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d814a720 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/2336409902 >> v2:172.21.15.157:3300/0 conn(0x7ff6d806ba80 0x7ff6d806be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 -- 172.21.15.99:0/2336409902 >> 172.21.15.99:0/2336409902 conn(0x7ff6d80b8ac0 msgr2=0x7ff6d80b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:12.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f0de4e62640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd0003da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c340 tx=0x7f0dd401f3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0af258b32d9bd9a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7fb8c1f54640 1 --2- 172.21.15.99:0/3738657458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae910 0x7fb8bc1427e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a681eae21cc24350 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:12.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 -- 172.21.15.99:0/2336409902 shutdown_connections 2024-01-19T05:18:12.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f618410f640 1 -- 172.21.15.99:0/580425194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0ae9e0 msgr2=0x7f617c0b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:12.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f618410f640 1 --2- 172.21.15.99:0/580425194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0ae9e0 0x7f617c0b2720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f617800ba60 tx=0x7f617801eae0 comp rx=0 tx=0).stop 2024-01-19T05:18:12.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7ff6dc85b640 1 -- 172.21.15.99:0/2336409902 wait complete. 2024-01-19T05:18:13.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f618410f640 1 -- 172.21.15.99:0/580425194 shutdown_connections 2024-01-19T05:18:13.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f618410f640 1 --2- 172.21.15.99:0/580425194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0ae9e0 0x7f617c0b2720 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f618410f640 1 --2- 172.21.15.99:0/580425194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0af7e0 0x7f617c0b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f618410f640 1 -- 172.21.15.99:0/580425194 >> 172.21.15.99:0/580425194 conn(0x7f617c0b5970 msgr2=0x7f617c0b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7fb56a30e640 1 --2- 172.21.15.99:0/2575369583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5640ba960 0x7fb564071eb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009e50 tx=0x7fb55c01c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce883197e4c28247 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f618410f640 1 -- 172.21.15.99:0/580425194 shutdown_connections 2024-01-19T05:18:13.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f618410f640 1 -- 172.21.15.99:0/580425194 wait complete. 2024-01-19T05:18:13.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4005ae0 con 0x7f0dd0003980 2024-01-19T05:18:13.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40ab070 con 0x7f0dd0003980 2024-01-19T05:18:13.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7fb56930c640 1 -- 172.21.15.99:0/2575369583 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0a5640 con 0x7fb5640ba960 2024-01-19T05:18:13.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7fb56930c640 1 -- 172.21.15.99:0/2575369583 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c0a57a0 con 0x7fb5640ba960 2024-01-19T05:18:13.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7fb56930c640 1 -- 172.21.15.99:0/2575369583 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0a5b30 con 0x7fb5640ba960 2024-01-19T05:18:13.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f0ddf7fe640 1 -- 172.21.15.99:0/3286323638 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4005e80 con 0x7f0dd0003980 2024-01-19T05:18:13.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f0de5e64640 1 -- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 msgr2=0x7f0dd0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f0de5e64640 1 --2- 172.21.15.99:0/3286323638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd0003da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400c340 tx=0x7f0dd401f3f0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f0de5663640 1 -- 172.21.15.99:0/3286323638 reap_dead start 2024-01-19T05:18:13.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.973+0000 7f2ac8d21640 1 -- 172.21.15.99:0/1782574154 wait complete. 2024-01-19T05:18:13.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 Processor -- start 2024-01-19T05:18:13.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- 172.21.15.99:0/2125539511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5720072100 msgr2=0x7f572014e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 --2- 172.21.15.99:0/2125539511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5720072100 0x7f572014e070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f571800d370 tx=0x7f571801eb80 comp rx=0 tx=0).stop 2024-01-19T05:18:13.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6dc85b640 1 Processor -- start 2024-01-19T05:18:13.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 Processor -- start 2024-01-19T05:18:13.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 -- 172.21.15.99:0/2575369583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5640ba960 msgr2=0x7fb564071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 --2- 172.21.15.99:0/2575369583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5640ba960 0x7fb564071eb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009e50 tx=0x7fb55c01c9c0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 -- start start 2024-01-19T05:18:13.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- 172.21.15.99:0/2125539511 shutdown_connections 2024-01-19T05:18:13.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 --2- 172.21.15.99:0/2125539511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5720072100 0x7f572014e070 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- 172.21.15.99:0/2125539511 >> 172.21.15.99:0/2125539511 conn(0x7f57200b7d80 msgr2=0x7f57200b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- 172.21.15.99:0/2125539511 shutdown_connections 2024-01-19T05:18:13.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 -- start start 2024-01-19T05:18:13.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc006490 0x7f2abc023830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc01b8c0 0x7f2abc033cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2abc039e30 0x7f2abc175a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc1755a0 con 0x7f2abc006490 2024-01-19T05:18:13.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc034200 con 0x7f2abc01b8c0 2024-01-19T05:18:13.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc037760 con 0x7f2abc039e30 2024-01-19T05:18:13.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6dc85b640 1 -- start start 2024-01-19T05:18:13.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6dc85b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d806ba80 0x7ff6d809c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6dc85b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d80b7670 0x7ff6d809b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6dc85b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d809b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6dc85b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d813d450 con 0x7ff6d806ba80 2024-01-19T05:18:13.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6dc85b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8143310 con 0x7ff6d80b7670 2024-01-19T05:18:13.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6dc85b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d81437a0 con 0x7ff6d814a2d0 2024-01-19T05:18:13.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617c0ae600 0x7f617c1d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0ae9e0 0x7f617c1d6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0af7e0 0x7f617c13c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1d6c40 con 0x7f617c0ae600 2024-01-19T05:18:13.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1d6e50 con 0x7f617c0af7e0 2024-01-19T05:18:13.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c13be10 con 0x7f617c0ae9e0 2024-01-19T05:18:13.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8b3fff640 1 -- 172.21.15.99:0/3738657458 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80ab600 con 0x7fb8bc0ae910 2024-01-19T05:18:13.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8b3fff640 1 -- 172.21.15.99:0/3738657458 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b80a7050 con 0x7fb8bc0ae910 2024-01-19T05:18:13.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8b3fff640 1 -- 172.21.15.99:0/3738657458 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80ab980 con 0x7fb8bc0ae910 2024-01-19T05:18:13.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2abc039e30 0x7f2abc175a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d80b7670 0x7ff6d809b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d80b7670 0x7ff6d809b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47156/0 (socket says 172.21.15.99:47156) 2024-01-19T05:18:13.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 -- 172.21.15.99:0/3202196089 learned_addr learned my addr 172.21.15.99:0/3202196089 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:13.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2abc039e30 0x7f2abc175a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:46098/0 (socket says 172.21.15.99:46098) 2024-01-19T05:18:13.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 -- 172.21.15.99:0/3083951554 learned_addr learned my addr 172.21.15.99:0/3083951554 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:13.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac2ffd640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc01b8c0 0x7f2abc033cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61826ac640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0af7e0 0x7f617c13c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d759e640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d809b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61816aa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0ae9e0 0x7f617c1d6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61816aa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0ae9e0 0x7f617c1d6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:46108/0 (socket says 172.21.15.99:46108) 2024-01-19T05:18:13.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61816aa640 1 -- 172.21.15.99:0/453707511 learned_addr learned my addr 172.21.15.99:0/453707511 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:13.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac37fe640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc006490 0x7f2abc023830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d6d9d640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d806ba80 0x7ff6d809c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f6181eab640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617c0ae600 0x7f617c1d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- 172.21.15.99:0/2125539511 wait complete. 2024-01-19T05:18:13.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 -- 172.21.15.99:0/2575369583 shutdown_connections 2024-01-19T05:18:13.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 --2- 172.21.15.99:0/2575369583 >> v2:172.21.15.99:3300/0 conn(0x7fb56409cc30 0x7fb5641415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 --2- 172.21.15.99:0/2575369583 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb5640ba960 0x7fb564071eb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 -- 172.21.15.99:0/2575369583 >> 172.21.15.99:0/2575369583 conn(0x7fb564066a50 msgr2=0x7fb5640b9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 Processor -- start 2024-01-19T05:18:13.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 -- 172.21.15.99:0/3083951554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc01b8c0 msgr2=0x7f2abc033cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 -- 172.21.15.99:0/3738657458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae910 msgr2=0x7fb8bc1427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 --2- 172.21.15.99:0/3738657458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae910 0x7fb8bc1427e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b801c470 comp rx=0 tx=0).stop 2024-01-19T05:18:13.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc01b8c0 0x7f2abc033cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 -- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc006490 msgr2=0x7f2abc023830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc006490 0x7f2abc023830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 -- 172.21.15.99:0/3083951554 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0009420 con 0x7f2abc039e30 2024-01-19T05:18:13.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 -- 172.21.15.99:0/3738657458 shutdown_connections 2024-01-19T05:18:13.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 --2- 172.21.15.99:0/3738657458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae910 0x7fb8bc1427e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 --2- 172.21.15.99:0/3738657458 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0b38b0 0x7fb8bc0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 -- 172.21.15.99:0/3738657458 >> 172.21.15.99:0/3738657458 conn(0x7fb8bc0b4880 msgr2=0x7fb8bc0b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 -- 172.21.15.99:0/2575369583 shutdown_connections 2024-01-19T05:18:13.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 -- 172.21.15.99:0/3738657458 shutdown_connections 2024-01-19T05:18:13.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 -- 172.21.15.99:0/3202196089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 msgr2=0x7ff6d809b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d809b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 -- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d806ba80 msgr2=0x7ff6d809c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d806ba80 0x7ff6d809c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 -- 172.21.15.99:0/3202196089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc009420 con 0x7ff6d80b7670 2024-01-19T05:18:13.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d6d9d640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d806ba80 0x7ff6d809c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:13.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac3fff640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2abc039e30 0x7f2abc175a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800e8b0 tx=0x7f2ab800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61826ac640 1 -- 172.21.15.99:0/453707511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0ae9e0 msgr2=0x7f617c1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61826ac640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0ae9e0 0x7f617c1d6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61826ac640 1 -- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617c0ae600 msgr2=0x7f617c1d5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61826ac640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617c0ae600 0x7f617c1d5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61826ac640 1 -- 172.21.15.99:0/453707511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617800b6c0 con 0x7f617c0af7e0 2024-01-19T05:18:13.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6d659c640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d80b7670 0x7ff6d809b4a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc01a9c0 tx=0x7ff6cc0190b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2aaffff640 1 -- 172.21.15.99:0/3083951554 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8009650 con 0x7f2abc039e30 2024-01-19T05:18:13.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- start start 2024-01-19T05:18:13.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b9e0 0x7f572006ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5720072100 0x7f57200b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57200ae300 0x7f57201e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572006ffd0 con 0x7f572006b9e0 2024-01-19T05:18:13.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200b1420 con 0x7f57200ae300 2024-01-19T05:18:13.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f5724e95640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200b1700 con 0x7f5720072100 2024-01-19T05:18:13.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2aaffff640 1 -- 172.21.15.99:0/3083951554 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab800c940 con 0x7f2abc039e30 2024-01-19T05:18:13.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2aaffff640 1 -- 172.21.15.99:0/3083951554 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800ccd0 con 0x7f2abc039e30 2024-01-19T05:18:13.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7ff6bf7fe640 1 -- 172.21.15.99:0/3202196089 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0b4810 con 0x7ff6d80b7670 2024-01-19T05:18:13.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f571e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b9e0 0x7f572006ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f571e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b9e0 0x7f572006ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55152/0 (socket says 172.21.15.99:55152) 2024-01-19T05:18:13.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f571e59c640 1 -- 172.21.15.99:0/3727537332 learned_addr learned my addr 172.21.15.99:0/3727537332 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:13.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f571dd9b640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5720072100 0x7f57200b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f571ed9d640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57200ae300 0x7f57201e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 -- 172.21.15.99:0/3738657458 wait complete. 2024-01-19T05:18:13.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 Processor -- start 2024-01-19T05:18:13.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61826ac640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0af7e0 0x7f617c13c9b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f61780ae000 tx=0x7f617801b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f61727fc640 1 -- 172.21.15.99:0/453707511 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780afdd0 con 0x7f617c0af7e0 2024-01-19T05:18:13.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 -- 172.21.15.99:0/2575369583 wait complete. 2024-01-19T05:18:13.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb56c572640 1 Processor -- start 2024-01-19T05:18:13.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c143470 con 0x7f617c0af7e0 2024-01-19T05:18:13.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c1d4b20 con 0x7f617c0af7e0 2024-01-19T05:18:13.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7fb8c2755640 1 -- start start 2024-01-19T05:18:13.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c2755640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae4b0 0x7fb8bc1ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c2755640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0ae910 0x7fb8bc0716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c2755640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0b38b0 0x7fb8bc09a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c2755640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc09bae0 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c2755640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc1ec180 con 0x7fb8bc0ae4b0 2024-01-19T05:18:13.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c2755640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc1ec460 con 0x7fb8bc0ae910 2024-01-19T05:18:13.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 -- 172.21.15.99:0/3286323638 shutdown_connections 2024-01-19T05:18:13.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 -- 172.21.15.99:0/3286323638 >> 172.21.15.99:0/3286323638 conn(0x7f0dd803ea70 msgr2=0x7f0dd803ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 -- 172.21.15.99:0/3286323638 shutdown_connections 2024-01-19T05:18:13.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 -- 172.21.15.99:0/3286323638 wait complete. 2024-01-19T05:18:13.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0b38b0 0x7fb8bc09a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0b38b0 0x7fb8bc09a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55156/0 (socket says 172.21.15.99:55156) 2024-01-19T05:18:13.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 -- 172.21.15.99:0/10280602 learned_addr learned my addr 172.21.15.99:0/10280602 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:13.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d809d010 con 0x7ff6d80b7670 2024-01-19T05:18:13.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d809d940 con 0x7ff6d80b7670 2024-01-19T05:18:13.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 -- 172.21.15.99:0/3083951554 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc034f60 con 0x7f2abc039e30 2024-01-19T05:18:13.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.977+0000 7f2ac8d21640 1 -- 172.21.15.99:0/3083951554 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc034760 con 0x7f2abc039e30 2024-01-19T05:18:13.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f2ac8d21640 1 -- 172.21.15.99:0/3083951554 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc175710 con 0x7f2abc039e30 2024-01-19T05:18:13.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7ff6bf7fe640 1 -- 172.21.15.99:0/3202196089 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc0ab6e0 con 0x7ff6d80b7670 2024-01-19T05:18:13.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7ff6bf7fe640 1 -- 172.21.15.99:0/3202196089 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0ab980 con 0x7ff6d80b7670 2024-01-19T05:18:13.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb56c572640 1 -- start start 2024-01-19T05:18:13.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb56c572640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb56409cc30 0x7fb56413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb56c572640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5640ba960 0x7fb56409a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb56c572640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb564147a70 0x7fb56406b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb56c572640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b4870 con 0x7fb5640ba960 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb56c572640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56413f180 con 0x7fb564147a70 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb56c572640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56409abe0 con 0x7fb56409cc30 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5640ba960 0x7fb56409a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5640ba960 0x7fb56409a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55166/0 (socket says 172.21.15.99:55166) 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 -- 172.21.15.99:0/4247615602 learned_addr learned my addr 172.21.15.99:0/4247615602 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c0f52640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0ae910 0x7fb8bc0716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1753640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae4b0 0x7fb8bc1ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 -- 172.21.15.99:0/10280602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0ae910 msgr2=0x7fb8bc0716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0ae910 0x7fb8bc0716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 -- 172.21.15.99:0/10280602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae4b0 msgr2=0x7fb8bc1ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae4b0 0x7fb8bc1ebb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 -- 172.21.15.99:0/10280602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b80094d0 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c1f54640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0b38b0 0x7fb8bc09a2d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb8b801ab20 tx=0x7fb8b8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f61727fc640 1 -- 172.21.15.99:0/453707511 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61780b8420 con 0x7f617c0af7e0 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f61727fc640 1 -- 172.21.15.99:0/453707511 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780b87d0 con 0x7f617c0af7e0 2024-01-19T05:18:13.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c1d4d10 con 0x7f617c0af7e0 2024-01-19T05:18:13.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 -- 172.21.15.99:0/3690241331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00b2780 msgr2=0x7facb00b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3690241331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00b2780 0x7facb00b2c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faca00098a0 tx=0x7faca001c470 comp rx=0 tx=0).stop 2024-01-19T05:18:13.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 -- 172.21.15.99:0/3690241331 shutdown_connections 2024-01-19T05:18:13.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3690241331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00b2780 0x7facb00b2c00 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faca00098a0 tx=0x7faca001c470 comp rx=0 tx=0).stop 2024-01-19T05:18:13.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3690241331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb006b9e0 0x7facb00ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 -- 172.21.15.99:0/3690241331 >> 172.21.15.99:0/3690241331 conn(0x7facb00b7d80 msgr2=0x7facb00b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb56a30e640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb56409cc30 0x7fb56413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 Processor -- start 2024-01-19T05:18:13.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 -- 172.21.15.99:0/3690241331 shutdown_connections 2024-01-19T05:18:13.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 -- 172.21.15.99:0/4247615602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb56409cc30 msgr2=0x7fb56413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 -- 172.21.15.99:0/3690241331 wait complete. 2024-01-19T05:18:13.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb56409cc30 0x7fb56413ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 -- 172.21.15.99:0/4247615602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb564147a70 msgr2=0x7fb56406b8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-19T05:18:13.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb564147a70 0x7fb56406b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 -- 172.21.15.99:0/4247615602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c009b30 con 0x7fb5640ba960 2024-01-19T05:18:13.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f2aaffff640 1 -- 172.21.15.99:0/3083951554 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2ab8013470 con 0x7f2abc039e30 2024-01-19T05:18:13.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f571ed9d640 1 -- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5720072100 msgr2=0x7f57200b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f571ed9d640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5720072100 0x7f57200b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f571ed9d640 1 -- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b9e0 msgr2=0x7f572006ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f571ed9d640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b9e0 0x7f572006ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f571ed9d640 1 -- 172.21.15.99:0/3727537332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571800d050 con 0x7f57200ae300 2024-01-19T05:18:13.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f571ed9d640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57200ae300 0x7f57201e50b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57180af000 tx=0x7f571801b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f570effd640 1 -- 172.21.15.99:0/3727537332 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180a7de0 con 0x7f57200ae300 2024-01-19T05:18:13.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f570effd640 1 -- 172.21.15.99:0/3727537332 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718008040 con 0x7f57200ae300 2024-01-19T05:18:13.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b80052a0 con 0x7ff6d80b7670 2024-01-19T05:18:13.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb569b0d640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5640ba960 0x7fb56409a3b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb55400e810 tx=0x7fb55400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8b1ffb640 1 -- 172.21.15.99:0/10280602 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80abe00 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8b1ffb640 1 -- 172.21.15.99:0/10280602 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b80b5400 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f2aaffff640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa8066500 0x7f2aa80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f2aaffff640 1 -- 172.21.15.99:0/3083951554 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ab8084790 con 0x7f2abc039e30 2024-01-19T05:18:13.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f2ac37fe640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa8066500 0x7f2aa80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 -- start start 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd80c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd80bf350 0x7f0dd80bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd8160cc0 0x7f0dd8161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80bdc30 con 0x7f0dd80bf350 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c3f00 con 0x7f0dd0003980 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de5e64640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c3c60 con 0x7f0dd8160cc0 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de4e62640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd80c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de4e62640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd80c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47220/0 (socket says 172.21.15.99:47220) 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0de4e62640 1 -- 172.21.15.99:0/131700406 learned_addr learned my addr 172.21.15.99:0/131700406 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:13.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f0ddffff640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd80bf350 0x7f0dd80bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0de5663640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd8160cc0 0x7f0dd8161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddffff640 1 -- 172.21.15.99:0/131700406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd8160cc0 msgr2=0x7f0dd8161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddffff640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd8160cc0 0x7f0dd8161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddffff640 1 -- 172.21.15.99:0/131700406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 msgr2=0x7f0dd80c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddffff640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd80c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddffff640 1 -- 172.21.15.99:0/131700406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80bfd10 con 0x7f0dd80bf350 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0de5663640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd8160cc0 0x7f0dd8161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddffff640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd80bf350 0x7f0dd80bf7d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8010870 tx=0x7f0dcc00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb55affd640 1 -- 172.21.15.99:0/4247615602 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55400c8d0 con 0x7fb5640ba960 2024-01-19T05:18:13.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb55affd640 1 -- 172.21.15.99:0/4247615602 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55400ca30 con 0x7fb5640ba960 2024-01-19T05:18:13.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb55affd640 1 -- 172.21.15.99:0/4247615602 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55400cde0 con 0x7fb5640ba960 2024-01-19T05:18:13.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb56c572640 1 -- 172.21.15.99:0/4247615602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56409aec0 con 0x7fb5640ba960 2024-01-19T05:18:13.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb56c572640 1 -- 172.21.15.99:0/4247615602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56409c490 con 0x7fb5640ba960 2024-01-19T05:18:13.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f570effd640 1 -- 172.21.15.99:0/3727537332 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180083f0 con 0x7f57200ae300 2024-01-19T05:18:13.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f5724e95640 1 -- 172.21.15.99:0/3727537332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57200b19e0 con 0x7f57200ae300 2024-01-19T05:18:13.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f5724e95640 1 -- 172.21.15.99:0/3727537332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57200b3d80 con 0x7f57200ae300 2024-01-19T05:18:13.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f570cff9640 1 -- 172.21.15.99:0/3727537332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57040052a0 con 0x7f57200ae300 2024-01-19T05:18:13.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8b1ffb640 1 -- 172.21.15.99:0/10280602 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80b5790 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c2755640 1 -- 172.21.15.99:0/10280602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc099db0 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7fb8c2755640 1 -- 172.21.15.99:0/10280602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc070890 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7f61727fc640 1 -- 172.21.15.99:0/453707511 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f61780b6070 con 0x7f617c0af7e0 2024-01-19T05:18:13.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f61727fc640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6160066530 0x7f61600689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f61727fc640 1 -- 172.21.15.99:0/453707511 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f617811f080 con 0x7f617c0af7e0 2024-01-19T05:18:13.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7facb6fdc640 1 Processor -- start 2024-01-19T05:18:13.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddd7fa640 1 -- 172.21.15.99:0/131700406 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc013610 con 0x7f0dd80bf350 2024-01-19T05:18:13.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddd7fa640 1 -- 172.21.15.99:0/131700406 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc013770 con 0x7f0dd80bf350 2024-01-19T05:18:13.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddd7fa640 1 -- 172.21.15.99:0/131700406 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc013ae0 con 0x7f0dd80bf350 2024-01-19T05:18:13.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0de5e64640 1 -- 172.21.15.99:0/131700406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd80ce810 con 0x7f0dd80bf350 2024-01-19T05:18:13.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0de5e64640 1 -- 172.21.15.99:0/131700406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd80c0890 con 0x7f0dd80bf350 2024-01-19T05:18:13.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.981+0000 7ff6bf7fe640 1 -- 172.21.15.99:0/3202196089 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff6cc0b2040 con 0x7ff6d80b7670 2024-01-19T05:18:13.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7ff6bf7fe640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c4066500 0x7ff6c40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7ff6bf7fe640 1 -- 172.21.15.99:0/3202196089 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6cc11e920 con 0x7ff6d80b7670 2024-01-19T05:18:13.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb6fdc640 1 -- start start 2024-01-19T05:18:13.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb6fdc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb006b9e0 0x7facb01493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb6fdc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb00b3140 0x7facb0143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb6fdc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb01e68e0 0x7facb00999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb6fdc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb009c100 con 0x7facb006b9e0 2024-01-19T05:18:13.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb6fdc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb0144be0 con 0x7facb01e68e0 2024-01-19T05:18:13.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb6fdc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb009caa0 con 0x7facb00b3140 2024-01-19T05:18:13.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb89f7fe640 1 -- 172.21.15.99:0/10280602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8980052a0 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f6181eab640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6160066530 0x7f61600689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb56c572640 1 -- 172.21.15.99:0/4247615602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb564067bf0 con 0x7fb5640ba960 2024-01-19T05:18:13.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb5579640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb01e68e0 0x7facb00999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb00b3140 0x7facb0143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb00b3140 0x7facb0143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:46166/0 (socket says 172.21.15.99:46166) 2024-01-19T05:18:13.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 -- 172.21.15.99:0/3336337960 learned_addr learned my addr 172.21.15.99:0/3336337960 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:13.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7ff6d6d9d640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c4066500 0x7ff6c40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facb4d78640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb006b9e0 0x7facb01493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f2ac37fe640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa8066500 0x7f2aa80689c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000b70 tx=0x7f2ac406d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0de5e64640 1 -- 172.21.15.99:0/131700406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd80ce670 con 0x7f0dd80bf350 2024-01-19T05:18:13.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddd7fa640 1 -- 172.21.15.99:0/131700406 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0dcc013c40 con 0x7f0dd80bf350 2024-01-19T05:18:13.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f0ddd7fa640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0dc4066580 0x7f0dc4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7ff6d6d9d640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c4066500 0x7ff6c40689c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8143b30 tx=0x7ff6c8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb55affd640 1 -- 172.21.15.99:0/4247615602 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb554026430 con 0x7fb5640ba960 2024-01-19T05:18:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb55affd640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb548066550 0x7fb548068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb55affd640 1 -- 172.21.15.99:0/4247615602 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb554083fd0 con 0x7fb5640ba960 2024-01-19T05:18:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb56a30e640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb548066550 0x7fb548068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb8b1ffb640 1 -- 172.21.15.99:0/10280602 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb8b80b58f0 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb8b1ffb640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb8a0066550 0x7fb8a0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7fb8c1753640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb8a0066550 0x7fb8a0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7f6181eab640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6160066530 0x7f61600689f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6174005c10 tx=0x7f6174009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 -- 172.21.15.99:0/3336337960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb01e68e0 msgr2=0x7facb00999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb01e68e0 0x7facb00999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 -- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb006b9e0 msgr2=0x7facb01493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb006b9e0 0x7facb01493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 -- 172.21.15.99:0/3336337960 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca00094d0 con 0x7facb00b3140 2024-01-19T05:18:13.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.985+0000 7facaffff640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb00b3140 0x7facb0143ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faca001a0a0 tx=0x7faca0019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.989+0000 7fb8c1753640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb8a0066550 0x7fb8a0068a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011340 tx=0x7fb8b400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.989+0000 7f0ddd7fa640 1 -- 172.21.15.99:0/131700406 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dcc083a50 con 0x7f0dd80bf350 2024-01-19T05:18:13.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.989+0000 7f0de4e62640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0dc4066580 0x7f0dc4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.989+0000 7fb56a30e640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb548066550 0x7fb548068a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0ae000 tx=0x7fb55c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.989+0000 7f0de4e62640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0dc4066580 0x7f0dc4068a40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dd401f430 tx=0x7f0dd40b4040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.989+0000 7fb55affd640 1 -- 172.21.15.99:0/4247615602 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb5540513e0 con 0x7fb5640ba960 2024-01-19T05:18:13.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.997+0000 7fb8b1ffb640 1 -- 172.21.15.99:0/10280602 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8b80ef120 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:12.997+0000 7f0ddd7fa640 1 -- 172.21.15.99:0/131700406 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0dd80ce670 con 0x7f0dd80bf350 2024-01-19T05:18:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.005+0000 7facad7fa640 1 -- 172.21.15.99:0/3336337960 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00b5850 con 0x7facb00b3140 2024-01-19T05:18:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.005+0000 7facad7fa640 1 -- 172.21.15.99:0/3336337960 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca00b59b0 con 0x7facb00b3140 2024-01-19T05:18:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.005+0000 7facad7fa640 1 -- 172.21.15.99:0/3336337960 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00b5d40 con 0x7facb00b3140 2024-01-19T05:18:13.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.005+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb0144e10 con 0x7facb00b3140 2024-01-19T05:18:13.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.005+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb009ac40 con 0x7facb00b3140 2024-01-19T05:18:13.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.005+0000 7f2aaffff640 1 -- 172.21.15.99:0/3083951554 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2ab8051b50 con 0x7f2abc039e30 2024-01-19T05:18:13.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.005+0000 7fb8b1ffb640 1 -- 172.21.15.99:0/10280602 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb8b8123060 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.009+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb0069560 con 0x7facb00b3140 2024-01-19T05:18:13.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.009+0000 7facad7fa640 1 -- 172.21.15.99:0/3336337960 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faca00c7430 con 0x7facb00b3140 2024-01-19T05:18:13.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.009+0000 7facad7fa640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fac9c066500 0x7fac9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.009+0000 7facad7fa640 1 -- 172.21.15.99:0/3336337960 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faca011e980 con 0x7facb00b3140 2024-01-19T05:18:13.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.009+0000 7f61727fc640 1 -- 172.21.15.99:0/453707511 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f61780ec390 con 0x7f617c0af7e0 2024-01-19T05:18:13.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.013+0000 7facb4d78640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fac9c066500 0x7fac9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.013+0000 7facb4d78640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fac9c066500 0x7fac9c0689c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faca8009fd0 tx=0x7faca800d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.021+0000 7ff6bf7fe640 1 -- 172.21.15.99:0/3202196089 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff6cc0ebce0 con 0x7ff6d80b7670 2024-01-19T05:18:13.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.021+0000 7facad7fa640 1 -- 172.21.15.99:0/3336337960 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faca00ebd40 con 0x7facb00b3140 2024-01-19T05:18:13.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.021+0000 7f570effd640 1 -- 172.21.15.99:0/3727537332 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5718008550 con 0x7f57200ae300 2024-01-19T05:18:13.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.021+0000 7f570effd640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5700066580 0x7f5700068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:13.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.021+0000 7f570effd640 1 -- 172.21.15.99:0/3727537332 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f571811e480 con 0x7f57200ae300 2024-01-19T05:18:13.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.021+0000 7f571e59c640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5700066580 0x7f5700068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:13.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.025+0000 7f571e59c640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5700066580 0x7f5700068a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5710000f70 tx=0x7f5710009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:13.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.029+0000 7f570effd640 1 -- 172.21.15.99:0/3727537332 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f57180eb7b0 con 0x7f57200ae300 2024-01-19T05:18:13.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.285+0000 7fb56c572640 1 -- 172.21.15.99:0/4247615602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb564069560 con 0x7fb5640ba960 2024-01-19T05:18:13.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.285+0000 7fb55affd640 1 -- 172.21.15.99:0/4247615602 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb554054a00 con 0x7fb5640ba960 2024-01-19T05:18:13.292 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 -- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb548066550 msgr2=0x7fb548068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb548066550 0x7fb548068a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0ae000 tx=0x7fb55c0a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 -- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5640ba960 msgr2=0x7fb56409a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5640ba960 0x7fb56409a3b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb55400e810 tx=0x7fb55400ecd0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 -- 172.21.15.99:0/4247615602 shutdown_connections 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb548066550 0x7fb548068a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb564147a70 0x7fb56406b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5640ba960 0x7fb56409a3b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 --2- 172.21.15.99:0/4247615602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb56409cc30 0x7fb56413ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 -- 172.21.15.99:0/4247615602 >> 172.21.15.99:0/4247615602 conn(0x7fb564066a50 msgr2=0x7fb5641434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 -- 172.21.15.99:0/4247615602 shutdown_connections 2024-01-19T05:18:13.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.289+0000 7fb558ff9640 1 -- 172.21.15.99:0/4247615602 wait complete. 2024-01-19T05:18:13.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.297+0000 7f0de5e64640 1 -- 172.21.15.99:0/131700406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0dd80cf5b0 con 0x7f0dd80bf350 2024-01-19T05:18:13.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.297+0000 7f0ddd7fa640 1 -- 172.21.15.99:0/131700406 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0dcc017020 con 0x7f0dd80bf350 2024-01-19T05:18:13.299 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-01-19T05:18:13.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 -- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0dc4066580 msgr2=0x7f0dc4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0dc4066580 0x7f0dc4068a40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dd401f430 tx=0x7f0dd40b4040 comp rx=0 tx=0).stop 2024-01-19T05:18:13.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 -- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd80bf350 msgr2=0x7f0dd80bf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd80bf350 0x7f0dd80bf7d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8010870 tx=0x7f0dcc00ea10 comp rx=0 tx=0).stop 2024-01-19T05:18:13.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 -- 172.21.15.99:0/131700406 shutdown_connections 2024-01-19T05:18:13.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0dc4066580 0x7f0dc4068a40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dd8160cc0 0x7f0dd8161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dd80bf350 0x7f0dd80bf7d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 --2- 172.21.15.99:0/131700406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dd0003980 0x7f0dd80c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 -- 172.21.15.99:0/131700406 >> 172.21.15.99:0/131700406 conn(0x7f0dd803ea70 msgr2=0x7f0dd8037fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 -- 172.21.15.99:0/131700406 shutdown_connections 2024-01-19T05:18:13.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.301+0000 7f0dcaffd640 1 -- 172.21.15.99:0/131700406 wait complete. 2024-01-19T05:18:13.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.309+0000 7f2ac8d21640 1 -- 172.21.15.99:0/3083951554 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2abc0057f0 con 0x7f2abc039e30 2024-01-19T05:18:13.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.309+0000 7f2aaffff640 1 -- 172.21.15.99:0/3083951554 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ab8055170 con 0x7f2abc039e30 2024-01-19T05:18:13.314 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:13.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 -- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa8066500 msgr2=0x7f2aa80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa8066500 0x7f2aa80689c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000b70 tx=0x7f2ac406d040 comp rx=0 tx=0).stop 2024-01-19T05:18:13.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 -- 172.21.15.99:0/3083951554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2abc039e30 msgr2=0x7f2abc175a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2abc039e30 0x7f2abc175a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800e8b0 tx=0x7f2ab800ed70 comp rx=0 tx=0).stop 2024-01-19T05:18:13.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 -- 172.21.15.99:0/3083951554 shutdown_connections 2024-01-19T05:18:13.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa8066500 0x7f2aa80689c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2abc039e30 0x7f2abc175a30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2abc01b8c0 0x7f2abc033cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 --2- 172.21.15.99:0/3083951554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc006490 0x7f2abc023830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 -- 172.21.15.99:0/3083951554 >> 172.21.15.99:0/3083951554 conn(0x7f2abc009c10 msgr2=0x7f2abc0071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 -- 172.21.15.99:0/3083951554 shutdown_connections 2024-01-19T05:18:13.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.313+0000 7f2aadffb640 1 -- 172.21.15.99:0/3083951554 wait complete. 2024-01-19T05:18:13.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-01-19T05:18:13.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.317+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f617c13da70 con 0x7f617c0af7e0 2024-01-19T05:18:13.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.317+0000 7f61727fc640 1 -- 172.21.15.99:0/453707511 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61780ef9b0 con 0x7f617c0af7e0 2024-01-19T05:18:13.321 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-01-19T05:18:13.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 -- 172.21.15.99:0/10280602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb898005820 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb8b1ffb640 1 -- 172.21.15.99:0/10280602 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8b80b9090 con 0x7fb8bc0b38b0 2024-01-19T05:18:13.322 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-01-19T05:18:13.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6160066530 msgr2=0x7f61600689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6160066530 0x7f61600689f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6174005c10 tx=0x7f6174009040 comp rx=0 tx=0).stop 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0af7e0 msgr2=0x7f617c13c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0af7e0 0x7f617c13c9b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f61780ae000 tx=0x7f617801b880 comp rx=0 tx=0).stop 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 shutdown_connections 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6160066530 0x7f61600689f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f617c0af7e0 0x7f617c13c9b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617c0ae9e0 0x7f617c1d6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 --2- 172.21.15.99:0/453707511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617c0ae600 0x7f617c1d5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 >> 172.21.15.99:0/453707511 conn(0x7f617c0b5970 msgr2=0x7f617c0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 shutdown_connections 2024-01-19T05:18:13.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7f618410f640 1 -- 172.21.15.99:0/453707511 wait complete. 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 -- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb8a0066550 msgr2=0x7fb8a0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb8a0066550 0x7fb8a0068a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011340 tx=0x7fb8b400b040 comp rx=0 tx=0).stop 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 -- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0b38b0 msgr2=0x7fb8bc09a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0b38b0 0x7fb8bc09a2d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb8b801ab20 tx=0x7fb8b8019210 comp rx=0 tx=0).stop 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 -- 172.21.15.99:0/10280602 shutdown_connections 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb8a0066550 0x7fb8a0068a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0b38b0 0x7fb8bc09a2d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8bc0ae910 0x7fb8bc0716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 --2- 172.21.15.99:0/10280602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8bc0ae4b0 0x7fb8bc1ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 -- 172.21.15.99:0/10280602 >> 172.21.15.99:0/10280602 conn(0x7fb8bc0b4880 msgr2=0x7fb8bc0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 -- 172.21.15.99:0/10280602 shutdown_connections 2024-01-19T05:18:13.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.321+0000 7fb89f7fe640 1 -- 172.21.15.99:0/10280602 wait complete. 2024-01-19T05:18:13.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-01-19T05:18:13.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff6b8005820 con 0x7ff6d80b7670 2024-01-19T05:18:13.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6bf7fe640 1 -- 172.21.15.99:0/3202196089 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6cc0ef300 con 0x7ff6d80b7670 2024-01-19T05:18:13.335 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-01-19T05:18:13.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7facb00aff10 con 0x7facb00b3140 2024-01-19T05:18:13.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7facad7fa640 1 -- 172.21.15.99:0/3336337960 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faca00b0020 con 0x7facb00b3140 2024-01-19T05:18:13.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c4066500 msgr2=0x7ff6c40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c4066500 0x7ff6c40689c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8143b30 tx=0x7ff6c8009190 comp rx=0 tx=0).stop 2024-01-19T05:18:13.337 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d80b7670 msgr2=0x7ff6d809b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d80b7670 0x7ff6d809b4a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc01a9c0 tx=0x7ff6cc0190b0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 shutdown_connections 2024-01-19T05:18:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c4066500 0x7ff6c40689c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d814a2d0 0x7ff6d809b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d80b7670 0x7ff6d809b4a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 --2- 172.21.15.99:0/3202196089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6d806ba80 0x7ff6d809c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 >> 172.21.15.99:0/3202196089 conn(0x7ff6d80b8ac0 msgr2=0x7ff6d813f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 shutdown_connections 2024-01-19T05:18:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.333+0000 7ff6dc85b640 1 -- 172.21.15.99:0/3202196089 wait complete. 2024-01-19T05:18:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fac9c066500 msgr2=0x7fac9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fac9c066500 0x7fac9c0689c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faca8009fd0 tx=0x7faca800d040 comp rx=0 tx=0).stop 2024-01-19T05:18:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb00b3140 msgr2=0x7facb0143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb00b3140 0x7facb0143ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faca001a0a0 tx=0x7faca0019210 comp rx=0 tx=0).stop 2024-01-19T05:18:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 shutdown_connections 2024-01-19T05:18:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fac9c066500 0x7fac9c0689c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb01e68e0 0x7facb00999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7facb00b3140 0x7facb0143ac0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 --2- 172.21.15.99:0/3336337960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb006b9e0 0x7facb01493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 >> 172.21.15.99:0/3336337960 conn(0x7facb00b7d80 msgr2=0x7facb00af140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 shutdown_connections 2024-01-19T05:18:13.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.337+0000 7facb6fdc640 1 -- 172.21.15.99:0/3336337960 wait complete. 2024-01-19T05:18:13.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.341+0000 7f570cff9640 1 -- 172.21.15.99:0/3727537332 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5704005820 con 0x7f57200ae300 2024-01-19T05:18:13.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570effd640 1 -- 172.21.15.99:0/3727537332 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57180ad090 con 0x7f57200ae300 2024-01-19T05:18:13.346 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:13.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-01-19T05:18:13.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 -- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5700066580 msgr2=0x7f5700068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5700066580 0x7f5700068a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5710000f70 tx=0x7f5710009040 comp rx=0 tx=0).stop 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 -- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57200ae300 msgr2=0x7f57201e50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57200ae300 0x7f57201e50b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57180af000 tx=0x7f571801b920 comp rx=0 tx=0).stop 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 -- 172.21.15.99:0/3727537332 shutdown_connections 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5700066580 0x7f5700068a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57200ae300 0x7f57201e50b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5720072100 0x7f57200b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 --2- 172.21.15.99:0/3727537332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f572006b9e0 0x7f572006ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 -- 172.21.15.99:0/3727537332 >> 172.21.15.99:0/3727537332 conn(0x7f57200b7d80 msgr2=0x7f572009c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 -- 172.21.15.99:0/3727537332 shutdown_connections 2024-01-19T05:18:13.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:13.345+0000 7f570cff9640 1 -- 172.21.15.99:0/3727537332 wait complete. 2024-01-19T05:18:13.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-01-19T05:18:13.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-01-19T05:18:13.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-01-19T05:18:13.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-01-19T05:18:14.318 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-19T05:18:14.331 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-19T05:18:14.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-19T05:18:14.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-19T05:18:14.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-19T05:18:14.361 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-19T05:18:14.367 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-19T05:18:14.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-19T05:18:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.493+0000 7ff07237c640 1 Processor -- start 2024-01-19T05:18:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.493+0000 7ff07237c640 1 -- start start 2024-01-19T05:18:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff07237c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff06c06b9e0 0x7ff06c0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff07237c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff07237c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c072490 con 0x7ff06c142ee0 2024-01-19T05:18:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff07237c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0ae860 con 0x7ff06c06b9e0 2024-01-19T05:18:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff07237c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0ae210 con 0x7ff06c0ae3e0 2024-01-19T05:18:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff06bfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff06c06b9e0 0x7ff06c0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff06bfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff06c06b9e0 0x7ff06c0ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55188/0 (socket says 172.21.15.99:55188) 2024-01-19T05:18:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff070919640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff06c142ee0 0x7ff06c1432e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:33306/0 (socket says 172.21.15.99:33306) 2024-01-19T05:18:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff070919640 1 -- 172.21.15.99:0/283115741 learned_addr learned my addr 172.21.15.99:0/283115741 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff06bfff640 1 -- 172.21.15.99:0/283115741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 msgr2=0x7ff06c0b2780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-19T05:18:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff06bfff640 1 --2- 172.21.15.99:0/283115741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c0b2780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff06bfff640 1 -- 172.21.15.99:0/283115741 >> v1:172.21.15.157:6789/0 conn(0x7ff06c142ee0 legacy=0x7ff06c1432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.497+0000 7ff06bfff640 1 -- 172.21.15.99:0/283115741 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c1439f0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.501+0000 7ff06bfff640 1 --2- 172.21.15.99:0/283115741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c06b9e0 0x7ff06c0ad860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0097c0 tx=0x7ff05c01e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112fdba7f53cc9d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff06affd640 1 -- 172.21.15.99:0/283115741 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0ad620 con 0x7ff06c06b9e0 2024-01-19T05:18:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff06affd640 1 -- 172.21.15.99:0/283115741 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c0ad780 con 0x7ff06c06b9e0 2024-01-19T05:18:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff06affd640 1 -- 172.21.15.99:0/283115741 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0adb10 con 0x7ff06c06b9e0 2024-01-19T05:18:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 -- 172.21.15.99:0/283115741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c06b9e0 msgr2=0x7ff06c0ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 --2- 172.21.15.99:0/283115741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c06b9e0 0x7ff06c0ad860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0097c0 tx=0x7ff05c01e4c0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 -- 172.21.15.99:0/283115741 shutdown_connections 2024-01-19T05:18:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 --2- 172.21.15.99:0/283115741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 --2- 172.21.15.99:0/283115741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c06b9e0 0x7ff06c0ad860 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 -- 172.21.15.99:0/283115741 >> 172.21.15.99:0/283115741 conn(0x7ff06c0b7d80 msgr2=0x7ff06c0b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 -- 172.21.15.99:0/283115741 shutdown_connections 2024-01-19T05:18:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 -- 172.21.15.99:0/283115741 wait complete. 2024-01-19T05:18:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.505+0000 7ff07237c640 1 Processor -- start 2024-01-19T05:18:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 -- start start 2024-01-19T05:18:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff06c06b9e0 0x7ff06c144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c09b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c142ee0 0x7ff06c09b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c145340 con 0x7ff06c142ee0 2024-01-19T05:18:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c11fbb0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0b7a90 con 0x7ff06c0ae3e0 2024-01-19T05:18:14.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff06c06b9e0 0x7ff06c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c09b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff06c06b9e0 0x7ff06c144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47234/0 (socket says 172.21.15.99:47234) 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 -- 172.21.15.99:0/4120514259 learned_addr learned my addr 172.21.15.99:0/4120514259 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c09b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:46170/0 (socket says 172.21.15.99:46170) 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff070919640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c142ee0 0x7ff06c09b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 -- 172.21.15.99:0/4120514259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 msgr2=0x7ff06c09b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c09b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 -- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c142ee0 msgr2=0x7ff06c09b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c142ee0 0x7ff06c09b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 -- 172.21.15.99:0/4120514259 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c009420 con 0x7ff06c06b9e0 2024-01-19T05:18:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06b7fe640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c09b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff06bfff640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff06c06b9e0 0x7ff06c144720 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0af040 tx=0x7ff05c01cd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff068ff9640 1 -- 172.21.15.99:0/4120514259 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0b6620 con 0x7ff06c06b9e0 2024-01-19T05:18:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c1456e0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff068ff9640 1 -- 172.21.15.99:0/4120514259 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c0b67a0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff068ff9640 1 -- 172.21.15.99:0/4120514259 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0b6b50 con 0x7ff06c06b9e0 2024-01-19T05:18:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.509+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c1461a0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.513+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c1454b0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.513+0000 7ff068ff9640 1 -- 172.21.15.99:0/4120514259 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff05c0b6cb0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.513+0000 7ff068ff9640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff058066500 0x7ff0580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.513+0000 7ff068ff9640 1 -- 172.21.15.99:0/4120514259 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff05c11eee0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.513+0000 7ff06b7fe640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff058066500 0x7ff0580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.513+0000 7ff06b7fe640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff058066500 0x7ff0580689c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0b78c0 tx=0x7ff0600090e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.521+0000 7f21f66ea640 1 Processor -- start 2024-01-19T05:18:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.521+0000 7f21f66ea640 1 -- start start 2024-01-19T05:18:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21f66ea640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21e800c360 0x7f21e80ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21effff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21e800c360 0x7f21e80ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21effff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21e800c360 0x7f21e80ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55212/0 (socket says 172.21.15.99:55212) 2024-01-19T05:18:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21effff640 1 -- 172.21.15.99:0/1522417348 learned_addr learned my addr 172.21.15.99:0/1522417348 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21f66ea640 1 --2- 172.21.15.99:0/1522417348 >> v2:172.21.15.157:3300/0 conn(0x7f21e80214d0 0x7f21e8021960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21f66ea640 1 -- 172.21.15.99:0/1522417348 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e80caac0 con 0x7f21e803a680 2024-01-19T05:18:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21f66ea640 1 -- 172.21.15.99:0/1522417348 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e80335f0 con 0x7f21e800c360 2024-01-19T05:18:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21f66ea640 1 -- 172.21.15.99:0/1522417348 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e801f890 con 0x7f21e80214d0 2024-01-19T05:18:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21f4c87640 1 --2- 172.21.15.99:0/1522417348 >> v2:172.21.15.157:3300/0 conn(0x7f21e80214d0 0x7f21e8021960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21effff640 1 -- 172.21.15.99:0/1522417348 >> v2:172.21.15.157:3300/0 conn(0x7f21e80214d0 msgr2=0x7f21e8021960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21effff640 1 --2- 172.21.15.99:0/1522417348 >> v2:172.21.15.157:3300/0 conn(0x7f21e80214d0 0x7f21e8021960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21effff640 1 -- 172.21.15.99:0/1522417348 >> v1:172.21.15.157:6789/0 conn(0x7f21e803a680 legacy=0x7f21e803aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7f21effff640 1 -- 172.21.15.99:0/1522417348 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e801fa90 con 0x7f21e800c360 2024-01-19T05:18:14.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.525+0000 7ff068ff9640 1 -- 172.21.15.99:0/4120514259 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff05c0ec2a0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21effff640 1 --2- 172.21.15.99:0/1522417348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e800c360 0x7f21e80ca580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f21e803bd20 tx=0x7f21e401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740eeae9ae872349 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21eeffd640 1 -- 172.21.15.99:0/1522417348 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40ac640 con 0x7f21e800c360 2024-01-19T05:18:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21eeffd640 1 -- 172.21.15.99:0/1522417348 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e40ac7a0 con 0x7f21e800c360 2024-01-19T05:18:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21eeffd640 1 -- 172.21.15.99:0/1522417348 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40acb30 con 0x7f21e800c360 2024-01-19T05:18:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7fab9ffff640 1 Processor -- start 2024-01-19T05:18:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7fab9ffff640 1 -- start start 2024-01-19T05:18:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21f66ea640 1 -- 172.21.15.99:0/1522417348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e800c360 msgr2=0x7f21e80ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21f66ea640 1 --2- 172.21.15.99:0/1522417348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e800c360 0x7f21e80ca580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f21e803bd20 tx=0x7f21e401c3e0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21f66ea640 1 -- 172.21.15.99:0/1522417348 shutdown_connections 2024-01-19T05:18:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21f66ea640 1 --2- 172.21.15.99:0/1522417348 >> v2:172.21.15.157:3300/0 conn(0x7f21e80214d0 0x7f21e8021960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21f66ea640 1 --2- 172.21.15.99:0/1522417348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e800c360 0x7f21e80ca580 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21f66ea640 1 -- 172.21.15.99:0/1522417348 >> 172.21.15.99:0/1522417348 conn(0x7f21e800b5e0 msgr2=0x7f21e800b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21f66ea640 1 -- 172.21.15.99:0/1522417348 shutdown_connections 2024-01-19T05:18:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7f21f66ea640 1 -- 172.21.15.99:0/1522417348 wait complete. 2024-01-19T05:18:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7fab9e7fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fab980c4370 0x7fab980ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33312/0 (socket says 172.21.15.99:33312) 2024-01-19T05:18:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7fab9e7fc640 1 -- 172.21.15.99:0/880727389 learned_addr learned my addr 172.21.15.99:0/880727389 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.529+0000 7fab9ffff640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab980cabb0 0x7fab980d5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9ffff640 1 -- 172.21.15.99:0/880727389 --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9802bd60 con 0x7fab980c4370 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9ffff640 1 -- 172.21.15.99:0/880727389 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab98039a50 con 0x7fab98037280 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9ffff640 1 -- 172.21.15.99:0/880727389 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9802bb80 con 0x7fab980cabb0 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297676676 0 0) 0x7fab9802bd60 con 0x7fab980c4370 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9f7fe640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab980cabb0 0x7fab980d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab88003530 con 0x7fab980c4370 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109586825 0 0) 0x7fab98039a50 con 0x7fab98037280 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab9802bd60 con 0x7fab98037280 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157956257 0 0) 0x7fab88003530 con 0x7fab980c4370 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab980cabb0 msgr2=0x7fab980d5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab980cabb0 0x7fab980d5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 >> v1:172.21.15.157:6789/0 conn(0x7fab98037280 legacy=0x7fab9802a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab98037660 con 0x7fab980c4370 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7faba004f1d0 con 0x7fab980c4370 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 >> v1:172.21.15.99:6789/0 conn(0x7fab980c4370 legacy=0x7fab980ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab980cabb0 0x7fab88003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880040a0 0x7fab880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab88004d10 0x7fab88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9802bb80 con 0x7fab88004d10 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8800ba70 con 0x7fab880040a0 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8800bc30 con 0x7fab980cabb0 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9f7fe640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab88004d10 0x7fab88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9effd640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab980cabb0 0x7fab88003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9e7fc640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880040a0 0x7fab880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9f7fe640 1 -- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab980cabb0 msgr2=0x7fab88003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9f7fe640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab980cabb0 0x7fab88003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9f7fe640 1 -- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880040a0 msgr2=0x7fab880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9f7fe640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880040a0 0x7fab880047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7fab9f7fe640 1 -- 172.21.15.99:0/880727389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88003530 con 0x7fab88004d10 2024-01-19T05:18:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f66ea640 1 Processor -- start 2024-01-19T05:18:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f66ea640 1 -- start start 2024-01-19T05:18:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f66ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21e800c360 0x7f21e80376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f66ea640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e80214d0 0x7f21e8038240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f66ea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21e803a680 0x7f21e81657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f66ea640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8038780 con 0x7f21e80214d0 2024-01-19T05:18:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f66ea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8033000 con 0x7f21e803a680 2024-01-19T05:18:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f66ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8039d10 con 0x7f21e800c360 2024-01-19T05:18:14.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f5aadfc0640 1 Processor -- start 2024-01-19T05:18:14.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f5aadfc0640 1 -- start start 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e80214d0 0x7f21e8038240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21effff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21e800c360 0x7f21e80376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e80214d0 0x7f21e8038240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55232/0 (socket says 172.21.15.99:55232) 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21ef7fe640 1 -- 172.21.15.99:0/514617364 learned_addr learned my addr 172.21.15.99:0/514617364 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21f4c87640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21e803a680 0x7f21e81657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21effff640 1 -- 172.21.15.99:0/514617364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21e803a680 msgr2=0x7f21e81657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21effff640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21e803a680 0x7f21e81657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21effff640 1 -- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e80214d0 msgr2=0x7f21e8038240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.533+0000 7f21effff640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e80214d0 0x7f21e8038240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21effff640 1 -- 172.21.15.99:0/514617364 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e40094d0 con 0x7f21e800c360 2024-01-19T05:18:14.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21ef7fe640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e80214d0 0x7f21e8038240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:14.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21effff640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21e800c360 0x7f21e80376d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21e40ac000 tx=0x7f21e4019180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aadfc0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa00cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aadfc0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5aa00c9400 0x7f5aa00c9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aadfc0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa001dac0 con 0x7f5aa000c360 2024-01-19T05:18:14.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aadfc0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa001ea00 con 0x7f5aa00c9400 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aadfc0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa003a5a0 con 0x7f5aa00cce70 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aa7fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa00cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aa7fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa00cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:46194/0 (socket says 172.21.15.99:46194) 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aa7fff640 1 -- 172.21.15.99:0/2956308517 learned_addr learned my addr 172.21.15.99:0/2956308517 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aa7fff640 1 -- 172.21.15.99:0/2956308517 >> v2:172.21.15.99:3300/0 conn(0x7f5aa00c9400 msgr2=0x7f5aa00c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aa7fff640 1 --2- 172.21.15.99:0/2956308517 >> v2:172.21.15.99:3300/0 conn(0x7f5aa00c9400 0x7f5aa00c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aa7fff640 1 -- 172.21.15.99:0/2956308517 >> v1:172.21.15.157:6789/0 conn(0x7f5aa000c360 legacy=0x7f5aa001dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f5aa7fff640 1 -- 172.21.15.99:0/2956308517 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa00cc9e0 con 0x7f5aa00cce70 2024-01-19T05:18:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9f7fe640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab88004d10 0x7fab88005190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fab90009ae0 tx=0x7fab9001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b67358e1c63a81 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab900a6510 con 0x7fab88004d10 2024-01-19T05:18:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21ecff9640 1 -- 172.21.15.99:0/514617364 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40abc20 con 0x7f21e800c360 2024-01-19T05:18:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21ecff9640 1 -- 172.21.15.99:0/514617364 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e40abda0 con 0x7f21e800c360 2024-01-19T05:18:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21ecff9640 1 -- 172.21.15.99:0/514617364 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40b5650 con 0x7f21e800c360 2024-01-19T05:18:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21f66ea640 1 -- 172.21.15.99:0/514617364 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e803a1f0 con 0x7f21e800c360 2024-01-19T05:18:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21f66ea640 1 -- 172.21.15.99:0/514617364 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e80370a0 con 0x7f21e800c360 2024-01-19T05:18:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab900a6670 con 0x7fab88004d10 2024-01-19T05:18:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9dffb640 1 -- 172.21.15.99:0/880727389 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab900a6a60 con 0x7fab88004d10 2024-01-19T05:18:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9ffff640 1 -- 172.21.15.99:0/880727389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab88004d10 msgr2=0x7fab88005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9ffff640 1 --2- 172.21.15.99:0/880727389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab88004d10 0x7fab88005190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fab90009ae0 tx=0x7fab9001ca20 comp rx=0 tx=0).stop 2024-01-19T05:18:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9f7fe640 1 -- 172.21.15.99:0/880727389 reap_dead start 2024-01-19T05:18:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9ffff640 1 -- 172.21.15.99:0/880727389 shutdown_connections 2024-01-19T05:18:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9ffff640 1 -- 172.21.15.99:0/880727389 >> 172.21.15.99:0/880727389 conn(0x7fab9803a860 msgr2=0x7fab9803ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9ffff640 1 -- 172.21.15.99:0/880727389 shutdown_connections 2024-01-19T05:18:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7fab9ffff640 1 -- 172.21.15.99:0/880727389 wait complete. 2024-01-19T05:18:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f21ecff9640 1 -- 172.21.15.99:0/514617364 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f21e40b3040 con 0x7f21e800c360 2024-01-19T05:18:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9ffff640 1 Processor -- start 2024-01-19T05:18:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f21ecff9640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f21d4066500 0x7f21d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f21ecff9640 1 -- 172.21.15.99:0/514617364 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21e411e540 con 0x7f21e800c360 2024-01-19T05:18:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f21f66ea640 1 -- 172.21.15.99:0/514617364 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d00052a0 con 0x7f21e800c360 2024-01-19T05:18:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f5aa7fff640 1 --2- 172.21.15.99:0/2956308517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa00cd2d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a94013150 tx=0x7f5a94024b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a5e02483a5a2c58 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f21ef7fe640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f21d4066500 0x7f21d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9ffff640 1 -- start start 2024-01-19T05:18:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab88004d10 0x7fab9803c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab980b60b0 0x7fab98165f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab98166450 0x7fab980bd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9ffff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980b8000 con 0x7fab98166450 2024-01-19T05:18:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9ffff640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980c7db0 con 0x7fab980b60b0 2024-01-19T05:18:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9ffff640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab981668d0 con 0x7fab88004d10 2024-01-19T05:18:14.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f21ef7fe640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f21d4066500 0x7f21d40689c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f21e801d380 tx=0x7f21dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab88004d10 0x7fab9803c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab88004d10 0x7fab9803c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:46212/0 (socket says 172.21.15.99:46212) 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 -- 172.21.15.99:0/4290035454 learned_addr learned my addr 172.21.15.99:0/4290035454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9e7fc640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab980b60b0 0x7fab98165f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9f7fe640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab98166450 0x7fab980bd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 -- 172.21.15.99:0/4290035454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab980b60b0 msgr2=0x7fab98165f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab980b60b0 0x7fab98165f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 -- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab98166450 msgr2=0x7fab980bd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab98166450 0x7fab980bd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 -- 172.21.15.99:0/4290035454 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980b7b90 con 0x7fab88004d10 2024-01-19T05:18:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7fab9effd640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab88004d10 0x7fab9803c500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab9400e4d0 tx=0x7fab9400e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f069f7c6640 1 Processor -- start 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.537+0000 7f069f7c6640 1 -- start start 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069f7c6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06980adf40 0x7f069808a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069f7c6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f069808a9f0 0x7f069815db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069f7c6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06980aed10 con 0x7f069806b9e0 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069f7c6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980ae3c0 con 0x7f069808a9f0 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069f7c6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980b1d30 con 0x7f06980adf40 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069dd63640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f069808a9f0 0x7f069815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069cd61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06980adf40 0x7f069808a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069d562640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f069806b9e0 0x7f06980acda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:33348/0 (socket says 172.21.15.99:33348) 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f069d562640 1 -- 172.21.15.99:0/1640244582 learned_addr learned my addr 172.21.15.99:0/1640244582 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.541+0000 7f068ffff640 1 -- 172.21.15.99:0/1640244582 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362415776 0 0) 0x7f06980aed10 con 0x7f069806b9e0 2024-01-19T05:18:14.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.545+0000 7f068ffff640 1 -- 172.21.15.99:0/1640244582 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0684003510 con 0x7f069806b9e0 2024-01-19T05:18:14.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.545+0000 7f069cd61640 1 -- 172.21.15.99:0/1640244582 >> v2:172.21.15.157:3300/0 conn(0x7f069808a9f0 msgr2=0x7f069815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:14.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.545+0000 7f069cd61640 1 --2- 172.21.15.99:0/1640244582 >> v2:172.21.15.157:3300/0 conn(0x7f069808a9f0 0x7f069815db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.545+0000 7f069cd61640 1 -- 172.21.15.99:0/1640244582 >> v1:172.21.15.157:6789/0 conn(0x7f069806b9e0 legacy=0x7f06980acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.545+0000 7f069cd61640 1 -- 172.21.15.99:0/1640244582 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980aef40 con 0x7f06980adf40 2024-01-19T05:18:14.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.545+0000 7f0d9d6a0640 1 Processor -- start 2024-01-19T05:18:14.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.545+0000 7f0d9d6a0640 1 -- start start 2024-01-19T05:18:14.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.545+0000 7f069cd61640 1 --2- 172.21.15.99:0/1640244582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06980adf40 0x7f069808a4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0694014d10 tx=0x7f0694024f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23d9b99ac6ea5e3b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d9d6a0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0d980b6090 0x7f0d98143420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d9d6a0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d98070d10 con 0x7f0d9813d2f0 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d9d6a0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980709e0 con 0x7f0d980711a0 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d9ce9f640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0d9813d2f0 0x7f0d9814dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33326/0 (socket says 172.21.15.99:33326) 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d9ce9f640 1 -- 172.21.15.99:0/161102261 learned_addr learned my addr 172.21.15.99:0/161102261 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/161102261 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d980718d0 con 0x7f0d980b6090 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d97fff640 1 --2- 172.21.15.99:0/161102261 >> v2:172.21.15.157:3300/0 conn(0x7f0d980b6090 0x7f0d98143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d96ffd640 1 -- 172.21.15.99:0/161102261 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566397611 0 0) 0x7f0d98070d10 con 0x7f0d9813d2f0 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d96ffd640 1 -- 172.21.15.99:0/161102261 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d80003530 con 0x7f0d9813d2f0 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d97fff640 1 -- 172.21.15.99:0/161102261 >> v1:172.21.15.157:6789/0 conn(0x7f0d980711a0 legacy=0x7f0d9806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d97fff640 1 -- 172.21.15.99:0/161102261 >> v1:172.21.15.99:6789/0 conn(0x7f0d9813d2f0 legacy=0x7f0d9814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.549+0000 7f0d97fff640 1 -- 172.21.15.99:0/161102261 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980b6470 con 0x7f0d980b6090 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d97fff640 1 --2- 172.21.15.99:0/161102261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980b6090 0x7f0d98143420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d880097c0 tx=0x7f0d8801ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2881b9ba17b415b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d96ffd640 1 -- 172.21.15.99:0/161102261 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90001980 con 0x7f0d980b6090 2024-01-19T05:18:14.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d96ffd640 1 -- 172.21.15.99:0/161102261 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d880a9050 con 0x7f0d980b6090 2024-01-19T05:18:14.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d96ffd640 1 -- 172.21.15.99:0/161102261 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880ad620 con 0x7f0d980b6090 2024-01-19T05:18:14.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aa77fe640 1 -- 172.21.15.99:0/2956308517 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940adb00 con 0x7f5aa00cce70 2024-01-19T05:18:14.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aa77fe640 1 -- 172.21.15.99:0/2956308517 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a940adc60 con 0x7f5aa00cce70 2024-01-19T05:18:14.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aa77fe640 1 -- 172.21.15.99:0/2956308517 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940110d0 con 0x7f5aa00cce70 2024-01-19T05:18:14.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7fab877fe640 1 -- 172.21.15.99:0/4290035454 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940052e0 con 0x7fab88004d10 2024-01-19T05:18:14.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f068ffff640 1 -- 172.21.15.99:0/1640244582 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940b7400 con 0x7f06980adf40 2024-01-19T05:18:14.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab980c5190 con 0x7fab88004d10 2024-01-19T05:18:14.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab980b7820 con 0x7fab88004d10 2024-01-19T05:18:14.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7fab877fe640 1 -- 172.21.15.99:0/4290035454 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab94007dc0 con 0x7fab88004d10 2024-01-19T05:18:14.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7fab877fe640 1 -- 172.21.15.99:0/4290035454 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94003800 con 0x7fab88004d10 2024-01-19T05:18:14.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f21ecff9640 1 -- 172.21.15.99:0/514617364 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f21e40eb770 con 0x7f21e800c360 2024-01-19T05:18:14.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/161102261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980b6090 msgr2=0x7f0d98143420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d9d6a0640 1 --2- 172.21.15.99:0/161102261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980b6090 0x7f0d98143420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d880097c0 tx=0x7f0d8801ee00 comp rx=0 tx=0).stop 2024-01-19T05:18:14.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aadfc0640 1 -- 172.21.15.99:0/2956308517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 msgr2=0x7f5aa00cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/2956308517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa00cd2d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a94013150 tx=0x7f5a94024b80 comp rx=0 tx=0).stop 2024-01-19T05:18:14.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/161102261 shutdown_connections 2024-01-19T05:18:14.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aadfc0640 1 -- 172.21.15.99:0/2956308517 shutdown_connections 2024-01-19T05:18:14.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/2956308517 >> v2:172.21.15.99:3300/0 conn(0x7f5aa00c9400 0x7f5aa00c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/2956308517 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa00cd2d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aadfc0640 1 -- 172.21.15.99:0/2956308517 >> 172.21.15.99:0/2956308517 conn(0x7f5aa000b5e0 msgr2=0x7f5aa000b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aadfc0640 1 -- 172.21.15.99:0/2956308517 shutdown_connections 2024-01-19T05:18:14.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d9d6a0640 1 --2- 172.21.15.99:0/161102261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980b6090 0x7f0d98143420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/161102261 >> 172.21.15.99:0/161102261 conn(0x7f0d980667f0 msgr2=0x7f0d98066c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f068ffff640 1 -- 172.21.15.99:0/1640244582 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06940b1070 con 0x7f06980adf40 2024-01-19T05:18:14.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f068ffff640 1 -- 172.21.15.99:0/1640244582 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940b7760 con 0x7f06980adf40 2024-01-19T05:18:14.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f069f7c6640 1 -- 172.21.15.99:0/1640244582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06980adf40 msgr2=0x7f069808a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f069f7c6640 1 --2- 172.21.15.99:0/1640244582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06980adf40 0x7f069808a4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0694014d10 tx=0x7f0694024f20 comp rx=0 tx=0).stop 2024-01-19T05:18:14.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7fab877fe640 1 -- 172.21.15.99:0/4290035454 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fab94003960 con 0x7fab88004d10 2024-01-19T05:18:14.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.553+0000 7f5aadfc0640 1 -- 172.21.15.99:0/2956308517 wait complete. 2024-01-19T05:18:14.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aadfc0640 1 Processor -- start 2024-01-19T05:18:14.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7fab877fe640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fab8c066500 0x7fab8c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7fab877fe640 1 -- 172.21.15.99:0/4290035454 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab94083b90 con 0x7fab88004d10 2024-01-19T05:18:14.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/161102261 shutdown_connections 2024-01-19T05:18:14.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/161102261 wait complete. 2024-01-19T05:18:14.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7fab9e7fc640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fab8c066500 0x7fab8c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aadfc0640 1 -- start start 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aadfc0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa000c360 0x7f5aa00389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aadfc0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5aa00c9400 0x7f5aa00373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aadfc0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa0037930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aadfc0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0160c90 con 0x7f5aa000c360 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aadfc0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa01614d0 con 0x7f5aa00c9400 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aadfc0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0160e80 con 0x7f5aa00cce70 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa000c360 0x7f5aa00389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa000c360 0x7f5aa00389b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55254/0 (socket says 172.21.15.99:55254) 2024-01-19T05:18:14.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 -- 172.21.15.99:0/968221550 learned_addr learned my addr 172.21.15.99:0/968221550 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aad7bf640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa0037930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aa7fff640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5aa00c9400 0x7f5aa00373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7fab9e7fc640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fab8c066500 0x7fab8c0689c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faba0000b70 tx=0x7faba006d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 -- 172.21.15.99:0/968221550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 msgr2=0x7f5aa0037930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa0037930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 -- 172.21.15.99:0/968221550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5aa00c9400 msgr2=0x7f5aa00373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5aa00c9400 0x7f5aa00373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 -- 172.21.15.99:0/968221550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94011d70 con 0x7f5aa000c360 2024-01-19T05:18:14.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f069f7c6640 1 -- 172.21.15.99:0/1640244582 shutdown_connections 2024-01-19T05:18:14.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f069f7c6640 1 --2- 172.21.15.99:0/1640244582 >> v2:172.21.15.157:3300/0 conn(0x7f069808a9f0 0x7f069815db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f069f7c6640 1 --2- 172.21.15.99:0/1640244582 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06980adf40 0x7f069808a4b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f069f7c6640 1 -- 172.21.15.99:0/1640244582 >> 172.21.15.99:0/1640244582 conn(0x7f06980b7d80 msgr2=0x7f06980b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f069f7c6640 1 -- 172.21.15.99:0/1640244582 shutdown_connections 2024-01-19T05:18:14.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aacfbe640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa000c360 0x7f5aa00389b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00c4c0 tx=0x7f5a9c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f0d9d6a0640 1 Processor -- start 2024-01-19T05:18:14.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f5aa57fa640 1 -- 172.21.15.99:0/968221550 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c005480 con 0x7f5aa000c360 2024-01-19T05:18:14.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f0d9d6a0640 1 -- start start 2024-01-19T05:18:14.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.557+0000 7f069f7c6640 1 -- 172.21.15.99:0/1640244582 wait complete. 2024-01-19T05:18:14.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa0161160 con 0x7f5aa000c360 2024-01-19T05:18:14.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa00365c0 con 0x7f5aa000c360 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9d6a0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980711a0 0x7f0d9813f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9d6a0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d980b6090 0x7f0d9813e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9d6a0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d9813d2f0 0x7f0d9813ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980711a0 0x7f0d9813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980711a0 0x7f0d9813f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47302/0 (socket says 172.21.15.99:47302) 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 -- 172.21.15.99:0/2686027088 learned_addr learned my addr 172.21.15.99:0/2686027088 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98142ee0 con 0x7f0d9813d2f0 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d977fe640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d980b6090 0x7f0d9813e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9813e310 con 0x7f0d980711a0 2024-01-19T05:18:14.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d98140320 con 0x7f0d980b6090 2024-01-19T05:18:14.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069f7c6640 1 Processor -- start 2024-01-19T05:18:14.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aa57fa640 1 -- 172.21.15.99:0/968221550 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c003600 con 0x7f5aa000c360 2024-01-19T05:18:14.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aa57fa640 1 -- 172.21.15.99:0/968221550 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c003990 con 0x7f5aa000c360 2024-01-19T05:18:14.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9ce9f640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d9813d2f0 0x7f0d9813ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 -- 172.21.15.99:0/2686027088 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d980b6090 msgr2=0x7f0d9813e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d980b6090 0x7f0d9813e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 -- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d9813d2f0 msgr2=0x7f0d9813ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d9813d2f0 0x7f0d9813ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 -- 172.21.15.99:0/2686027088 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88009420 con 0x7f0d980711a0 2024-01-19T05:18:14.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9ce9f640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d9813d2f0 0x7f0d9813ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:14.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069f7c6640 1 -- start start 2024-01-19T05:18:14.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069f7c6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069806b9e0 0x7f069809b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069f7c6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f069808a9f0 0x7f0698158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069f7c6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06980adf40 0x7f069809a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069f7c6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069809a160 con 0x7f069808a9f0 2024-01-19T05:18:14.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069f7c6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06981f6810 con 0x7f06980adf40 2024-01-19T05:18:14.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069f7c6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0698099d80 con 0x7f069806b9e0 2024-01-19T05:18:14.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d97fff640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980711a0 0x7f0d9813f930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d880b0040 tx=0x7f0d8801cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f069808a9f0 0x7f0698158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f069808a9f0 0x7f0698158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55270/0 (socket says 172.21.15.99:55270) 2024-01-19T05:18:14.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 -- 172.21.15.99:0/2801852794 learned_addr learned my addr 172.21.15.99:0/2801852794 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069d562640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069806b9e0 0x7f069809b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aa57fa640 1 -- 172.21.15.99:0/968221550 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5a9c003af0 con 0x7f5aa000c360 2024-01-19T05:18:14.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069dd63640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06980adf40 0x7f069809a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aa57fa640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5a8c066530 0x7f5a8c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 -- 172.21.15.99:0/2801852794 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069806b9e0 msgr2=0x7f069809b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069806b9e0 0x7f069809b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 -- 172.21.15.99:0/2801852794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06980adf40 msgr2=0x7f069809a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06980adf40 0x7f069809a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 -- 172.21.15.99:0/2801852794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694014970 con 0x7f069808a9f0 2024-01-19T05:18:14.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aa57fa640 1 -- 172.21.15.99:0/968221550 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a9c0832a0 con 0x7f5aa000c360 2024-01-19T05:18:14.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d94ff9640 1 -- 172.21.15.99:0/2686027088 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880b9450 con 0x7f0d980711a0 2024-01-19T05:18:14.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aa7fff640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5a8c066530 0x7f5a8c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f069cd61640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f069808a9f0 0x7f0698158ef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0694022b50 tx=0x7f0694021cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d94ff9640 1 -- 172.21.15.99:0/2686027088 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d880b95b0 con 0x7f0d980711a0 2024-01-19T05:18:14.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d98140cc0 con 0x7f0d980711a0 2024-01-19T05:18:14.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d94ff9640 1 -- 172.21.15.99:0/2686027088 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880b9960 con 0x7f0d980711a0 2024-01-19T05:18:14.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d98140040 con 0x7f0d980711a0 2024-01-19T05:18:14.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f068dffb640 1 -- 172.21.15.99:0/2801852794 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694014580 con 0x7f069808a9f0 2024-01-19T05:18:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f068dffb640 1 -- 172.21.15.99:0/2801852794 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06940146e0 con 0x7f069808a9f0 2024-01-19T05:18:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.561+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a880052a0 con 0x7f5aa000c360 2024-01-19T05:18:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f5aa7fff640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5a8c066530 0x7f5a8c0689f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a940b6000 tx=0x7f5a94008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d980b32c0 con 0x7f0d980711a0 2024-01-19T05:18:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f068dffb640 1 -- 172.21.15.99:0/2801852794 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694003b70 con 0x7f069808a9f0 2024-01-19T05:18:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0698159ae0 con 0x7f069808a9f0 2024-01-19T05:18:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0698071bc0 con 0x7f069808a9f0 2024-01-19T05:18:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab800052a0 con 0x7fab88004d10 2024-01-19T05:18:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069809a2a0 con 0x7f069808a9f0 2024-01-19T05:18:14.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f0d94ff9640 1 -- 172.21.15.99:0/2686027088 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0d880b9ac0 con 0x7f0d980711a0 2024-01-19T05:18:14.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f0d94ff9640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d84066550 0x7f0d84068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f0d94ff9640 1 -- 172.21.15.99:0/2686027088 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d88120920 con 0x7f0d980711a0 2024-01-19T05:18:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f0d977fe640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d84066550 0x7f0d84068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.565+0000 7f0d977fe640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d84066550 0x7f0d84068a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c000c10 tx=0x7f0d8c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.569+0000 7f5aa57fa640 1 -- 172.21.15.99:0/968221550 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5a9c017070 con 0x7f5aa000c360 2024-01-19T05:18:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.569+0000 7f068dffb640 1 -- 172.21.15.99:0/2801852794 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0694013030 con 0x7f069808a9f0 2024-01-19T05:18:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.569+0000 7f068dffb640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f067c066550 0x7f067c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7f069d562640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f067c066550 0x7f067c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7f068dffb640 1 -- 172.21.15.99:0/2801852794 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f069411e430 con 0x7f069808a9f0 2024-01-19T05:18:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7f069d562640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f067c066550 0x7f067c068a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0688007fd0 tx=0x7f0688009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc6c9d640 1 Processor -- start 2024-01-19T05:18:14.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc6c9d640 1 -- start start 2024-01-19T05:18:14.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc6c9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdcc0147040 0x7fdcc0149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc6c9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0140650 0x7fdcc0140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc6c9d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc006e4c0 con 0x7fdcc006e0e0 2024-01-19T05:18:14.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7f068dffb640 1 -- 172.21.15.99:0/2801852794 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f06940eb7f0 con 0x7f069808a9f0 2024-01-19T05:18:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc6c9d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc014a480 con 0x7fdcc0147040 2024-01-19T05:18:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc6c9d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc014a760 con 0x7fdcc0140650 2024-01-19T05:18:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc4a39640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdcc006e0e0 0x7fdcc0146930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33338/0 (socket says 172.21.15.99:33338) 2024-01-19T05:18:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc4a39640 1 -- 172.21.15.99:0/546289175 learned_addr learned my addr 172.21.15.99:0/546289175 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcc523a640 1 --2- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0140650 0x7fdcc0140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcbffff640 1 --2- 172.21.15.99:0/546289175 >> v2:172.21.15.157:3300/0 conn(0x7fdcc0147040 0x7fdcc0149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.573+0000 7fdcbf7fe640 1 -- 172.21.15.99:0/546289175 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636122907 0 0) 0x7fdcc006e4c0 con 0x7fdcc006e0e0 2024-01-19T05:18:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.577+0000 7fdcbf7fe640 1 -- 172.21.15.99:0/546289175 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb0003530 con 0x7fdcc006e0e0 2024-01-19T05:18:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.577+0000 7fab877fe640 1 -- 172.21.15.99:0/4290035454 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fab94054960 con 0x7fab88004d10 2024-01-19T05:18:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.577+0000 7f0d94ff9640 1 -- 172.21.15.99:0/2686027088 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0d880edd30 con 0x7f0d980711a0 2024-01-19T05:18:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.577+0000 7fdcbffff640 1 -- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0140650 msgr2=0x7fdcc0140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.577+0000 7fdcbffff640 1 --2- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0140650 0x7fdcc0140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.577+0000 7fdcbffff640 1 -- 172.21.15.99:0/546289175 >> v1:172.21.15.99:6789/0 conn(0x7fdcc006e0e0 legacy=0x7fdcc0146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.577+0000 7fdcbffff640 1 -- 172.21.15.99:0/546289175 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc014aa40 con 0x7fdcc0147040 2024-01-19T05:18:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.577+0000 7fdcc523a640 1 --2- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0140650 0x7fdcc0140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.581+0000 7fbb518b0640 1 Processor -- start 2024-01-19T05:18:14.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.581+0000 7fdcbffff640 1 --2- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0147040 0x7fdcc0149ea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b4abf11e36337ea server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.581+0000 7fdcbf7fe640 1 -- 172.21.15.99:0/546289175 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0ad680 con 0x7fdcc0147040 2024-01-19T05:18:14.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.581+0000 7fdcbf7fe640 1 -- 172.21.15.99:0/546289175 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac0ad7e0 con 0x7fdcc0147040 2024-01-19T05:18:14.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.581+0000 7fdcbf7fe640 1 -- 172.21.15.99:0/546289175 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0adb70 con 0x7fdcc0147040 2024-01-19T05:18:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.581+0000 7fbb518b0640 1 -- start start 2024-01-19T05:18:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb518b0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 0x7fbb4c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb518b0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbb4c1467f0 0x7fbb4c0b0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb518b0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4c0ad2f0 con 0x7fbb4c0acda0 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb518b0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4c06cea0 con 0x7fbb4c1467f0 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb518b0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c0ae300 con 0x7fbb4c146410 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb4bfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbb4c0acda0 0x7fbb4c06b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33342/0 (socket says 172.21.15.99:33342) 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb4bfff640 1 -- 172.21.15.99:0/3301005667 learned_addr learned my addr 172.21.15.99:0/3301005667 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb510af640 1 --2- 172.21.15.99:0/3301005667 >> v2:172.21.15.99:3300/0 conn(0x7fbb4c1467f0 0x7fbb4c0b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb510af640 1 -- 172.21.15.99:0/3301005667 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 msgr2=0x7fbb4c0afd30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb510af640 1 --2- 172.21.15.99:0/3301005667 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 0x7fbb4c0afd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb510af640 1 -- 172.21.15.99:0/3301005667 >> v1:172.21.15.99:6789/0 conn(0x7fbb4c0acda0 legacy=0x7fbb4c06b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.585+0000 7fbb510af640 1 -- 172.21.15.99:0/3301005667 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c0ae790 con 0x7fbb4c1467f0 2024-01-19T05:18:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb510af640 1 --2- 172.21.15.99:0/3301005667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c0b0270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0097c0 tx=0x7fbb3c01d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c1b13375aae63a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0147040 msgr2=0x7fdcc0149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0147040 0x7fdcc0149ea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c360 comp rx=0 tx=0).stop 2024-01-19T05:18:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/546289175 shutdown_connections 2024-01-19T05:18:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0140650 0x7fdcc0140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/546289175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0147040 0x7fdcc0149ea0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb4b7fe640 1 -- 172.21.15.99:0/3301005667 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0a6730 con 0x7fbb4c1467f0 2024-01-19T05:18:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/546289175 >> 172.21.15.99:0/546289175 conn(0x7fdcc00ba500 msgr2=0x7fdcc00ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb4b7fe640 1 -- 172.21.15.99:0/3301005667 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c0a6890 con 0x7fbb4c1467f0 2024-01-19T05:18:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb4b7fe640 1 -- 172.21.15.99:0/3301005667 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0a6c20 con 0x7fbb4c1467f0 2024-01-19T05:18:14.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/546289175 shutdown_connections 2024-01-19T05:18:14.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/546289175 wait complete. 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb518b0640 1 -- 172.21.15.99:0/3301005667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 msgr2=0x7fbb4c0b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3301005667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c0b0270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0097c0 tx=0x7fbb3c01d6a0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb518b0640 1 -- 172.21.15.99:0/3301005667 shutdown_connections 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3301005667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c0b0270 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3301005667 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 0x7fbb4c0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb518b0640 1 -- 172.21.15.99:0/3301005667 >> 172.21.15.99:0/3301005667 conn(0x7fbb4c0b5c80 msgr2=0x7fbb4c0b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb518b0640 1 -- 172.21.15.99:0/3301005667 shutdown_connections 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.589+0000 7fbb518b0640 1 -- 172.21.15.99:0/3301005667 wait complete. 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb518b0640 1 Processor -- start 2024-01-19T05:18:14.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb518b0640 1 -- start start 2024-01-19T05:18:14.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc6c9d640 1 Processor -- start 2024-01-19T05:18:14.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc6c9d640 1 -- start start 2024-01-19T05:18:14.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc6c9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcc006e0e0 0x7fdcc0139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc6c9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0140650 0x7fdcc013ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc6c9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0147040 0x7fdcc013f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc6c9d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0139fb0 con 0x7fdcc006e0e0 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc6c9d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc013e440 con 0x7fdcc0140650 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc6c9d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc013e720 con 0x7fdcc0147040 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc4a39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcc006e0e0 0x7fdcc0139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc4a39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcc006e0e0 0x7fdcc0139a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55294/0 (socket says 172.21.15.99:55294) 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc4a39640 1 -- 172.21.15.99:0/569621513 learned_addr learned my addr 172.21.15.99:0/569621513 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcbffff640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0140650 0x7fdcc013ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcc523a640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0147040 0x7fdcc013f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcbffff640 1 -- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0147040 msgr2=0x7fdcc013f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcbffff640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0147040 0x7fdcc013f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcbffff640 1 -- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcc006e0e0 msgr2=0x7fdcc0139a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcbffff640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcc006e0e0 0x7fdcc0139a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcbffff640 1 -- 172.21.15.99:0/569621513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb8009a70 con 0x7fdcc0140650 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb518b0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 0x7fbb4c13f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb518b0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c1e0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c1e0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c1e0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55304/0 (socket says 172.21.15.99:55304) 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb508ae640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 0x7fbb4c13f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 -- 172.21.15.99:0/3347377845 learned_addr learned my addr 172.21.15.99:0/3347377845 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb4c13fa20 0x7fbb4c1e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c09a210 con 0x7fbb4c1467f0 2024-01-19T05:18:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c1ddf60 con 0x7fbb4c13fa20 2024-01-19T05:18:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c1dd920 con 0x7fbb4c146410 2024-01-19T05:18:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb510af640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb4c13fa20 0x7fbb4c1e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fdcbffff640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0140650 0x7fdcc013ef00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0ac000 tx=0x7fdcac01aba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 -- 172.21.15.99:0/3347377845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 msgr2=0x7fbb4c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 0x7fbb4c13f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 -- 172.21.15.99:0/3347377845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb4c13fa20 msgr2=0x7fbb4c1e0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb4c13fa20 0x7fbb4c1e0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 -- 172.21.15.99:0/3347377845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c009420 con 0x7fbb4c1467f0 2024-01-19T05:18:14.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.593+0000 7fbb4bfff640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c1e0940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000d580 tx=0x7fbb4000da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.601+0000 7fbb497fa640 1 -- 172.21.15.99:0/3347377845 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40012c50 con 0x7fbb4c1467f0 2024-01-19T05:18:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.601+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c1ddbf0 con 0x7fbb4c1467f0 2024-01-19T05:18:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.601+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c1370f0 con 0x7fbb4c1467f0 2024-01-19T05:18:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.601+0000 7fbb497fa640 1 -- 172.21.15.99:0/3347377845 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40012db0 con 0x7fbb4c1467f0 2024-01-19T05:18:14.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.601+0000 7fbb497fa640 1 -- 172.21.15.99:0/3347377845 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4001b670 con 0x7fbb4c1467f0 2024-01-19T05:18:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.601+0000 7fbb497fa640 1 -- 172.21.15.99:0/3347377845 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbb40018070 con 0x7fbb4c1467f0 2024-01-19T05:18:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.601+0000 7fbb497fa640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb38066500 0x7fbb380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.605+0000 7fbb508ae640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb38066500 0x7fbb380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.605+0000 7fbb497fa640 1 -- 172.21.15.99:0/3347377845 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb40009040 con 0x7fbb4c1467f0 2024-01-19T05:18:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.605+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c0052a0 con 0x7fbb4c1467f0 2024-01-19T05:18:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.605+0000 7fbb508ae640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb38066500 0x7fbb380689c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009fd0 tx=0x7fbb4400d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.613+0000 7fbb497fa640 1 -- 172.21.15.99:0/3347377845 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbb40055480 con 0x7fbb4c1467f0 2024-01-19T05:18:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.613+0000 7fdcbd7fa640 1 -- 172.21.15.99:0/569621513 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0ad680 con 0x7fdcc0140650 2024-01-19T05:18:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.613+0000 7fdcbd7fa640 1 -- 172.21.15.99:0/569621513 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac0adda0 con 0x7fdcc0140650 2024-01-19T05:18:14.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.613+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac009420 con 0x7fdcc0140650 2024-01-19T05:18:14.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.613+0000 7fdcbd7fa640 1 -- 172.21.15.99:0/569621513 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0b8690 con 0x7fdcc0140650 2024-01-19T05:18:14.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.613+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc013c990 con 0x7fdcc0140650 2024-01-19T05:18:14.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.617+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc013ebe0 con 0x7fdcc0140650 2024-01-19T05:18:14.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.617+0000 7fdcbd7fa640 1 -- 172.21.15.99:0/569621513 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdcac0b4070 con 0x7fdcc0140650 2024-01-19T05:18:14.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.617+0000 7fdcbd7fa640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdca40665d0 0x7fdca4068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:14.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.617+0000 7fdcbd7fa640 1 -- 172.21.15.99:0/569621513 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcac11e160 con 0x7fdcc0140650 2024-01-19T05:18:14.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.617+0000 7fdcc4a39640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdca40665d0 0x7fdca4068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:14.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.617+0000 7fdcc4a39640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdca40665d0 0x7fdca4068a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4007fd0 tx=0x7fdcb4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:14.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.629+0000 7fdcbd7fa640 1 -- 172.21.15.99:0/569621513 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdcac0eb520 con 0x7fdcc0140650 2024-01-19T05:18:14.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.841+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff06c1458d0 con 0x7ff06c06b9e0 2024-01-19T05:18:14.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.841+0000 7ff068ff9640 1 -- 172.21.15.99:0/4120514259 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff05c0bc090 con 0x7ff06c06b9e0 2024-01-19T05:18:14.845 INFO:teuthology.orchestra.run.smithi099.stdout:55834574856 2024-01-19T05:18:14.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff058066500 msgr2=0x7ff0580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff058066500 0x7ff0580689c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0b78c0 tx=0x7ff0600090e0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff06c06b9e0 msgr2=0x7ff06c144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff06c06b9e0 0x7ff06c144720 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0af040 tx=0x7ff05c01cd00 comp rx=0 tx=0).stop 2024-01-19T05:18:14.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 shutdown_connections 2024-01-19T05:18:14.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff058066500 0x7ff0580689c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff06c142ee0 0x7ff06c09b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff06c0ae3e0 0x7ff06c09b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 --2- 172.21.15.99:0/4120514259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff06c06b9e0 0x7ff06c144720 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 >> 172.21.15.99:0/4120514259 conn(0x7ff06c0b7d80 msgr2=0x7ff06c0b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 shutdown_connections 2024-01-19T05:18:14.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.845+0000 7ff07237c640 1 -- 172.21.15.99:0/4120514259 wait complete. 2024-01-19T05:18:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.857+0000 7f21f66ea640 1 -- 172.21.15.99:0/514617364 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f21d0005550 con 0x7f21e800c360 2024-01-19T05:18:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.857+0000 7f21ecff9640 1 -- 172.21.15.99:0/514617364 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21e40b1090 con 0x7f21e800c360 2024-01-19T05:18:14.864 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:14.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-01-19T05:18:14.871 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 -- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f21d4066500 msgr2=0x7f21d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f21d4066500 0x7f21d40689c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f21e801d380 tx=0x7f21dc009040 comp rx=0 tx=0).stop 2024-01-19T05:18:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 -- 172.21.15.99:0/514617364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21e800c360 msgr2=0x7f21e80376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21e800c360 0x7f21e80376d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21e40ac000 tx=0x7f21e4019180 comp rx=0 tx=0).stop 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 -- 172.21.15.99:0/514617364 shutdown_connections 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f21d4066500 0x7f21d40689c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21e803a680 0x7f21e81657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e80214d0 0x7f21e8038240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 --2- 172.21.15.99:0/514617364 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21e800c360 0x7f21e80376d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 -- 172.21.15.99:0/514617364 >> 172.21.15.99:0/514617364 conn(0x7f21e800b5e0 msgr2=0x7f21e8006550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 -- 172.21.15.99:0/514617364 shutdown_connections 2024-01-19T05:18:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f21da7fc640 1 -- 172.21.15.99:0/514617364 wait complete. 2024-01-19T05:18:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5a88005550 con 0x7f5aa000c360 2024-01-19T05:18:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aa57fa640 1 -- 172.21.15.99:0/968221550 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a9c050680 con 0x7f5aa000c360 2024-01-19T05:18:14.873 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5a8c066530 msgr2=0x7f5a8c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5a8c066530 0x7f5a8c0689f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a940b6000 tx=0x7f5a94008040 comp rx=0 tx=0).stop 2024-01-19T05:18:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa000c360 msgr2=0x7f5aa00389b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa000c360 0x7f5aa00389b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00c4c0 tx=0x7f5a9c001e80 comp rx=0 tx=0).stop 2024-01-19T05:18:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 shutdown_connections 2024-01-19T05:18:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5a8c066530 0x7f5a8c0689f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5aa00cce70 0x7f5aa0037930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.869+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5aa00c9400 0x7f5aa00373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.873+0000 7f5aadfc0640 1 --2- 172.21.15.99:0/968221550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa000c360 0x7f5aa00389b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.873+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 >> 172.21.15.99:0/968221550 conn(0x7f5aa000b5e0 msgr2=0x7f5aa00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.873+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d980676d0 con 0x7f0d980711a0 2024-01-19T05:18:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.873+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 shutdown_connections 2024-01-19T05:18:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.873+0000 7f5aadfc0640 1 -- 172.21.15.99:0/968221550 wait complete. 2024-01-19T05:18:14.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.873+0000 7f0d94ff9640 1 -- 172.21.15.99:0/2686027088 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d880b2090 con 0x7f0d980711a0 2024-01-19T05:18:14.876 INFO:teuthology.orchestra.run.smithi099.stdout:55834574855 2024-01-19T05:18:14.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d84066550 msgr2=0x7f0d84068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d84066550 0x7f0d84068a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c000c10 tx=0x7f0d8c009040 comp rx=0 tx=0).stop 2024-01-19T05:18:14.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980711a0 msgr2=0x7f0d9813f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980711a0 0x7f0d9813f930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d880b0040 tx=0x7f0d8801cbe0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 shutdown_connections 2024-01-19T05:18:14.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d84066550 0x7f0d84068a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d9813d2f0 0x7f0d9813ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d980b6090 0x7f0d9813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 --2- 172.21.15.99:0/2686027088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d980711a0 0x7f0d9813f930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 >> 172.21.15.99:0/2686027088 conn(0x7f0d980667f0 msgr2=0x7f0d98143c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 shutdown_connections 2024-01-19T05:18:14.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.877+0000 7f0d9d6a0640 1 -- 172.21.15.99:0/2686027088 wait complete. 2024-01-19T05:18:14.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-01-19T05:18:14.895 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:14.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-01-19T05:18:14.898 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:14.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-01-19T05:18:14.907 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:14.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.913+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbb2c005820 con 0x7fbb4c1467f0 2024-01-19T05:18:14.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.913+0000 7fbb497fa640 1 -- 172.21.15.99:0/3347377845 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb40058aa0 con 0x7fbb4c1467f0 2024-01-19T05:18:14.916 INFO:teuthology.orchestra.run.smithi099.stdout:55834574856 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.913+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb38066500 msgr2=0x7fbb380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.913+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb38066500 0x7fbb380689c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009fd0 tx=0x7fbb4400d040 comp rx=0 tx=0).stop 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.913+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 msgr2=0x7fbb4c1e0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.913+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c1e0940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000d580 tx=0x7fbb4000da40 comp rx=0 tx=0).stop 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.913+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 shutdown_connections 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbb38066500 0x7fbb380689c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbb4c13fa20 0x7fbb4c1e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb4c1467f0 0x7fbb4c1e0940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fbb518b0640 1 --2- 172.21.15.99:0/3347377845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbb4c146410 0x7fbb4c13f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 >> 172.21.15.99:0/3347377845 conn(0x7fbb4c0b5c80 msgr2=0x7fbb4c0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdcc00696e0 con 0x7fdcc0140650 2024-01-19T05:18:14.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 shutdown_connections 2024-01-19T05:18:14.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fbb518b0640 1 -- 172.21.15.99:0/3347377845 wait complete. 2024-01-19T05:18:14.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fdcbd7fa640 1 -- 172.21.15.99:0/569621513 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcac0eeb40 con 0x7fdcc0140650 2024-01-19T05:18:14.920 INFO:teuthology.orchestra.run.smithi099.stdout:55834574856 2024-01-19T05:18:14.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdca40665d0 msgr2=0x7fdca4068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdca40665d0 0x7fdca4068a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4007fd0 tx=0x7fdcb4009040 comp rx=0 tx=0).stop 2024-01-19T05:18:14.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0140650 msgr2=0x7fdcc013ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.917+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0140650 0x7fdcc013ef00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0ac000 tx=0x7fdcac01aba0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 shutdown_connections 2024-01-19T05:18:14.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdca40665d0 0x7fdca4068a90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdcc0147040 0x7fdcc013f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0140650 0x7fdcc013ef00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7fdcc6c9d640 1 --2- 172.21.15.99:0/569621513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcc006e0e0 0x7fdcc0139a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 >> 172.21.15.99:0/569621513 conn(0x7fdcc00ba500 msgr2=0x7fdcc00b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 shutdown_connections 2024-01-19T05:18:14.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7fdcc6c9d640 1 -- 172.21.15.99:0/569621513 wait complete. 2024-01-19T05:18:14.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f069809a2a0 con 0x7f069808a9f0 2024-01-19T05:18:14.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.921+0000 7f068dffb640 1 -- 172.21.15.99:0/2801852794 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f069809a2a0 con 0x7f069808a9f0 2024-01-19T05:18:14.925 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-01-19T05:18:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f067c066550 msgr2=0x7f067c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f067c066550 0x7f067c068a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0688007fd0 tx=0x7f0688009040 comp rx=0 tx=0).stop 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f069808a9f0 msgr2=0x7f0698158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f069808a9f0 0x7f0698158ef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0694022b50 tx=0x7f0694021cc0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 shutdown_connections 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f067c066550 0x7f067c068a10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06980adf40 0x7f069809a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f069808a9f0 0x7f0698158ef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 --2- 172.21.15.99:0/2801852794 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f069806b9e0 0x7f069809b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 >> 172.21.15.99:0/2801852794 conn(0x7f06980b7d80 msgr2=0x7f06980af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 shutdown_connections 2024-01-19T05:18:14.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7f069f7c6640 1 -- 172.21.15.99:0/2801852794 wait complete. 2024-01-19T05:18:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab80005550 con 0x7fab88004d10 2024-01-19T05:18:14.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.925+0000 7fab877fe640 1 -- 172.21.15.99:0/4290035454 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab940544f0 con 0x7fab88004d10 2024-01-19T05:18:14.930 INFO:teuthology.orchestra.run.smithi099.stdout:55834574856 2024-01-19T05:18:14.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fab8c066500 msgr2=0x7fab8c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fab8c066500 0x7fab8c0689c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faba0000b70 tx=0x7faba006d040 comp rx=0 tx=0).stop 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab88004d10 msgr2=0x7fab9803c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab88004d10 0x7fab9803c500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab9400e4d0 tx=0x7fab9400e990 comp rx=0 tx=0).stop 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 shutdown_connections 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fab8c066500 0x7fab8c0689c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab98166450 0x7fab980bd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab980b60b0 0x7fab98165f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 --2- 172.21.15.99:0/4290035454 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab88004d10 0x7fab9803c500 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 >> 172.21.15.99:0/4290035454 conn(0x7fab9803a860 msgr2=0x7fab98038ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 shutdown_connections 2024-01-19T05:18:14.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:14.929+0000 7fab9ffff640 1 -- 172.21.15.99:0/4290035454 wait complete. 2024-01-19T05:18:14.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-01-19T05:18:14.937 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:14.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-01-19T05:18:14.943 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:14.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-01-19T05:18:14.955 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:14.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-01-19T05:18:14.956 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:14.956 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-19T05:18:14.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:15.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.097+0000 7f7eb8a59640 1 Processor -- start 2024-01-19T05:18:15.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.097+0000 7f7eb8a59640 1 -- start start 2024-01-19T05:18:15.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb8a59640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7eb40b2ce0 0x7f7eb4071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb8a59640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb40b1870 0x7f7eb4072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb8a59640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb406f620 con 0x7f7eb4143ac0 2024-01-19T05:18:15.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb8a59640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb4141000 con 0x7f7eb40b2ce0 2024-01-19T05:18:15.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb8a59640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4143610 con 0x7f7eb40b1870 2024-01-19T05:18:15.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7ea9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb40b1870 0x7f7eb4072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7eb40b2ce0 0x7f7eb4071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7eb40b2ce0 0x7f7eb4071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:47360/0 (socket says 172.21.15.99:47360) 2024-01-19T05:18:15.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb259c640 1 -- 172.21.15.99:0/1250273852 learned_addr learned my addr 172.21.15.99:0/1250273852 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:15.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb259c640 1 -- 172.21.15.99:0/1250273852 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb40b1870 msgr2=0x7f7eb4072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:15.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb259c640 1 --2- 172.21.15.99:0/1250273852 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb40b1870 0x7f7eb4072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb259c640 1 -- 172.21.15.99:0/1250273852 >> v1:172.21.15.157:6789/0 conn(0x7f7eb4143ac0 legacy=0x7f7eb4146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb259c640 1 -- 172.21.15.99:0/1250273852 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40b30c0 con 0x7f7eb40b2ce0 2024-01-19T05:18:15.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.101+0000 7f7eb259c640 1 --2- 172.21.15.99:0/1250273852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 0x7f7eb4071f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009870 tx=0x7f7ea401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38fe20568429968 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb1d9b640 1 -- 172.21.15.99:0/1250273852 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40aa670 con 0x7f7eb40b2ce0 2024-01-19T05:18:15.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb1d9b640 1 -- 172.21.15.99:0/1250273852 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea40aa7d0 con 0x7f7eb40b2ce0 2024-01-19T05:18:15.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb1d9b640 1 -- 172.21.15.99:0/1250273852 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40aab60 con 0x7f7eb40b2ce0 2024-01-19T05:18:15.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- 172.21.15.99:0/1250273852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 msgr2=0x7f7eb4071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/1250273852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 0x7f7eb4071f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009870 tx=0x7f7ea401c510 comp rx=0 tx=0).stop 2024-01-19T05:18:15.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- 172.21.15.99:0/1250273852 shutdown_connections 2024-01-19T05:18:15.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/1250273852 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb40b1870 0x7f7eb4072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/1250273852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 0x7f7eb4071f00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- 172.21.15.99:0/1250273852 >> 172.21.15.99:0/1250273852 conn(0x7f7eb40b8080 msgr2=0x7f7eb40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:15.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- 172.21.15.99:0/1250273852 shutdown_connections 2024-01-19T05:18:15.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- 172.21.15.99:0/1250273852 wait complete. 2024-01-19T05:18:15.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 Processor -- start 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- start start 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 0x7f7eb41392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb4143ac0 0x7f7eb40a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb41e25a0 0x7f7eb41e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40a86e0 con 0x7f7eb4143ac0 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40a8b70 con 0x7f7eb40b2ce0 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40aa440 con 0x7f7eb41e25a0 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb4143ac0 0x7f7eb40a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb4143ac0 0x7f7eb40a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55318/0 (socket says 172.21.15.99:55318) 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 -- 172.21.15.99:0/36249461 learned_addr learned my addr 172.21.15.99:0/36249461 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb2d9d640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb41e25a0 0x7f7eb41e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb259c640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 0x7f7eb41392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 -- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb41e25a0 msgr2=0x7f7eb41e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb41e25a0 0x7f7eb41e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 -- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 msgr2=0x7f7eb41392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 0x7f7eb41392c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 -- 172.21.15.99:0/36249461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea40094d0 con 0x7f7eb4143ac0 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb2d9d640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb41e25a0 0x7f7eb41e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7ea9d9b640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb4143ac0 0x7f7eb40a8f60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00e960 tx=0x7f7e9c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eab7fe640 1 -- 172.21.15.99:0/36249461 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c009690 con 0x7f7eb4143ac0 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eab7fe640 1 -- 172.21.15.99:0/36249461 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00ca00 con 0x7f7eb4143ac0 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40a98c0 con 0x7f7eb4143ac0 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eab7fe640 1 -- 172.21.15.99:0/36249461 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00cd70 con 0x7f7eb4143ac0 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.105+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb40b7d50 con 0x7f7eb4143ac0 2024-01-19T05:18:15.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.109+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40a8890 con 0x7f7eb4143ac0 2024-01-19T05:18:15.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.109+0000 7f7eab7fe640 1 -- 172.21.15.99:0/36249461 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7e9c013470 con 0x7f7eb4143ac0 2024-01-19T05:18:15.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.109+0000 7f7eab7fe640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7e94066500 0x7f7e940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.109+0000 7f7eab7fe640 1 -- 172.21.15.99:0/36249461 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e9c0844c0 con 0x7f7eb4143ac0 2024-01-19T05:18:15.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.109+0000 7f7eb259c640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7e94066500 0x7f7e940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.109+0000 7f7eb259c640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7e94066500 0x7f7e940689c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40ae000 tx=0x7f7ea4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.113+0000 7f7eab7fe640 1 -- 172.21.15.99:0/36249461 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7eb40a8890 con 0x7f7eb4143ac0 2024-01-19T05:18:15.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.253+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7eb40696e0 con 0x7f7e94066500 2024-01-19T05:18:15.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.261+0000 7f7eab7fe640 1 -- 172.21.15.99:0/36249461 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264412 (secure 0 0 0) 0x7f7eb40696e0 con 0x7f7e94066500 2024-01-19T05:18:15.269 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:15.270 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:15.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7e94066500 msgr2=0x7f7e940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7e94066500 0x7f7e940689c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40ae000 tx=0x7f7ea4008040 comp rx=0 tx=0).stop 2024-01-19T05:18:15.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb4143ac0 msgr2=0x7f7eb40a8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb4143ac0 0x7f7eb40a8f60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00e960 tx=0x7f7e9c00ee20 comp rx=0 tx=0).stop 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 shutdown_connections 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7e94066500 0x7f7e940689c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7eb41e25a0 0x7f7eb41e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7eb4143ac0 0x7f7eb40a8f60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 --2- 172.21.15.99:0/36249461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7eb40b2ce0 0x7f7eb41392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 >> 172.21.15.99:0/36249461 conn(0x7f7eb40b8080 msgr2=0x7f7eb41417c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 shutdown_connections 2024-01-19T05:18:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.269+0000 7f7eb8a59640 1 -- 172.21.15.99:0/36249461 wait complete. 2024-01-19T05:18:15.285 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-01-19T05:18:13.346793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235644,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739076,"statfs":{"total":773094113280,"available":772852813824,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.838258"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729517+0000","last_change":"2024-01-19T05:18:03.537400+0000","last_active":"2024-01-19T05:18:04.729517+0000","last_peered":"2024-01-19T05:18:04.729517+0000","last_clean":"2024-01-19T05:18:04.729517+0000","last_became_active":"2024-01-19T05:18:03.536533+0000","last_became_peered":"2024-01-19T05:18:03.536533+0000","last_unstale":"2024-01-19T05:18:04.729517+0000","last_undegraded":"2024-01-19T05:18:04.729517+0000","last_fullsized":"2024-01-19T05:18:04.729517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513273+0000","last_change":"2024-01-19T05:18:03.538419+0000","last_active":"2024-01-19T05:18:04.513273+0000","last_peered":"2024-01-19T05:18:04.513273+0000","last_clean":"2024-01-19T05:18:04.513273+0000","last_became_active":"2024-01-19T05:18:03.537715+0000","last_became_peered":"2024-01-19T05:18:03.537715+0000","last_unstale":"2024-01-19T05:18:04.513273+0000","last_undegraded":"2024-01-19T05:18:04.513273+0000","last_fullsized":"2024-01-19T05:18:04.513273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728283+0000","last_change":"2024-01-19T05:18:03.554921+0000","last_active":"2024-01-19T05:18:04.728283+0000","last_peered":"2024-01-19T05:18:04.728283+0000","last_clean":"2024-01-19T05:18:04.728283+0000","last_became_active":"2024-01-19T05:18:03.554270+0000","last_became_peered":"2024-01-19T05:18:03.554270+0000","last_unstale":"2024-01-19T05:18:04.728283+0000","last_undegraded":"2024-01-19T05:18:04.728283+0000","last_fullsized":"2024-01-19T05:18:04.728283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:13.087104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730979+0000","last_change":"2024-01-19T05:18:03.566913+0000","last_active":"2024-01-19T05:18:04.730979+0000","last_peered":"2024-01-19T05:18:04.730979+0000","last_clean":"2024-01-19T05:18:04.730979+0000","last_became_active":"2024-01-19T05:18:03.566063+0000","last_became_peered":"2024-01-19T05:18:03.566063+0000","last_unstale":"2024-01-19T05:18:04.730979+0000","last_undegraded":"2024-01-19T05:18:04.730979+0000","last_fullsized":"2024-01-19T05:18:04.730979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.554926+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.554035+0000","last_became_peered":"2024-01-19T05:18:03.554035+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730556+0000","last_change":"2024-01-19T05:18:03.563300+0000","last_active":"2024-01-19T05:18:04.730556+0000","last_peered":"2024-01-19T05:18:04.730556+0000","last_clean":"2024-01-19T05:18:04.730556+0000","last_became_active":"2024-01-19T05:18:03.562655+0000","last_became_peered":"2024-01-19T05:18:03.562655+0000","last_unstale":"2024-01-19T05:18:04.730556+0000","last_undegraded":"2024-01-19T05:18:04.730556+0000","last_fullsized":"2024-01-19T05:18:04.730556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729148+0000","last_change":"2024-01-19T05:18:03.535107+0000","last_active":"2024-01-19T05:18:04.729148+0000","last_peered":"2024-01-19T05:18:04.729148+0000","last_clean":"2024-01-19T05:18:04.729148+0000","last_became_active":"2024-01-19T05:18:03.534338+0000","last_became_peered":"2024-01-19T05:18:03.534338+0000","last_unstale":"2024-01-19T05:18:04.729148+0000","last_undegraded":"2024-01-19T05:18:04.729148+0000","last_fullsized":"2024-01-19T05:18:04.729148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728969+0000","last_change":"2024-01-19T05:18:03.567466+0000","last_active":"2024-01-19T05:18:04.728969+0000","last_peered":"2024-01-19T05:18:04.728969+0000","last_clean":"2024-01-19T05:18:04.728969+0000","last_became_active":"2024-01-19T05:18:03.566828+0000","last_became_peered":"2024-01-19T05:18:03.566828+0000","last_unstale":"2024-01-19T05:18:04.728969+0000","last_undegraded":"2024-01-19T05:18:04.728969+0000","last_fullsized":"2024-01-19T05:18:04.728969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.573607+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.573072+0000","last_became_peered":"2024-01-19T05:18:03.573072+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515175+0000","last_change":"2024-01-19T05:18:03.560176+0000","last_active":"2024-01-19T05:18:04.515175+0000","last_peered":"2024-01-19T05:18:04.515175+0000","last_clean":"2024-01-19T05:18:04.515175+0000","last_became_active":"2024-01-19T05:18:03.559432+0000","last_became_peered":"2024-01-19T05:18:03.559432+0000","last_unstale":"2024-01-19T05:18:04.515175+0000","last_undegraded":"2024-01-19T05:18:04.515175+0000","last_fullsized":"2024-01-19T05:18:04.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515576+0000","last_change":"2024-01-19T05:18:03.570077+0000","last_active":"2024-01-19T05:18:04.515576+0000","last_peered":"2024-01-19T05:18:04.515576+0000","last_clean":"2024-01-19T05:18:04.515576+0000","last_became_active":"2024-01-19T05:18:03.569528+0000","last_became_peered":"2024-01-19T05:18:03.569528+0000","last_unstale":"2024-01-19T05:18:04.515576+0000","last_undegraded":"2024-01-19T05:18:04.515576+0000","last_fullsized":"2024-01-19T05:18:04.515576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516108+0000","last_change":"2024-01-19T05:18:03.538635+0000","last_active":"2024-01-19T05:18:04.516108+0000","last_peered":"2024-01-19T05:18:04.516108+0000","last_clean":"2024-01-19T05:18:04.516108+0000","last_became_active":"2024-01-19T05:18:03.537778+0000","last_became_peered":"2024-01-19T05:18:03.537778+0000","last_unstale":"2024-01-19T05:18:04.516108+0000","last_undegraded":"2024-01-19T05:18:04.516108+0000","last_fullsized":"2024-01-19T05:18:04.516108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729656+0000","last_change":"2024-01-19T05:18:03.542188+0000","last_active":"2024-01-19T05:18:04.729656+0000","last_peered":"2024-01-19T05:18:04.729656+0000","last_clean":"2024-01-19T05:18:04.729656+0000","last_became_active":"2024-01-19T05:18:03.541504+0000","last_became_peered":"2024-01-19T05:18:03.541504+0000","last_unstale":"2024-01-19T05:18:04.729656+0000","last_undegraded":"2024-01-19T05:18:04.729656+0000","last_fullsized":"2024-01-19T05:18:04.729656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728750+0000","last_change":"2024-01-19T05:18:03.547095+0000","last_active":"2024-01-19T05:18:04.728750+0000","last_peered":"2024-01-19T05:18:04.728750+0000","last_clean":"2024-01-19T05:18:04.728750+0000","last_became_active":"2024-01-19T05:18:03.546466+0000","last_became_peered":"2024-01-19T05:18:03.546466+0000","last_unstale":"2024-01-19T05:18:04.728750+0000","last_undegraded":"2024-01-19T05:18:04.728750+0000","last_fullsized":"2024-01-19T05:18:04.728750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512907+0000","last_change":"2024-01-19T05:18:03.540449+0000","last_active":"2024-01-19T05:18:04.512907+0000","last_peered":"2024-01-19T05:18:04.512907+0000","last_clean":"2024-01-19T05:18:04.512907+0000","last_became_active":"2024-01-19T05:18:03.539616+0000","last_became_peered":"2024-01-19T05:18:03.539616+0000","last_unstale":"2024-01-19T05:18:04.512907+0000","last_undegraded":"2024-01-19T05:18:04.512907+0000","last_fullsized":"2024-01-19T05:18:04.512907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728960+0000","last_change":"2024-01-19T05:18:03.568406+0000","last_active":"2024-01-19T05:18:04.728960+0000","last_peered":"2024-01-19T05:18:04.728960+0000","last_clean":"2024-01-19T05:18:04.728960+0000","last_became_active":"2024-01-19T05:18:03.567759+0000","last_became_peered":"2024-01-19T05:18:03.567759+0000","last_unstale":"2024-01-19T05:18:04.728960+0000","last_undegraded":"2024-01-19T05:18:04.728960+0000","last_fullsized":"2024-01-19T05:18:04.728960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731803+0000","last_change":"2024-01-19T05:18:03.571085+0000","last_active":"2024-01-19T05:18:04.731803+0000","last_peered":"2024-01-19T05:18:04.731803+0000","last_clean":"2024-01-19T05:18:04.731803+0000","last_became_active":"2024-01-19T05:18:03.569878+0000","last_became_peered":"2024-01-19T05:18:03.569878+0000","last_unstale":"2024-01-19T05:18:04.731803+0000","last_undegraded":"2024-01-19T05:18:04.731803+0000","last_fullsized":"2024-01-19T05:18:04.731803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728098+0000","last_change":"2024-01-19T05:18:03.520269+0000","last_active":"2024-01-19T05:18:04.728098+0000","last_peered":"2024-01-19T05:18:04.728098+0000","last_clean":"2024-01-19T05:18:04.728098+0000","last_became_active":"2024-01-19T05:18:03.519676+0000","last_became_peered":"2024-01-19T05:18:03.519676+0000","last_unstale":"2024-01-19T05:18:04.728098+0000","last_undegraded":"2024-01-19T05:18:04.728098+0000","last_fullsized":"2024-01-19T05:18:04.728098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730254+0000","last_change":"2024-01-19T05:18:03.555567+0000","last_active":"2024-01-19T05:18:04.730254+0000","last_peered":"2024-01-19T05:18:04.730254+0000","last_clean":"2024-01-19T05:18:04.730254+0000","last_became_active":"2024-01-19T05:18:03.554832+0000","last_became_peered":"2024-01-19T05:18:03.554832+0000","last_unstale":"2024-01-19T05:18:04.730254+0000","last_undegraded":"2024-01-19T05:18:04.730254+0000","last_fullsized":"2024-01-19T05:18:04.730254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514744+0000","last_change":"2024-01-19T05:18:03.545771+0000","last_active":"2024-01-19T05:18:04.514744+0000","last_peered":"2024-01-19T05:18:04.514744+0000","last_clean":"2024-01-19T05:18:04.514744+0000","last_became_active":"2024-01-19T05:18:03.545003+0000","last_became_peered":"2024-01-19T05:18:03.545003+0000","last_unstale":"2024-01-19T05:18:04.514744+0000","last_undegraded":"2024-01-19T05:18:04.514744+0000","last_fullsized":"2024-01-19T05:18:04.514744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728346+0000","last_change":"2024-01-19T05:18:03.551774+0000","last_active":"2024-01-19T05:18:04.728346+0000","last_peered":"2024-01-19T05:18:04.728346+0000","last_clean":"2024-01-19T05:18:04.728346+0000","last_became_active":"2024-01-19T05:18:03.550788+0000","last_became_peered":"2024-01-19T05:18:03.550788+0000","last_unstale":"2024-01-19T05:18:04.728346+0000","last_undegraded":"2024-01-19T05:18:04.728346+0000","last_fullsized":"2024-01-19T05:18:04.728346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731558+0000","last_change":"2024-01-19T05:18:03.568310+0000","last_active":"2024-01-19T05:18:04.731558+0000","last_peered":"2024-01-19T05:18:04.731558+0000","last_clean":"2024-01-19T05:18:04.731558+0000","last_became_active":"2024-01-19T05:18:03.567678+0000","last_became_peered":"2024-01-19T05:18:03.567678+0000","last_unstale":"2024-01-19T05:18:04.731558+0000","last_undegraded":"2024-01-19T05:18:04.731558+0000","last_fullsized":"2024-01-19T05:18:04.731558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729157+0000","last_change":"2024-01-19T05:18:03.554839+0000","last_active":"2024-01-19T05:18:04.729157+0000","last_peered":"2024-01-19T05:18:04.729157+0000","last_clean":"2024-01-19T05:18:04.729157+0000","last_became_active":"2024-01-19T05:18:03.551361+0000","last_became_peered":"2024-01-19T05:18:03.551361+0000","last_unstale":"2024-01-19T05:18:04.729157+0000","last_undegraded":"2024-01-19T05:18:04.729157+0000","last_fullsized":"2024-01-19T05:18:04.729157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729155+0000","last_change":"2024-01-19T05:18:03.563289+0000","last_active":"2024-01-19T05:18:04.729155+0000","last_peered":"2024-01-19T05:18:04.729155+0000","last_clean":"2024-01-19T05:18:04.729155+0000","last_became_active":"2024-01-19T05:18:03.556561+0000","last_became_peered":"2024-01-19T05:18:03.556561+0000","last_unstale":"2024-01-19T05:18:04.729155+0000","last_undegraded":"2024-01-19T05:18:04.729155+0000","last_fullsized":"2024-01-19T05:18:04.729155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730025+0000","last_change":"2024-01-19T05:18:03.546978+0000","last_active":"2024-01-19T05:18:04.730025+0000","last_peered":"2024-01-19T05:18:04.730025+0000","last_clean":"2024-01-19T05:18:04.730025+0000","last_became_active":"2024-01-19T05:18:03.546276+0000","last_became_peered":"2024-01-19T05:18:03.546276+0000","last_unstale":"2024-01-19T05:18:04.730025+0000","last_undegraded":"2024-01-19T05:18:04.730025+0000","last_fullsized":"2024-01-19T05:18:04.730025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515447+0000","last_change":"2024-01-19T05:18:03.525138+0000","last_active":"2024-01-19T05:18:04.515447+0000","last_peered":"2024-01-19T05:18:04.515447+0000","last_clean":"2024-01-19T05:18:04.515447+0000","last_became_active":"2024-01-19T05:18:03.524523+0000","last_became_peered":"2024-01-19T05:18:03.524523+0000","last_unstale":"2024-01-19T05:18:04.515447+0000","last_undegraded":"2024-01-19T05:18:04.515447+0000","last_fullsized":"2024-01-19T05:18:04.515447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512997+0000","last_change":"2024-01-19T05:18:03.544359+0000","last_active":"2024-01-19T05:18:04.512997+0000","last_peered":"2024-01-19T05:18:04.512997+0000","last_clean":"2024-01-19T05:18:04.512997+0000","last_became_active":"2024-01-19T05:18:03.543559+0000","last_became_peered":"2024-01-19T05:18:03.543559+0000","last_unstale":"2024-01-19T05:18:04.512997+0000","last_undegraded":"2024-01-19T05:18:04.512997+0000","last_fullsized":"2024-01-19T05:18:04.512997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729855+0000","last_change":"2024-01-19T05:18:03.549033+0000","last_active":"2024-01-19T05:18:04.729855+0000","last_peered":"2024-01-19T05:18:04.729855+0000","last_clean":"2024-01-19T05:18:04.729855+0000","last_became_active":"2024-01-19T05:18:03.548292+0000","last_became_peered":"2024-01-19T05:18:03.548292+0000","last_unstale":"2024-01-19T05:18:04.729855+0000","last_undegraded":"2024-01-19T05:18:04.729855+0000","last_fullsized":"2024-01-19T05:18:04.729855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728511+0000","last_change":"2024-01-19T05:18:03.557894+0000","last_active":"2024-01-19T05:18:04.728511+0000","last_peered":"2024-01-19T05:18:04.728511+0000","last_clean":"2024-01-19T05:18:04.728511+0000","last_became_active":"2024-01-19T05:18:03.556934+0000","last_became_peered":"2024-01-19T05:18:03.556934+0000","last_unstale":"2024-01-19T05:18:04.728511+0000","last_undegraded":"2024-01-19T05:18:04.728511+0000","last_fullsized":"2024-01-19T05:18:04.728511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730933+0000","last_change":"2024-01-19T05:18:03.557384+0000","last_active":"2024-01-19T05:18:04.730933+0000","last_peered":"2024-01-19T05:18:04.730933+0000","last_clean":"2024-01-19T05:18:04.730933+0000","last_became_active":"2024-01-19T05:18:03.555960+0000","last_became_peered":"2024-01-19T05:18:03.555960+0000","last_unstale":"2024-01-19T05:18:04.730933+0000","last_undegraded":"2024-01-19T05:18:04.730933+0000","last_fullsized":"2024-01-19T05:18:04.730933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727845+0000","last_change":"2024-01-19T05:18:03.560129+0000","last_active":"2024-01-19T05:18:04.727845+0000","last_peered":"2024-01-19T05:18:04.727845+0000","last_clean":"2024-01-19T05:18:04.727845+0000","last_became_active":"2024-01-19T05:18:03.559502+0000","last_became_peered":"2024-01-19T05:18:03.559502+0000","last_unstale":"2024-01-19T05:18:04.727845+0000","last_undegraded":"2024-01-19T05:18:04.727845+0000","last_fullsized":"2024-01-19T05:18:04.727845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513499+0000","last_change":"2024-01-19T05:18:03.537557+0000","last_active":"2024-01-19T05:18:04.513499+0000","last_peered":"2024-01-19T05:18:04.513499+0000","last_clean":"2024-01-19T05:18:04.513499+0000","last_became_active":"2024-01-19T05:18:03.536744+0000","last_became_peered":"2024-01-19T05:18:03.536744+0000","last_unstale":"2024-01-19T05:18:04.513499+0000","last_undegraded":"2024-01-19T05:18:04.513499+0000","last_fullsized":"2024-01-19T05:18:04.513499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514550+0000","last_change":"2024-01-19T05:18:03.537254+0000","last_active":"2024-01-19T05:18:04.514550+0000","last_peered":"2024-01-19T05:18:04.514550+0000","last_clean":"2024-01-19T05:18:04.514550+0000","last_became_active":"2024-01-19T05:18:03.536484+0000","last_became_peered":"2024-01-19T05:18:03.536484+0000","last_unstale":"2024-01-19T05:18:04.514550+0000","last_undegraded":"2024-01-19T05:18:04.514550+0000","last_fullsized":"2024-01-19T05:18:04.514550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:40.310261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729759+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.729759+0000","last_peered":"2024-01-19T05:18:04.729759+0000","last_clean":"2024-01-19T05:18:04.729759+0000","last_became_active":"2024-01-19T05:18:02.664263+0000","last_became_peered":"2024-01-19T05:18:02.664263+0000","last_unstale":"2024-01-19T05:18:04.729759+0000","last_undegraded":"2024-01-19T05:18:04.729759+0000","last_fullsized":"2024-01-19T05:18:04.729759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728651+0000","last_change":"2024-01-19T05:18:03.544005+0000","last_active":"2024-01-19T05:18:04.728651+0000","last_peered":"2024-01-19T05:18:04.728651+0000","last_clean":"2024-01-19T05:18:04.728651+0000","last_became_active":"2024-01-19T05:18:03.543213+0000","last_became_peered":"2024-01-19T05:18:03.543213+0000","last_unstale":"2024-01-19T05:18:04.728651+0000","last_undegraded":"2024-01-19T05:18:04.728651+0000","last_fullsized":"2024-01-19T05:18:04.728651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515401+0000","last_change":"2024-01-19T05:18:02.657382+0000","last_active":"2024-01-19T05:18:04.515401+0000","last_peered":"2024-01-19T05:18:04.515401+0000","last_clean":"2024-01-19T05:18:04.515401+0000","last_became_active":"2024-01-19T05:18:02.656806+0000","last_became_peered":"2024-01-19T05:18:02.656806+0000","last_unstale":"2024-01-19T05:18:04.515401+0000","last_undegraded":"2024-01-19T05:18:04.515401+0000","last_fullsized":"2024-01-19T05:18:04.515401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729079+0000","last_change":"2024-01-19T05:18:02.653215+0000","last_active":"2024-01-19T05:18:04.729079+0000","last_peered":"2024-01-19T05:18:04.729079+0000","last_clean":"2024-01-19T05:18:04.729079+0000","last_became_active":"2024-01-19T05:18:02.652938+0000","last_became_peered":"2024-01-19T05:18:02.652938+0000","last_unstale":"2024-01-19T05:18:04.729079+0000","last_undegraded":"2024-01-19T05:18:04.729079+0000","last_fullsized":"2024-01-19T05:18:04.729079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729005+0000","last_change":"2024-01-19T05:18:03.541881+0000","last_active":"2024-01-19T05:18:04.729005+0000","last_peered":"2024-01-19T05:18:04.729005+0000","last_clean":"2024-01-19T05:18:04.729005+0000","last_became_active":"2024-01-19T05:18:03.541176+0000","last_became_peered":"2024-01-19T05:18:03.541176+0000","last_unstale":"2024-01-19T05:18:04.729005+0000","last_undegraded":"2024-01-19T05:18:04.729005+0000","last_fullsized":"2024-01-19T05:18:04.729005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730990+0000","last_change":"2024-01-19T05:18:02.657034+0000","last_active":"2024-01-19T05:18:04.730990+0000","last_peered":"2024-01-19T05:18:04.730990+0000","last_clean":"2024-01-19T05:18:04.730990+0000","last_became_active":"2024-01-19T05:18:02.656500+0000","last_became_peered":"2024-01-19T05:18:02.656500+0000","last_unstale":"2024-01-19T05:18:04.730990+0000","last_undegraded":"2024-01-19T05:18:04.730990+0000","last_fullsized":"2024-01-19T05:18:04.730990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512764+0000","last_change":"2024-01-19T05:18:03.544242+0000","last_active":"2024-01-19T05:18:04.512764+0000","last_peered":"2024-01-19T05:18:04.512764+0000","last_clean":"2024-01-19T05:18:04.512764+0000","last_became_active":"2024-01-19T05:18:03.543438+0000","last_became_peered":"2024-01-19T05:18:03.543438+0000","last_unstale":"2024-01-19T05:18:04.512764+0000","last_undegraded":"2024-01-19T05:18:04.512764+0000","last_fullsized":"2024-01-19T05:18:04.512764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515016+0000","last_change":"2024-01-19T05:18:02.653594+0000","last_active":"2024-01-19T05:18:04.515016+0000","last_peered":"2024-01-19T05:18:04.515016+0000","last_clean":"2024-01-19T05:18:04.515016+0000","last_became_active":"2024-01-19T05:18:02.653182+0000","last_became_peered":"2024-01-19T05:18:02.653182+0000","last_unstale":"2024-01-19T05:18:04.515016+0000","last_undegraded":"2024-01-19T05:18:04.515016+0000","last_fullsized":"2024-01-19T05:18:04.515016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730837+0000","last_change":"2024-01-19T05:18:03.562845+0000","last_active":"2024-01-19T05:18:04.730837+0000","last_peered":"2024-01-19T05:18:04.730837+0000","last_clean":"2024-01-19T05:18:04.730837+0000","last_became_active":"2024-01-19T05:18:03.562235+0000","last_became_peered":"2024-01-19T05:18:03.562235+0000","last_unstale":"2024-01-19T05:18:04.730837+0000","last_undegraded":"2024-01-19T05:18:04.730837+0000","last_fullsized":"2024-01-19T05:18:04.730837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731055+0000","last_change":"2024-01-19T05:18:02.660025+0000","last_active":"2024-01-19T05:18:04.731055+0000","last_peered":"2024-01-19T05:18:04.731055+0000","last_clean":"2024-01-19T05:18:04.731055+0000","last_became_active":"2024-01-19T05:18:02.659546+0000","last_became_peered":"2024-01-19T05:18:02.659546+0000","last_unstale":"2024-01-19T05:18:04.731055+0000","last_undegraded":"2024-01-19T05:18:04.731055+0000","last_fullsized":"2024-01-19T05:18:04.731055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:56.624468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728512+0000","last_change":"2024-01-19T05:18:03.568936+0000","last_active":"2024-01-19T05:18:04.728512+0000","last_peered":"2024-01-19T05:18:04.728512+0000","last_clean":"2024-01-19T05:18:04.728512+0000","last_became_active":"2024-01-19T05:18:03.568337+0000","last_became_peered":"2024-01-19T05:18:03.568337+0000","last_unstale":"2024-01-19T05:18:04.728512+0000","last_undegraded":"2024-01-19T05:18:04.728512+0000","last_fullsized":"2024-01-19T05:18:04.728512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513376+0000","last_change":"2024-01-19T05:18:02.661567+0000","last_active":"2024-01-19T05:18:04.513376+0000","last_peered":"2024-01-19T05:18:04.513376+0000","last_clean":"2024-01-19T05:18:04.513376+0000","last_became_active":"2024-01-19T05:18:02.660906+0000","last_became_peered":"2024-01-19T05:18:02.660906+0000","last_unstale":"2024-01-19T05:18:04.513376+0000","last_undegraded":"2024-01-19T05:18:04.513376+0000","last_fullsized":"2024-01-19T05:18:04.513376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516234+0000","last_change":"2024-01-19T05:18:03.548080+0000","last_active":"2024-01-19T05:18:04.516234+0000","last_peered":"2024-01-19T05:18:04.516234+0000","last_clean":"2024-01-19T05:18:04.516234+0000","last_became_active":"2024-01-19T05:18:03.547506+0000","last_became_peered":"2024-01-19T05:18:03.547506+0000","last_unstale":"2024-01-19T05:18:04.516234+0000","last_undegraded":"2024-01-19T05:18:04.516234+0000","last_fullsized":"2024-01-19T05:18:04.516234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514989+0000","last_change":"2024-01-19T05:18:02.660672+0000","last_active":"2024-01-19T05:18:04.514989+0000","last_peered":"2024-01-19T05:18:04.514989+0000","last_clean":"2024-01-19T05:18:04.514989+0000","last_became_active":"2024-01-19T05:18:02.659596+0000","last_became_peered":"2024-01-19T05:18:02.659596+0000","last_unstale":"2024-01-19T05:18:04.514989+0000","last_undegraded":"2024-01-19T05:18:04.514989+0000","last_fullsized":"2024-01-19T05:18:04.514989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729720+0000","last_change":"2024-01-19T05:18:03.550622+0000","last_active":"2024-01-19T05:18:04.729720+0000","last_peered":"2024-01-19T05:18:04.729720+0000","last_clean":"2024-01-19T05:18:04.729720+0000","last_became_active":"2024-01-19T05:18:03.548243+0000","last_became_peered":"2024-01-19T05:18:03.548243+0000","last_unstale":"2024-01-19T05:18:04.729720+0000","last_undegraded":"2024-01-19T05:18:04.729720+0000","last_fullsized":"2024-01-19T05:18:04.729720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728733+0000","last_change":"2024-01-19T05:18:02.653694+0000","last_active":"2024-01-19T05:18:04.728733+0000","last_peered":"2024-01-19T05:18:04.728733+0000","last_clean":"2024-01-19T05:18:04.728733+0000","last_became_active":"2024-01-19T05:18:02.653236+0000","last_became_peered":"2024-01-19T05:18:02.653236+0000","last_unstale":"2024-01-19T05:18:04.728733+0000","last_undegraded":"2024-01-19T05:18:04.728733+0000","last_fullsized":"2024-01-19T05:18:04.728733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728870+0000","last_change":"2024-01-19T05:18:03.541272+0000","last_active":"2024-01-19T05:18:04.728870+0000","last_peered":"2024-01-19T05:18:04.728870+0000","last_clean":"2024-01-19T05:18:04.728870+0000","last_became_active":"2024-01-19T05:18:03.540187+0000","last_became_peered":"2024-01-19T05:18:03.540187+0000","last_unstale":"2024-01-19T05:18:04.728870+0000","last_undegraded":"2024-01-19T05:18:04.728870+0000","last_fullsized":"2024-01-19T05:18:04.728870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731175+0000","last_change":"2024-01-19T05:18:02.662629+0000","last_active":"2024-01-19T05:18:04.731175+0000","last_peered":"2024-01-19T05:18:04.731175+0000","last_clean":"2024-01-19T05:18:04.731175+0000","last_became_active":"2024-01-19T05:18:02.662095+0000","last_became_peered":"2024-01-19T05:18:02.662095+0000","last_unstale":"2024-01-19T05:18:04.731175+0000","last_undegraded":"2024-01-19T05:18:04.731175+0000","last_fullsized":"2024-01-19T05:18:04.731175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:03.589258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729878+0000","last_change":"2024-01-19T05:18:03.543853+0000","last_active":"2024-01-19T05:18:04.729878+0000","last_peered":"2024-01-19T05:18:04.729878+0000","last_clean":"2024-01-19T05:18:04.729878+0000","last_became_active":"2024-01-19T05:18:03.543119+0000","last_became_peered":"2024-01-19T05:18:03.543119+0000","last_unstale":"2024-01-19T05:18:04.729878+0000","last_undegraded":"2024-01-19T05:18:04.729878+0000","last_fullsized":"2024-01-19T05:18:04.729878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513670+0000","last_change":"2024-01-19T05:18:02.657695+0000","last_active":"2024-01-19T05:18:04.513670+0000","last_peered":"2024-01-19T05:18:04.513670+0000","last_clean":"2024-01-19T05:18:04.513670+0000","last_became_active":"2024-01-19T05:18:02.656870+0000","last_became_peered":"2024-01-19T05:18:02.656870+0000","last_unstale":"2024-01-19T05:18:04.513670+0000","last_undegraded":"2024-01-19T05:18:04.513670+0000","last_fullsized":"2024-01-19T05:18:04.513670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513835+0000","last_change":"2024-01-19T05:18:03.534680+0000","last_active":"2024-01-19T05:18:04.513835+0000","last_peered":"2024-01-19T05:18:04.513835+0000","last_clean":"2024-01-19T05:18:04.513835+0000","last_became_active":"2024-01-19T05:18:03.533937+0000","last_became_peered":"2024-01-19T05:18:03.533937+0000","last_unstale":"2024-01-19T05:18:04.513835+0000","last_undegraded":"2024-01-19T05:18:04.513835+0000","last_fullsized":"2024-01-19T05:18:04.513835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727901+0000","last_change":"2024-01-19T05:18:02.650559+0000","last_active":"2024-01-19T05:18:04.727901+0000","last_peered":"2024-01-19T05:18:04.727901+0000","last_clean":"2024-01-19T05:18:04.727901+0000","last_became_active":"2024-01-19T05:18:02.649764+0000","last_became_peered":"2024-01-19T05:18:02.649764+0000","last_unstale":"2024-01-19T05:18:04.727901+0000","last_undegraded":"2024-01-19T05:18:04.727901+0000","last_fullsized":"2024-01-19T05:18:04.727901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729375+0000","last_change":"2024-01-19T05:18:03.550709+0000","last_active":"2024-01-19T05:18:04.729375+0000","last_peered":"2024-01-19T05:18:04.729375+0000","last_clean":"2024-01-19T05:18:04.729375+0000","last_became_active":"2024-01-19T05:18:03.550073+0000","last_became_peered":"2024-01-19T05:18:03.550073+0000","last_unstale":"2024-01-19T05:18:04.729375+0000","last_undegraded":"2024-01-19T05:18:04.729375+0000","last_fullsized":"2024-01-19T05:18:04.729375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516191+0000","last_change":"2024-01-19T05:18:02.655120+0000","last_active":"2024-01-19T05:18:04.516191+0000","last_peered":"2024-01-19T05:18:04.516191+0000","last_clean":"2024-01-19T05:18:04.516191+0000","last_became_active":"2024-01-19T05:18:02.654360+0000","last_became_peered":"2024-01-19T05:18:02.654360+0000","last_unstale":"2024-01-19T05:18:04.516191+0000","last_undegraded":"2024-01-19T05:18:04.516191+0000","last_fullsized":"2024-01-19T05:18:04.516191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:32:02.214385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730500+0000","last_change":"2024-01-19T05:18:03.543739+0000","last_active":"2024-01-19T05:18:04.730500+0000","last_peered":"2024-01-19T05:18:04.730500+0000","last_clean":"2024-01-19T05:18:04.730500+0000","last_became_active":"2024-01-19T05:18:03.543142+0000","last_became_peered":"2024-01-19T05:18:03.543142+0000","last_unstale":"2024-01-19T05:18:04.730500+0000","last_undegraded":"2024-01-19T05:18:04.730500+0000","last_fullsized":"2024-01-19T05:18:04.730500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728061+0000","last_change":"2024-01-19T05:18:02.662915+0000","last_active":"2024-01-19T05:18:04.728061+0000","last_peered":"2024-01-19T05:18:04.728061+0000","last_clean":"2024-01-19T05:18:04.728061+0000","last_became_active":"2024-01-19T05:18:02.662617+0000","last_became_peered":"2024-01-19T05:18:02.662617+0000","last_unstale":"2024-01-19T05:18:04.728061+0000","last_undegraded":"2024-01-19T05:18:04.728061+0000","last_fullsized":"2024-01-19T05:18:04.728061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729905+0000","last_change":"2024-01-19T05:18:03.543521+0000","last_active":"2024-01-19T05:18:04.729905+0000","last_peered":"2024-01-19T05:18:04.729905+0000","last_clean":"2024-01-19T05:18:04.729905+0000","last_became_active":"2024-01-19T05:18:03.542803+0000","last_became_peered":"2024-01-19T05:18:03.542803+0000","last_unstale":"2024-01-19T05:18:04.729905+0000","last_undegraded":"2024-01-19T05:18:04.729905+0000","last_fullsized":"2024-01-19T05:18:04.729905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513101+0000","last_change":"2024-01-19T05:18:02.650642+0000","last_active":"2024-01-19T05:18:04.513101+0000","last_peered":"2024-01-19T05:18:04.513101+0000","last_clean":"2024-01-19T05:18:04.513101+0000","last_became_active":"2024-01-19T05:18:02.650319+0000","last_became_peered":"2024-01-19T05:18:02.650319+0000","last_unstale":"2024-01-19T05:18:04.513101+0000","last_undegraded":"2024-01-19T05:18:04.513101+0000","last_fullsized":"2024-01-19T05:18:04.513101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.565837+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.564725+0000","last_became_peered":"2024-01-19T05:18:03.564725+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727937+0000","last_change":"2024-01-19T05:18:02.656957+0000","last_active":"2024-01-19T05:18:04.727937+0000","last_peered":"2024-01-19T05:18:04.727937+0000","last_clean":"2024-01-19T05:18:04.727937+0000","last_became_active":"2024-01-19T05:18:02.656536+0000","last_became_peered":"2024-01-19T05:18:02.656536+0000","last_unstale":"2024-01-19T05:18:04.727937+0000","last_undegraded":"2024-01-19T05:18:04.727937+0000","last_fullsized":"2024-01-19T05:18:04.727937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729922+0000","last_change":"2024-01-19T05:18:03.571256+0000","last_active":"2024-01-19T05:18:04.729922+0000","last_peered":"2024-01-19T05:18:04.729922+0000","last_clean":"2024-01-19T05:18:04.729922+0000","last_became_active":"2024-01-19T05:18:03.570499+0000","last_became_peered":"2024-01-19T05:18:03.570499+0000","last_unstale":"2024-01-19T05:18:04.729922+0000","last_undegraded":"2024-01-19T05:18:04.729922+0000","last_fullsized":"2024-01-19T05:18:04.729922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-19T05:18:03.520367+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:03.520367+0000","last_peered":"2024-01-19T05:18:03.520367+0000","last_clean":"2024-01-19T05:18:03.520367+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:03.520367+0000","last_undegraded":"2024-01-19T05:18:03.520367+0000","last_fullsized":"2024-01-19T05:18:03.520367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730433+0000","last_change":"2024-01-19T05:18:02.650789+0000","last_active":"2024-01-19T05:18:04.730433+0000","last_peered":"2024-01-19T05:18:04.730433+0000","last_clean":"2024-01-19T05:18:04.730433+0000","last_became_active":"2024-01-19T05:18:02.649923+0000","last_became_peered":"2024-01-19T05:18:02.649923+0000","last_unstale":"2024-01-19T05:18:04.730433+0000","last_undegraded":"2024-01-19T05:18:04.730433+0000","last_fullsized":"2024-01-19T05:18:04.730433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:12.078445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729614+0000","last_change":"2024-01-19T05:18:03.569109+0000","last_active":"2024-01-19T05:18:04.729614+0000","last_peered":"2024-01-19T05:18:04.729614+0000","last_clean":"2024-01-19T05:18:04.729614+0000","last_became_active":"2024-01-19T05:18:03.568602+0000","last_became_peered":"2024-01-19T05:18:03.568602+0000","last_unstale":"2024-01-19T05:18:04.729614+0000","last_undegraded":"2024-01-19T05:18:04.729614+0000","last_fullsized":"2024-01-19T05:18:04.729614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729626+0000","last_change":"2024-01-19T05:18:02.671990+0000","last_active":"2024-01-19T05:18:04.729626+0000","last_peered":"2024-01-19T05:18:04.729626+0000","last_clean":"2024-01-19T05:18:04.729626+0000","last_became_active":"2024-01-19T05:18:02.671477+0000","last_became_peered":"2024-01-19T05:18:02.671477+0000","last_unstale":"2024-01-19T05:18:04.729626+0000","last_undegraded":"2024-01-19T05:18:04.729626+0000","last_fullsized":"2024-01-19T05:18:04.729626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728522+0000","last_change":"2024-01-19T05:18:03.551760+0000","last_active":"2024-01-19T05:18:04.728522+0000","last_peered":"2024-01-19T05:18:04.728522+0000","last_clean":"2024-01-19T05:18:04.728522+0000","last_became_active":"2024-01-19T05:18:03.550881+0000","last_became_peered":"2024-01-19T05:18:03.550881+0000","last_unstale":"2024-01-19T05:18:04.728522+0000","last_undegraded":"2024-01-19T05:18:04.728522+0000","last_fullsized":"2024-01-19T05:18:04.728522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727890+0000","last_change":"2024-01-19T05:18:02.663101+0000","last_active":"2024-01-19T05:18:04.727890+0000","last_peered":"2024-01-19T05:18:04.727890+0000","last_clean":"2024-01-19T05:18:04.727890+0000","last_became_active":"2024-01-19T05:18:02.662604+0000","last_became_peered":"2024-01-19T05:18:02.662604+0000","last_unstale":"2024-01-19T05:18:04.727890+0000","last_undegraded":"2024-01-19T05:18:04.727890+0000","last_fullsized":"2024-01-19T05:18:04.727890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512852+0000","last_change":"2024-01-19T05:18:03.537638+0000","last_active":"2024-01-19T05:18:04.512852+0000","last_peered":"2024-01-19T05:18:04.512852+0000","last_clean":"2024-01-19T05:18:04.512852+0000","last_became_active":"2024-01-19T05:18:03.536862+0000","last_became_peered":"2024-01-19T05:18:03.536862+0000","last_unstale":"2024-01-19T05:18:04.512852+0000","last_undegraded":"2024-01-19T05:18:04.512852+0000","last_fullsized":"2024-01-19T05:18:04.512852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731398+0000","last_change":"2024-01-19T05:18:02.655462+0000","last_active":"2024-01-19T05:18:04.731398+0000","last_peered":"2024-01-19T05:18:04.731398+0000","last_clean":"2024-01-19T05:18:04.731398+0000","last_became_active":"2024-01-19T05:18:02.654363+0000","last_became_peered":"2024-01-19T05:18:02.654363+0000","last_unstale":"2024-01-19T05:18:04.731398+0000","last_undegraded":"2024-01-19T05:18:04.731398+0000","last_fullsized":"2024-01-19T05:18:04.731398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:40.854099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515031+0000","last_change":"2024-01-19T05:18:03.540906+0000","last_active":"2024-01-19T05:18:04.515031+0000","last_peered":"2024-01-19T05:18:04.515031+0000","last_clean":"2024-01-19T05:18:04.515031+0000","last_became_active":"2024-01-19T05:18:03.540116+0000","last_became_peered":"2024-01-19T05:18:03.540116+0000","last_unstale":"2024-01-19T05:18:04.515031+0000","last_undegraded":"2024-01-19T05:18:04.515031+0000","last_fullsized":"2024-01-19T05:18:04.515031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:37.646122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512849+0000","last_change":"2024-01-19T05:18:02.657808+0000","last_active":"2024-01-19T05:18:04.512849+0000","last_peered":"2024-01-19T05:18:04.512849+0000","last_clean":"2024-01-19T05:18:04.512849+0000","last_became_active":"2024-01-19T05:18:02.657357+0000","last_became_peered":"2024-01-19T05:18:02.657357+0000","last_unstale":"2024-01-19T05:18:04.512849+0000","last_undegraded":"2024-01-19T05:18:04.512849+0000","last_fullsized":"2024-01-19T05:18:04.512849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.566199+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.565571+0000","last_became_peered":"2024-01-19T05:18:03.565571+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730213+0000","last_change":"2024-01-19T05:18:02.674805+0000","last_active":"2024-01-19T05:18:04.730213+0000","last_peered":"2024-01-19T05:18:04.730213+0000","last_clean":"2024-01-19T05:18:04.730213+0000","last_became_active":"2024-01-19T05:18:02.674331+0000","last_became_peered":"2024-01-19T05:18:02.674331+0000","last_unstale":"2024-01-19T05:18:04.730213+0000","last_undegraded":"2024-01-19T05:18:04.730213+0000","last_fullsized":"2024-01-19T05:18:04.730213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513263+0000","last_change":"2024-01-19T05:18:03.535625+0000","last_active":"2024-01-19T05:18:04.513263+0000","last_peered":"2024-01-19T05:18:04.513263+0000","last_clean":"2024-01-19T05:18:04.513263+0000","last_became_active":"2024-01-19T05:18:03.534935+0000","last_became_peered":"2024-01-19T05:18:03.534935+0000","last_unstale":"2024-01-19T05:18:04.513263+0000","last_undegraded":"2024-01-19T05:18:04.513263+0000","last_fullsized":"2024-01-19T05:18:04.513263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:05.378485+0000","last_change":"2024-01-19T05:18:02.660485+0000","last_active":"2024-01-19T05:18:05.378485+0000","last_peered":"2024-01-19T05:18:05.378485+0000","last_clean":"2024-01-19T05:18:05.378485+0000","last_became_active":"2024-01-19T05:18:02.660172+0000","last_became_peered":"2024-01-19T05:18:02.660172+0000","last_unstale":"2024-01-19T05:18:05.378485+0000","last_undegraded":"2024-01-19T05:18:05.378485+0000","last_fullsized":"2024-01-19T05:18:05.378485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730089+0000","last_change":"2024-01-19T05:18:03.549395+0000","last_active":"2024-01-19T05:18:04.730089+0000","last_peered":"2024-01-19T05:18:04.730089+0000","last_clean":"2024-01-19T05:18:04.730089+0000","last_became_active":"2024-01-19T05:18:03.548645+0000","last_became_peered":"2024-01-19T05:18:03.548645+0000","last_unstale":"2024-01-19T05:18:04.730089+0000","last_undegraded":"2024-01-19T05:18:04.730089+0000","last_fullsized":"2024-01-19T05:18:04.730089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515120+0000","last_change":"2024-01-19T05:18:02.665544+0000","last_active":"2024-01-19T05:18:04.515120+0000","last_peered":"2024-01-19T05:18:04.515120+0000","last_clean":"2024-01-19T05:18:04.515120+0000","last_became_active":"2024-01-19T05:18:02.665011+0000","last_became_peered":"2024-01-19T05:18:02.665011+0000","last_unstale":"2024-01-19T05:18:04.515120+0000","last_undegraded":"2024-01-19T05:18:04.515120+0000","last_fullsized":"2024-01-19T05:18:04.515120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728406+0000","last_change":"2024-01-19T05:18:03.546972+0000","last_active":"2024-01-19T05:18:04.728406+0000","last_peered":"2024-01-19T05:18:04.728406+0000","last_clean":"2024-01-19T05:18:04.728406+0000","last_became_active":"2024-01-19T05:18:03.546258+0000","last_became_peered":"2024-01-19T05:18:03.546258+0000","last_unstale":"2024-01-19T05:18:04.728406+0000","last_undegraded":"2024-01-19T05:18:04.728406+0000","last_fullsized":"2024-01-19T05:18:04.728406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728783+0000","last_change":"2024-01-19T05:18:02.668468+0000","last_active":"2024-01-19T05:18:04.728783+0000","last_peered":"2024-01-19T05:18:04.728783+0000","last_clean":"2024-01-19T05:18:04.728783+0000","last_became_active":"2024-01-19T05:18:02.668005+0000","last_became_peered":"2024-01-19T05:18:02.668005+0000","last_unstale":"2024-01-19T05:18:04.728783+0000","last_undegraded":"2024-01-19T05:18:04.728783+0000","last_fullsized":"2024-01-19T05:18:04.728783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514090+0000","last_change":"2024-01-19T05:18:03.545257+0000","last_active":"2024-01-19T05:18:04.514090+0000","last_peered":"2024-01-19T05:18:04.514090+0000","last_clean":"2024-01-19T05:18:04.514090+0000","last_became_active":"2024-01-19T05:18:03.542709+0000","last_became_peered":"2024-01-19T05:18:03.542709+0000","last_unstale":"2024-01-19T05:18:04.514090+0000","last_undegraded":"2024-01-19T05:18:04.514090+0000","last_fullsized":"2024-01-19T05:18:04.514090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:31.698937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512995+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.512995+0000","last_peered":"2024-01-19T05:18:04.512995+0000","last_clean":"2024-01-19T05:18:04.512995+0000","last_became_active":"2024-01-19T05:18:02.664286+0000","last_became_peered":"2024-01-19T05:18:02.664286+0000","last_unstale":"2024-01-19T05:18:04.512995+0000","last_undegraded":"2024-01-19T05:18:04.512995+0000","last_fullsized":"2024-01-19T05:18:04.512995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729156+0000","last_change":"2024-01-19T05:18:03.554862+0000","last_active":"2024-01-19T05:18:04.729156+0000","last_peered":"2024-01-19T05:18:04.729156+0000","last_clean":"2024-01-19T05:18:04.729156+0000","last_became_active":"2024-01-19T05:18:03.550546+0000","last_became_peered":"2024-01-19T05:18:03.550546+0000","last_unstale":"2024-01-19T05:18:04.729156+0000","last_undegraded":"2024-01-19T05:18:04.729156+0000","last_fullsized":"2024-01-19T05:18:04.729156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513140+0000","last_change":"2024-01-19T05:18:02.663145+0000","last_active":"2024-01-19T05:18:04.513140+0000","last_peered":"2024-01-19T05:18:04.513140+0000","last_clean":"2024-01-19T05:18:04.513140+0000","last_became_active":"2024-01-19T05:18:02.662788+0000","last_became_peered":"2024-01-19T05:18:02.662788+0000","last_unstale":"2024-01-19T05:18:04.513140+0000","last_undegraded":"2024-01-19T05:18:04.513140+0000","last_fullsized":"2024-01-19T05:18:04.513140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729679+0000","last_change":"2024-01-19T05:18:03.551324+0000","last_active":"2024-01-19T05:18:04.729679+0000","last_peered":"2024-01-19T05:18:04.729679+0000","last_clean":"2024-01-19T05:18:04.729679+0000","last_became_active":"2024-01-19T05:18:03.549215+0000","last_became_peered":"2024-01-19T05:18:03.549215+0000","last_unstale":"2024-01-19T05:18:04.729679+0000","last_undegraded":"2024-01-19T05:18:04.729679+0000","last_fullsized":"2024-01-19T05:18:04.729679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730060+0000","last_change":"2024-01-19T05:18:02.670360+0000","last_active":"2024-01-19T05:18:04.730060+0000","last_peered":"2024-01-19T05:18:04.730060+0000","last_clean":"2024-01-19T05:18:04.730060+0000","last_became_active":"2024-01-19T05:18:02.669751+0000","last_became_peered":"2024-01-19T05:18:02.669751+0000","last_unstale":"2024-01-19T05:18:04.730060+0000","last_undegraded":"2024-01-19T05:18:04.730060+0000","last_fullsized":"2024-01-19T05:18:04.730060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513640+0000","last_change":"2024-01-19T05:18:03.531197+0000","last_active":"2024-01-19T05:18:04.513640+0000","last_peered":"2024-01-19T05:18:04.513640+0000","last_clean":"2024-01-19T05:18:04.513640+0000","last_became_active":"2024-01-19T05:18:03.530484+0000","last_became_peered":"2024-01-19T05:18:03.530484+0000","last_unstale":"2024-01-19T05:18:04.513640+0000","last_undegraded":"2024-01-19T05:18:04.513640+0000","last_fullsized":"2024-01-19T05:18:04.513640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731287+0000","last_change":"2024-01-19T05:18:03.562891+0000","last_active":"2024-01-19T05:18:04.731287+0000","last_peered":"2024-01-19T05:18:04.731287+0000","last_clean":"2024-01-19T05:18:04.731287+0000","last_became_active":"2024-01-19T05:18:03.558374+0000","last_became_peered":"2024-01-19T05:18:03.558374+0000","last_unstale":"2024-01-19T05:18:04.731287+0000","last_undegraded":"2024-01-19T05:18:04.731287+0000","last_fullsized":"2024-01-19T05:18:04.731287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729394+0000","last_change":"2024-01-19T05:18:02.672001+0000","last_active":"2024-01-19T05:18:04.729394+0000","last_peered":"2024-01-19T05:18:04.729394+0000","last_clean":"2024-01-19T05:18:04.729394+0000","last_became_active":"2024-01-19T05:18:02.671437+0000","last_became_peered":"2024-01-19T05:18:02.671437+0000","last_unstale":"2024-01-19T05:18:04.729394+0000","last_undegraded":"2024-01-19T05:18:04.729394+0000","last_fullsized":"2024-01-19T05:18:04.729394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731196+0000","last_change":"2024-01-19T05:18:03.565321+0000","last_active":"2024-01-19T05:18:04.731196+0000","last_peered":"2024-01-19T05:18:04.731196+0000","last_clean":"2024-01-19T05:18:04.731196+0000","last_became_active":"2024-01-19T05:18:03.563207+0000","last_became_peered":"2024-01-19T05:18:03.563207+0000","last_unstale":"2024-01-19T05:18:04.731196+0000","last_undegraded":"2024-01-19T05:18:04.731196+0000","last_fullsized":"2024-01-19T05:18:04.731196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729996+0000","last_change":"2024-01-19T05:18:02.673614+0000","last_active":"2024-01-19T05:18:04.729996+0000","last_peered":"2024-01-19T05:18:04.729996+0000","last_clean":"2024-01-19T05:18:04.729996+0000","last_became_active":"2024-01-19T05:18:02.673106+0000","last_became_peered":"2024-01-19T05:18:02.673106+0000","last_unstale":"2024-01-19T05:18:04.729996+0000","last_undegraded":"2024-01-19T05:18:04.729996+0000","last_fullsized":"2024-01-19T05:18:04.729996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728334+0000","last_change":"2024-01-19T05:18:03.570972+0000","last_active":"2024-01-19T05:18:04.728334+0000","last_peered":"2024-01-19T05:18:04.728334+0000","last_clean":"2024-01-19T05:18:04.728334+0000","last_became_active":"2024-01-19T05:18:03.570555+0000","last_became_peered":"2024-01-19T05:18:03.570555+0000","last_unstale":"2024-01-19T05:18:04.728334+0000","last_undegraded":"2024-01-19T05:18:04.728334+0000","last_fullsized":"2024-01-19T05:18:04.728334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:41.862758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729948+0000","last_change":"2024-01-19T05:18:02.661127+0000","last_active":"2024-01-19T05:18:04.729948+0000","last_peered":"2024-01-19T05:18:04.729948+0000","last_clean":"2024-01-19T05:18:04.729948+0000","last_became_active":"2024-01-19T05:18:02.660171+0000","last_became_peered":"2024-01-19T05:18:02.660171+0000","last_unstale":"2024-01-19T05:18:04.729948+0000","last_undegraded":"2024-01-19T05:18:04.729948+0000","last_fullsized":"2024-01-19T05:18:04.729948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729899+0000","last_change":"2024-01-19T05:18:03.546643+0000","last_active":"2024-01-19T05:18:04.729899+0000","last_peered":"2024-01-19T05:18:04.729899+0000","last_clean":"2024-01-19T05:18:04.729899+0000","last_became_active":"2024-01-19T05:18:03.545889+0000","last_became_peered":"2024-01-19T05:18:03.545889+0000","last_unstale":"2024-01-19T05:18:04.729899+0000","last_undegraded":"2024-01-19T05:18:04.729899+0000","last_fullsized":"2024-01-19T05:18:04.729899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728691+0000","last_change":"2024-01-19T05:18:02.666057+0000","last_active":"2024-01-19T05:18:04.728691+0000","last_peered":"2024-01-19T05:18:04.728691+0000","last_clean":"2024-01-19T05:18:04.728691+0000","last_became_active":"2024-01-19T05:18:02.665663+0000","last_became_peered":"2024-01-19T05:18:02.665663+0000","last_unstale":"2024-01-19T05:18:04.728691+0000","last_undegraded":"2024-01-19T05:18:04.728691+0000","last_fullsized":"2024-01-19T05:18:04.728691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:15.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:15.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.441+0000 7fd10c567640 1 Processor -- start 2024-01-19T05:18:15.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.441+0000 7fd10c567640 1 -- start start 2024-01-19T05:18:15.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd10c567640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd1040b4500 0x7fd104142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd10c567640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd1040b36f0 0x7fd1041433d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd10c567640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1040b22b0 con 0x7fd1040b3310 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd10c567640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10406eda0 con 0x7fd1040b4500 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd10c567640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1040b16d0 con 0x7fd1040b36f0 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd10a303640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd1040b3310 0x7fd1040b3df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33344/0 (socket says 172.21.15.99:33344) 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd10a303640 1 -- 172.21.15.99:0/2058314220 learned_addr learned my addr 172.21.15.99:0/2058314220 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109b02640 1 --2- 172.21.15.99:0/2058314220 >> v2:172.21.15.99:3300/0 conn(0x7fd1040b4500 0x7fd104142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109301640 1 -- 172.21.15.99:0/2058314220 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167762708 0 0) 0x7fd1040b22b0 con 0x7fd1040b3310 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109301640 1 -- 172.21.15.99:0/2058314220 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0f0003530 con 0x7fd1040b3310 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd10ab04640 1 --2- 172.21.15.99:0/2058314220 >> v2:172.21.15.157:3300/0 conn(0x7fd1040b36f0 0x7fd1041433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109b02640 1 -- 172.21.15.99:0/2058314220 >> v2:172.21.15.157:3300/0 conn(0x7fd1040b36f0 msgr2=0x7fd1041433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109b02640 1 --2- 172.21.15.99:0/2058314220 >> v2:172.21.15.157:3300/0 conn(0x7fd1040b36f0 0x7fd1041433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109b02640 1 -- 172.21.15.99:0/2058314220 >> v1:172.21.15.99:6789/0 conn(0x7fd1040b3310 legacy=0x7fd1040b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109b02640 1 -- 172.21.15.99:0/2058314220 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040721c0 con 0x7fd1040b4500 2024-01-19T05:18:15.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109b02640 1 --2- 172.21.15.99:0/2058314220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b4500 0x7fd104142e90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40097c0 tx=0x7fd0f401c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c10d3469901607 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109301640 1 -- 172.21.15.99:0/2058314220 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40ac640 con 0x7fd1040b4500 2024-01-19T05:18:15.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109301640 1 -- 172.21.15.99:0/2058314220 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40ac7a0 con 0x7fd1040b4500 2024-01-19T05:18:15.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.445+0000 7fd109301640 1 -- 172.21.15.99:0/2058314220 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40acb30 con 0x7fd1040b4500 2024-01-19T05:18:15.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- 172.21.15.99:0/2058314220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b4500 msgr2=0x7fd104142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 --2- 172.21.15.99:0/2058314220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b4500 0x7fd104142e90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40097c0 tx=0x7fd0f401c2f0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- 172.21.15.99:0/2058314220 shutdown_connections 2024-01-19T05:18:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 --2- 172.21.15.99:0/2058314220 >> v2:172.21.15.157:3300/0 conn(0x7fd1040b36f0 0x7fd1041433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 --2- 172.21.15.99:0/2058314220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b4500 0x7fd104142e90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- 172.21.15.99:0/2058314220 >> 172.21.15.99:0/2058314220 conn(0x7fd1040b8080 msgr2=0x7fd1040b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- 172.21.15.99:0/2058314220 shutdown_connections 2024-01-19T05:18:15.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- 172.21.15.99:0/2058314220 wait complete. 2024-01-19T05:18:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 Processor -- start 2024-01-19T05:18:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- start start 2024-01-19T05:18:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1040b3310 0x7fd10414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b36f0 0x7fd1041e0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1040b4500 0x7fd1041e1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041465e0 con 0x7fd1040b36f0 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd104143f80 con 0x7fd1040b4500 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041e06c0 con 0x7fd1040b3310 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b36f0 0x7fd1041e0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b36f0 0x7fd1041e0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55334/0 (socket says 172.21.15.99:55334) 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 -- 172.21.15.99:0/3968735698 learned_addr learned my addr 172.21.15.99:0/3968735698 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 -- 172.21.15.99:0/3968735698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1040b3310 msgr2=0x7fd10414db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1040b3310 0x7fd10414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 -- 172.21.15.99:0/3968735698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1040b4500 msgr2=0x7fd1041e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1040b4500 0x7fd1041e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 -- 172.21.15.99:0/3968735698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4009420 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd109b02640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b36f0 0x7fd1041e0b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40097c0 tx=0x7fd0f4019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd0faffd640 1 -- 172.21.15.99:0/3968735698 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40b5610 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd0faffd640 1 -- 172.21.15.99:0/3968735698 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40b5790 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1041472a0 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd0faffd640 1 -- 172.21.15.99:0/3968735698 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40b5b40 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10414cb60 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.449+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1040696e0 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.453+0000 7fd0faffd640 1 -- 172.21.15.99:0/3968735698 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd0f40b3040 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.453+0000 7fd0faffd640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd0e8066500 0x7fd0e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.453+0000 7fd0faffd640 1 -- 172.21.15.99:0/3968735698 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0f411e0e0 con 0x7fd1040b36f0 2024-01-19T05:18:15.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.453+0000 7fd10a303640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd0e8066500 0x7fd0e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.453+0000 7fd10a303640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd0e8066500 0x7fd0e80689c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd100007fd0 tx=0x7fd100007900 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.457+0000 7fd0faffd640 1 -- 172.21.15.99:0/3968735698 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd0f40eb410 con 0x7fd1040b36f0 2024-01-19T05:18:15.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.597+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd104143d20 con 0x7fd0e8066500 2024-01-19T05:18:15.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.613+0000 7fd0faffd640 1 -- 172.21.15.99:0/3968735698 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264413 (secure 0 0 0) 0x7fd1000058a0 con 0x7fd0e8066500 2024-01-19T05:18:15.616 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:15.618 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:15.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd0e8066500 msgr2=0x7fd0e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd0e8066500 0x7fd0e80689c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd100007fd0 tx=0x7fd100007900 comp rx=0 tx=0).stop 2024-01-19T05:18:15.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b36f0 msgr2=0x7fd1041e0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b36f0 0x7fd1041e0b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40097c0 tx=0x7fd0f4019090 comp rx=0 tx=0).stop 2024-01-19T05:18:15.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 shutdown_connections 2024-01-19T05:18:15.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd0e8066500 0x7fd0e80689c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1040b4500 0x7fd1041e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1040b36f0 0x7fd1041e0b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 --2- 172.21.15.99:0/3968735698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd1040b3310 0x7fd10414db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 >> 172.21.15.99:0/3968735698 conn(0x7fd1040b8080 msgr2=0x7fd104070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:15.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 shutdown_connections 2024-01-19T05:18:15.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.617+0000 7fd10c567640 1 -- 172.21.15.99:0/3968735698 wait complete. 2024-01-19T05:18:15.634 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-19T05:18:15.347452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235644,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739076,"statfs":{"total":773094113280,"available":772852813824,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.836537"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729517+0000","last_change":"2024-01-19T05:18:03.537400+0000","last_active":"2024-01-19T05:18:04.729517+0000","last_peered":"2024-01-19T05:18:04.729517+0000","last_clean":"2024-01-19T05:18:04.729517+0000","last_became_active":"2024-01-19T05:18:03.536533+0000","last_became_peered":"2024-01-19T05:18:03.536533+0000","last_unstale":"2024-01-19T05:18:04.729517+0000","last_undegraded":"2024-01-19T05:18:04.729517+0000","last_fullsized":"2024-01-19T05:18:04.729517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513273+0000","last_change":"2024-01-19T05:18:03.538419+0000","last_active":"2024-01-19T05:18:04.513273+0000","last_peered":"2024-01-19T05:18:04.513273+0000","last_clean":"2024-01-19T05:18:04.513273+0000","last_became_active":"2024-01-19T05:18:03.537715+0000","last_became_peered":"2024-01-19T05:18:03.537715+0000","last_unstale":"2024-01-19T05:18:04.513273+0000","last_undegraded":"2024-01-19T05:18:04.513273+0000","last_fullsized":"2024-01-19T05:18:04.513273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728283+0000","last_change":"2024-01-19T05:18:03.554921+0000","last_active":"2024-01-19T05:18:04.728283+0000","last_peered":"2024-01-19T05:18:04.728283+0000","last_clean":"2024-01-19T05:18:04.728283+0000","last_became_active":"2024-01-19T05:18:03.554270+0000","last_became_peered":"2024-01-19T05:18:03.554270+0000","last_unstale":"2024-01-19T05:18:04.728283+0000","last_undegraded":"2024-01-19T05:18:04.728283+0000","last_fullsized":"2024-01-19T05:18:04.728283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:13.087104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730979+0000","last_change":"2024-01-19T05:18:03.566913+0000","last_active":"2024-01-19T05:18:04.730979+0000","last_peered":"2024-01-19T05:18:04.730979+0000","last_clean":"2024-01-19T05:18:04.730979+0000","last_became_active":"2024-01-19T05:18:03.566063+0000","last_became_peered":"2024-01-19T05:18:03.566063+0000","last_unstale":"2024-01-19T05:18:04.730979+0000","last_undegraded":"2024-01-19T05:18:04.730979+0000","last_fullsized":"2024-01-19T05:18:04.730979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.554926+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.554035+0000","last_became_peered":"2024-01-19T05:18:03.554035+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730556+0000","last_change":"2024-01-19T05:18:03.563300+0000","last_active":"2024-01-19T05:18:04.730556+0000","last_peered":"2024-01-19T05:18:04.730556+0000","last_clean":"2024-01-19T05:18:04.730556+0000","last_became_active":"2024-01-19T05:18:03.562655+0000","last_became_peered":"2024-01-19T05:18:03.562655+0000","last_unstale":"2024-01-19T05:18:04.730556+0000","last_undegraded":"2024-01-19T05:18:04.730556+0000","last_fullsized":"2024-01-19T05:18:04.730556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729148+0000","last_change":"2024-01-19T05:18:03.535107+0000","last_active":"2024-01-19T05:18:04.729148+0000","last_peered":"2024-01-19T05:18:04.729148+0000","last_clean":"2024-01-19T05:18:04.729148+0000","last_became_active":"2024-01-19T05:18:03.534338+0000","last_became_peered":"2024-01-19T05:18:03.534338+0000","last_unstale":"2024-01-19T05:18:04.729148+0000","last_undegraded":"2024-01-19T05:18:04.729148+0000","last_fullsized":"2024-01-19T05:18:04.729148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728969+0000","last_change":"2024-01-19T05:18:03.567466+0000","last_active":"2024-01-19T05:18:04.728969+0000","last_peered":"2024-01-19T05:18:04.728969+0000","last_clean":"2024-01-19T05:18:04.728969+0000","last_became_active":"2024-01-19T05:18:03.566828+0000","last_became_peered":"2024-01-19T05:18:03.566828+0000","last_unstale":"2024-01-19T05:18:04.728969+0000","last_undegraded":"2024-01-19T05:18:04.728969+0000","last_fullsized":"2024-01-19T05:18:04.728969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729630+0000","last_change":"2024-01-19T05:18:03.573607+0000","last_active":"2024-01-19T05:18:04.729630+0000","last_peered":"2024-01-19T05:18:04.729630+0000","last_clean":"2024-01-19T05:18:04.729630+0000","last_became_active":"2024-01-19T05:18:03.573072+0000","last_became_peered":"2024-01-19T05:18:03.573072+0000","last_unstale":"2024-01-19T05:18:04.729630+0000","last_undegraded":"2024-01-19T05:18:04.729630+0000","last_fullsized":"2024-01-19T05:18:04.729630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515175+0000","last_change":"2024-01-19T05:18:03.560176+0000","last_active":"2024-01-19T05:18:04.515175+0000","last_peered":"2024-01-19T05:18:04.515175+0000","last_clean":"2024-01-19T05:18:04.515175+0000","last_became_active":"2024-01-19T05:18:03.559432+0000","last_became_peered":"2024-01-19T05:18:03.559432+0000","last_unstale":"2024-01-19T05:18:04.515175+0000","last_undegraded":"2024-01-19T05:18:04.515175+0000","last_fullsized":"2024-01-19T05:18:04.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515576+0000","last_change":"2024-01-19T05:18:03.570077+0000","last_active":"2024-01-19T05:18:04.515576+0000","last_peered":"2024-01-19T05:18:04.515576+0000","last_clean":"2024-01-19T05:18:04.515576+0000","last_became_active":"2024-01-19T05:18:03.569528+0000","last_became_peered":"2024-01-19T05:18:03.569528+0000","last_unstale":"2024-01-19T05:18:04.515576+0000","last_undegraded":"2024-01-19T05:18:04.515576+0000","last_fullsized":"2024-01-19T05:18:04.515576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516108+0000","last_change":"2024-01-19T05:18:03.538635+0000","last_active":"2024-01-19T05:18:04.516108+0000","last_peered":"2024-01-19T05:18:04.516108+0000","last_clean":"2024-01-19T05:18:04.516108+0000","last_became_active":"2024-01-19T05:18:03.537778+0000","last_became_peered":"2024-01-19T05:18:03.537778+0000","last_unstale":"2024-01-19T05:18:04.516108+0000","last_undegraded":"2024-01-19T05:18:04.516108+0000","last_fullsized":"2024-01-19T05:18:04.516108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729656+0000","last_change":"2024-01-19T05:18:03.542188+0000","last_active":"2024-01-19T05:18:04.729656+0000","last_peered":"2024-01-19T05:18:04.729656+0000","last_clean":"2024-01-19T05:18:04.729656+0000","last_became_active":"2024-01-19T05:18:03.541504+0000","last_became_peered":"2024-01-19T05:18:03.541504+0000","last_unstale":"2024-01-19T05:18:04.729656+0000","last_undegraded":"2024-01-19T05:18:04.729656+0000","last_fullsized":"2024-01-19T05:18:04.729656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728750+0000","last_change":"2024-01-19T05:18:03.547095+0000","last_active":"2024-01-19T05:18:04.728750+0000","last_peered":"2024-01-19T05:18:04.728750+0000","last_clean":"2024-01-19T05:18:04.728750+0000","last_became_active":"2024-01-19T05:18:03.546466+0000","last_became_peered":"2024-01-19T05:18:03.546466+0000","last_unstale":"2024-01-19T05:18:04.728750+0000","last_undegraded":"2024-01-19T05:18:04.728750+0000","last_fullsized":"2024-01-19T05:18:04.728750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512907+0000","last_change":"2024-01-19T05:18:03.540449+0000","last_active":"2024-01-19T05:18:04.512907+0000","last_peered":"2024-01-19T05:18:04.512907+0000","last_clean":"2024-01-19T05:18:04.512907+0000","last_became_active":"2024-01-19T05:18:03.539616+0000","last_became_peered":"2024-01-19T05:18:03.539616+0000","last_unstale":"2024-01-19T05:18:04.512907+0000","last_undegraded":"2024-01-19T05:18:04.512907+0000","last_fullsized":"2024-01-19T05:18:04.512907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728960+0000","last_change":"2024-01-19T05:18:03.568406+0000","last_active":"2024-01-19T05:18:04.728960+0000","last_peered":"2024-01-19T05:18:04.728960+0000","last_clean":"2024-01-19T05:18:04.728960+0000","last_became_active":"2024-01-19T05:18:03.567759+0000","last_became_peered":"2024-01-19T05:18:03.567759+0000","last_unstale":"2024-01-19T05:18:04.728960+0000","last_undegraded":"2024-01-19T05:18:04.728960+0000","last_fullsized":"2024-01-19T05:18:04.728960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731803+0000","last_change":"2024-01-19T05:18:03.571085+0000","last_active":"2024-01-19T05:18:04.731803+0000","last_peered":"2024-01-19T05:18:04.731803+0000","last_clean":"2024-01-19T05:18:04.731803+0000","last_became_active":"2024-01-19T05:18:03.569878+0000","last_became_peered":"2024-01-19T05:18:03.569878+0000","last_unstale":"2024-01-19T05:18:04.731803+0000","last_undegraded":"2024-01-19T05:18:04.731803+0000","last_fullsized":"2024-01-19T05:18:04.731803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728098+0000","last_change":"2024-01-19T05:18:03.520269+0000","last_active":"2024-01-19T05:18:04.728098+0000","last_peered":"2024-01-19T05:18:04.728098+0000","last_clean":"2024-01-19T05:18:04.728098+0000","last_became_active":"2024-01-19T05:18:03.519676+0000","last_became_peered":"2024-01-19T05:18:03.519676+0000","last_unstale":"2024-01-19T05:18:04.728098+0000","last_undegraded":"2024-01-19T05:18:04.728098+0000","last_fullsized":"2024-01-19T05:18:04.728098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730254+0000","last_change":"2024-01-19T05:18:03.555567+0000","last_active":"2024-01-19T05:18:04.730254+0000","last_peered":"2024-01-19T05:18:04.730254+0000","last_clean":"2024-01-19T05:18:04.730254+0000","last_became_active":"2024-01-19T05:18:03.554832+0000","last_became_peered":"2024-01-19T05:18:03.554832+0000","last_unstale":"2024-01-19T05:18:04.730254+0000","last_undegraded":"2024-01-19T05:18:04.730254+0000","last_fullsized":"2024-01-19T05:18:04.730254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514744+0000","last_change":"2024-01-19T05:18:03.545771+0000","last_active":"2024-01-19T05:18:04.514744+0000","last_peered":"2024-01-19T05:18:04.514744+0000","last_clean":"2024-01-19T05:18:04.514744+0000","last_became_active":"2024-01-19T05:18:03.545003+0000","last_became_peered":"2024-01-19T05:18:03.545003+0000","last_unstale":"2024-01-19T05:18:04.514744+0000","last_undegraded":"2024-01-19T05:18:04.514744+0000","last_fullsized":"2024-01-19T05:18:04.514744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728346+0000","last_change":"2024-01-19T05:18:03.551774+0000","last_active":"2024-01-19T05:18:04.728346+0000","last_peered":"2024-01-19T05:18:04.728346+0000","last_clean":"2024-01-19T05:18:04.728346+0000","last_became_active":"2024-01-19T05:18:03.550788+0000","last_became_peered":"2024-01-19T05:18:03.550788+0000","last_unstale":"2024-01-19T05:18:04.728346+0000","last_undegraded":"2024-01-19T05:18:04.728346+0000","last_fullsized":"2024-01-19T05:18:04.728346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731558+0000","last_change":"2024-01-19T05:18:03.568310+0000","last_active":"2024-01-19T05:18:04.731558+0000","last_peered":"2024-01-19T05:18:04.731558+0000","last_clean":"2024-01-19T05:18:04.731558+0000","last_became_active":"2024-01-19T05:18:03.567678+0000","last_became_peered":"2024-01-19T05:18:03.567678+0000","last_unstale":"2024-01-19T05:18:04.731558+0000","last_undegraded":"2024-01-19T05:18:04.731558+0000","last_fullsized":"2024-01-19T05:18:04.731558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:41:38.526899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729157+0000","last_change":"2024-01-19T05:18:03.554839+0000","last_active":"2024-01-19T05:18:04.729157+0000","last_peered":"2024-01-19T05:18:04.729157+0000","last_clean":"2024-01-19T05:18:04.729157+0000","last_became_active":"2024-01-19T05:18:03.551361+0000","last_became_peered":"2024-01-19T05:18:03.551361+0000","last_unstale":"2024-01-19T05:18:04.729157+0000","last_undegraded":"2024-01-19T05:18:04.729157+0000","last_fullsized":"2024-01-19T05:18:04.729157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729155+0000","last_change":"2024-01-19T05:18:03.563289+0000","last_active":"2024-01-19T05:18:04.729155+0000","last_peered":"2024-01-19T05:18:04.729155+0000","last_clean":"2024-01-19T05:18:04.729155+0000","last_became_active":"2024-01-19T05:18:03.556561+0000","last_became_peered":"2024-01-19T05:18:03.556561+0000","last_unstale":"2024-01-19T05:18:04.729155+0000","last_undegraded":"2024-01-19T05:18:04.729155+0000","last_fullsized":"2024-01-19T05:18:04.729155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730025+0000","last_change":"2024-01-19T05:18:03.546978+0000","last_active":"2024-01-19T05:18:04.730025+0000","last_peered":"2024-01-19T05:18:04.730025+0000","last_clean":"2024-01-19T05:18:04.730025+0000","last_became_active":"2024-01-19T05:18:03.546276+0000","last_became_peered":"2024-01-19T05:18:03.546276+0000","last_unstale":"2024-01-19T05:18:04.730025+0000","last_undegraded":"2024-01-19T05:18:04.730025+0000","last_fullsized":"2024-01-19T05:18:04.730025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515447+0000","last_change":"2024-01-19T05:18:03.525138+0000","last_active":"2024-01-19T05:18:04.515447+0000","last_peered":"2024-01-19T05:18:04.515447+0000","last_clean":"2024-01-19T05:18:04.515447+0000","last_became_active":"2024-01-19T05:18:03.524523+0000","last_became_peered":"2024-01-19T05:18:03.524523+0000","last_unstale":"2024-01-19T05:18:04.515447+0000","last_undegraded":"2024-01-19T05:18:04.515447+0000","last_fullsized":"2024-01-19T05:18:04.515447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512997+0000","last_change":"2024-01-19T05:18:03.544359+0000","last_active":"2024-01-19T05:18:04.512997+0000","last_peered":"2024-01-19T05:18:04.512997+0000","last_clean":"2024-01-19T05:18:04.512997+0000","last_became_active":"2024-01-19T05:18:03.543559+0000","last_became_peered":"2024-01-19T05:18:03.543559+0000","last_unstale":"2024-01-19T05:18:04.512997+0000","last_undegraded":"2024-01-19T05:18:04.512997+0000","last_fullsized":"2024-01-19T05:18:04.512997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729855+0000","last_change":"2024-01-19T05:18:03.549033+0000","last_active":"2024-01-19T05:18:04.729855+0000","last_peered":"2024-01-19T05:18:04.729855+0000","last_clean":"2024-01-19T05:18:04.729855+0000","last_became_active":"2024-01-19T05:18:03.548292+0000","last_became_peered":"2024-01-19T05:18:03.548292+0000","last_unstale":"2024-01-19T05:18:04.729855+0000","last_undegraded":"2024-01-19T05:18:04.729855+0000","last_fullsized":"2024-01-19T05:18:04.729855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728511+0000","last_change":"2024-01-19T05:18:03.557894+0000","last_active":"2024-01-19T05:18:04.728511+0000","last_peered":"2024-01-19T05:18:04.728511+0000","last_clean":"2024-01-19T05:18:04.728511+0000","last_became_active":"2024-01-19T05:18:03.556934+0000","last_became_peered":"2024-01-19T05:18:03.556934+0000","last_unstale":"2024-01-19T05:18:04.728511+0000","last_undegraded":"2024-01-19T05:18:04.728511+0000","last_fullsized":"2024-01-19T05:18:04.728511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730933+0000","last_change":"2024-01-19T05:18:03.557384+0000","last_active":"2024-01-19T05:18:04.730933+0000","last_peered":"2024-01-19T05:18:04.730933+0000","last_clean":"2024-01-19T05:18:04.730933+0000","last_became_active":"2024-01-19T05:18:03.555960+0000","last_became_peered":"2024-01-19T05:18:03.555960+0000","last_unstale":"2024-01-19T05:18:04.730933+0000","last_undegraded":"2024-01-19T05:18:04.730933+0000","last_fullsized":"2024-01-19T05:18:04.730933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:02.353958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727845+0000","last_change":"2024-01-19T05:18:03.560129+0000","last_active":"2024-01-19T05:18:04.727845+0000","last_peered":"2024-01-19T05:18:04.727845+0000","last_clean":"2024-01-19T05:18:04.727845+0000","last_became_active":"2024-01-19T05:18:03.559502+0000","last_became_peered":"2024-01-19T05:18:03.559502+0000","last_unstale":"2024-01-19T05:18:04.727845+0000","last_undegraded":"2024-01-19T05:18:04.727845+0000","last_fullsized":"2024-01-19T05:18:04.727845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:30.418992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513499+0000","last_change":"2024-01-19T05:18:03.537557+0000","last_active":"2024-01-19T05:18:04.513499+0000","last_peered":"2024-01-19T05:18:04.513499+0000","last_clean":"2024-01-19T05:18:04.513499+0000","last_became_active":"2024-01-19T05:18:03.536744+0000","last_became_peered":"2024-01-19T05:18:03.536744+0000","last_unstale":"2024-01-19T05:18:04.513499+0000","last_undegraded":"2024-01-19T05:18:04.513499+0000","last_fullsized":"2024-01-19T05:18:04.513499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:46:21.033519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514550+0000","last_change":"2024-01-19T05:18:03.537254+0000","last_active":"2024-01-19T05:18:04.514550+0000","last_peered":"2024-01-19T05:18:04.514550+0000","last_clean":"2024-01-19T05:18:04.514550+0000","last_became_active":"2024-01-19T05:18:03.536484+0000","last_became_peered":"2024-01-19T05:18:03.536484+0000","last_unstale":"2024-01-19T05:18:04.514550+0000","last_undegraded":"2024-01-19T05:18:04.514550+0000","last_fullsized":"2024-01-19T05:18:04.514550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:40.310261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729759+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.729759+0000","last_peered":"2024-01-19T05:18:04.729759+0000","last_clean":"2024-01-19T05:18:04.729759+0000","last_became_active":"2024-01-19T05:18:02.664263+0000","last_became_peered":"2024-01-19T05:18:02.664263+0000","last_unstale":"2024-01-19T05:18:04.729759+0000","last_undegraded":"2024-01-19T05:18:04.729759+0000","last_fullsized":"2024-01-19T05:18:04.729759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728651+0000","last_change":"2024-01-19T05:18:03.544005+0000","last_active":"2024-01-19T05:18:04.728651+0000","last_peered":"2024-01-19T05:18:04.728651+0000","last_clean":"2024-01-19T05:18:04.728651+0000","last_became_active":"2024-01-19T05:18:03.543213+0000","last_became_peered":"2024-01-19T05:18:03.543213+0000","last_unstale":"2024-01-19T05:18:04.728651+0000","last_undegraded":"2024-01-19T05:18:04.728651+0000","last_fullsized":"2024-01-19T05:18:04.728651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515401+0000","last_change":"2024-01-19T05:18:02.657382+0000","last_active":"2024-01-19T05:18:04.515401+0000","last_peered":"2024-01-19T05:18:04.515401+0000","last_clean":"2024-01-19T05:18:04.515401+0000","last_became_active":"2024-01-19T05:18:02.656806+0000","last_became_peered":"2024-01-19T05:18:02.656806+0000","last_unstale":"2024-01-19T05:18:04.515401+0000","last_undegraded":"2024-01-19T05:18:04.515401+0000","last_fullsized":"2024-01-19T05:18:04.515401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729079+0000","last_change":"2024-01-19T05:18:02.653215+0000","last_active":"2024-01-19T05:18:04.729079+0000","last_peered":"2024-01-19T05:18:04.729079+0000","last_clean":"2024-01-19T05:18:04.729079+0000","last_became_active":"2024-01-19T05:18:02.652938+0000","last_became_peered":"2024-01-19T05:18:02.652938+0000","last_unstale":"2024-01-19T05:18:04.729079+0000","last_undegraded":"2024-01-19T05:18:04.729079+0000","last_fullsized":"2024-01-19T05:18:04.729079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729005+0000","last_change":"2024-01-19T05:18:03.541881+0000","last_active":"2024-01-19T05:18:04.729005+0000","last_peered":"2024-01-19T05:18:04.729005+0000","last_clean":"2024-01-19T05:18:04.729005+0000","last_became_active":"2024-01-19T05:18:03.541176+0000","last_became_peered":"2024-01-19T05:18:03.541176+0000","last_unstale":"2024-01-19T05:18:04.729005+0000","last_undegraded":"2024-01-19T05:18:04.729005+0000","last_fullsized":"2024-01-19T05:18:04.729005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730990+0000","last_change":"2024-01-19T05:18:02.657034+0000","last_active":"2024-01-19T05:18:04.730990+0000","last_peered":"2024-01-19T05:18:04.730990+0000","last_clean":"2024-01-19T05:18:04.730990+0000","last_became_active":"2024-01-19T05:18:02.656500+0000","last_became_peered":"2024-01-19T05:18:02.656500+0000","last_unstale":"2024-01-19T05:18:04.730990+0000","last_undegraded":"2024-01-19T05:18:04.730990+0000","last_fullsized":"2024-01-19T05:18:04.730990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512764+0000","last_change":"2024-01-19T05:18:03.544242+0000","last_active":"2024-01-19T05:18:04.512764+0000","last_peered":"2024-01-19T05:18:04.512764+0000","last_clean":"2024-01-19T05:18:04.512764+0000","last_became_active":"2024-01-19T05:18:03.543438+0000","last_became_peered":"2024-01-19T05:18:03.543438+0000","last_unstale":"2024-01-19T05:18:04.512764+0000","last_undegraded":"2024-01-19T05:18:04.512764+0000","last_fullsized":"2024-01-19T05:18:04.512764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515016+0000","last_change":"2024-01-19T05:18:02.653594+0000","last_active":"2024-01-19T05:18:04.515016+0000","last_peered":"2024-01-19T05:18:04.515016+0000","last_clean":"2024-01-19T05:18:04.515016+0000","last_became_active":"2024-01-19T05:18:02.653182+0000","last_became_peered":"2024-01-19T05:18:02.653182+0000","last_unstale":"2024-01-19T05:18:04.515016+0000","last_undegraded":"2024-01-19T05:18:04.515016+0000","last_fullsized":"2024-01-19T05:18:04.515016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730837+0000","last_change":"2024-01-19T05:18:03.562845+0000","last_active":"2024-01-19T05:18:04.730837+0000","last_peered":"2024-01-19T05:18:04.730837+0000","last_clean":"2024-01-19T05:18:04.730837+0000","last_became_active":"2024-01-19T05:18:03.562235+0000","last_became_peered":"2024-01-19T05:18:03.562235+0000","last_unstale":"2024-01-19T05:18:04.730837+0000","last_undegraded":"2024-01-19T05:18:04.730837+0000","last_fullsized":"2024-01-19T05:18:04.730837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731055+0000","last_change":"2024-01-19T05:18:02.660025+0000","last_active":"2024-01-19T05:18:04.731055+0000","last_peered":"2024-01-19T05:18:04.731055+0000","last_clean":"2024-01-19T05:18:04.731055+0000","last_became_active":"2024-01-19T05:18:02.659546+0000","last_became_peered":"2024-01-19T05:18:02.659546+0000","last_unstale":"2024-01-19T05:18:04.731055+0000","last_undegraded":"2024-01-19T05:18:04.731055+0000","last_fullsized":"2024-01-19T05:18:04.731055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:56.624468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728512+0000","last_change":"2024-01-19T05:18:03.568936+0000","last_active":"2024-01-19T05:18:04.728512+0000","last_peered":"2024-01-19T05:18:04.728512+0000","last_clean":"2024-01-19T05:18:04.728512+0000","last_became_active":"2024-01-19T05:18:03.568337+0000","last_became_peered":"2024-01-19T05:18:03.568337+0000","last_unstale":"2024-01-19T05:18:04.728512+0000","last_undegraded":"2024-01-19T05:18:04.728512+0000","last_fullsized":"2024-01-19T05:18:04.728512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:38:56.541591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513376+0000","last_change":"2024-01-19T05:18:02.661567+0000","last_active":"2024-01-19T05:18:04.513376+0000","last_peered":"2024-01-19T05:18:04.513376+0000","last_clean":"2024-01-19T05:18:04.513376+0000","last_became_active":"2024-01-19T05:18:02.660906+0000","last_became_peered":"2024-01-19T05:18:02.660906+0000","last_unstale":"2024-01-19T05:18:04.513376+0000","last_undegraded":"2024-01-19T05:18:04.513376+0000","last_fullsized":"2024-01-19T05:18:04.513376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516234+0000","last_change":"2024-01-19T05:18:03.548080+0000","last_active":"2024-01-19T05:18:04.516234+0000","last_peered":"2024-01-19T05:18:04.516234+0000","last_clean":"2024-01-19T05:18:04.516234+0000","last_became_active":"2024-01-19T05:18:03.547506+0000","last_became_peered":"2024-01-19T05:18:03.547506+0000","last_unstale":"2024-01-19T05:18:04.516234+0000","last_undegraded":"2024-01-19T05:18:04.516234+0000","last_fullsized":"2024-01-19T05:18:04.516234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:42.086840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514989+0000","last_change":"2024-01-19T05:18:02.660672+0000","last_active":"2024-01-19T05:18:04.514989+0000","last_peered":"2024-01-19T05:18:04.514989+0000","last_clean":"2024-01-19T05:18:04.514989+0000","last_became_active":"2024-01-19T05:18:02.659596+0000","last_became_peered":"2024-01-19T05:18:02.659596+0000","last_unstale":"2024-01-19T05:18:04.514989+0000","last_undegraded":"2024-01-19T05:18:04.514989+0000","last_fullsized":"2024-01-19T05:18:04.514989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729720+0000","last_change":"2024-01-19T05:18:03.550622+0000","last_active":"2024-01-19T05:18:04.729720+0000","last_peered":"2024-01-19T05:18:04.729720+0000","last_clean":"2024-01-19T05:18:04.729720+0000","last_became_active":"2024-01-19T05:18:03.548243+0000","last_became_peered":"2024-01-19T05:18:03.548243+0000","last_unstale":"2024-01-19T05:18:04.729720+0000","last_undegraded":"2024-01-19T05:18:04.729720+0000","last_fullsized":"2024-01-19T05:18:04.729720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728733+0000","last_change":"2024-01-19T05:18:02.653694+0000","last_active":"2024-01-19T05:18:04.728733+0000","last_peered":"2024-01-19T05:18:04.728733+0000","last_clean":"2024-01-19T05:18:04.728733+0000","last_became_active":"2024-01-19T05:18:02.653236+0000","last_became_peered":"2024-01-19T05:18:02.653236+0000","last_unstale":"2024-01-19T05:18:04.728733+0000","last_undegraded":"2024-01-19T05:18:04.728733+0000","last_fullsized":"2024-01-19T05:18:04.728733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728870+0000","last_change":"2024-01-19T05:18:03.541272+0000","last_active":"2024-01-19T05:18:04.728870+0000","last_peered":"2024-01-19T05:18:04.728870+0000","last_clean":"2024-01-19T05:18:04.728870+0000","last_became_active":"2024-01-19T05:18:03.540187+0000","last_became_peered":"2024-01-19T05:18:03.540187+0000","last_unstale":"2024-01-19T05:18:04.728870+0000","last_undegraded":"2024-01-19T05:18:04.728870+0000","last_fullsized":"2024-01-19T05:18:04.728870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731175+0000","last_change":"2024-01-19T05:18:02.662629+0000","last_active":"2024-01-19T05:18:04.731175+0000","last_peered":"2024-01-19T05:18:04.731175+0000","last_clean":"2024-01-19T05:18:04.731175+0000","last_became_active":"2024-01-19T05:18:02.662095+0000","last_became_peered":"2024-01-19T05:18:02.662095+0000","last_unstale":"2024-01-19T05:18:04.731175+0000","last_undegraded":"2024-01-19T05:18:04.731175+0000","last_fullsized":"2024-01-19T05:18:04.731175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:43:03.589258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729878+0000","last_change":"2024-01-19T05:18:03.543853+0000","last_active":"2024-01-19T05:18:04.729878+0000","last_peered":"2024-01-19T05:18:04.729878+0000","last_clean":"2024-01-19T05:18:04.729878+0000","last_became_active":"2024-01-19T05:18:03.543119+0000","last_became_peered":"2024-01-19T05:18:03.543119+0000","last_unstale":"2024-01-19T05:18:04.729878+0000","last_undegraded":"2024-01-19T05:18:04.729878+0000","last_fullsized":"2024-01-19T05:18:04.729878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513670+0000","last_change":"2024-01-19T05:18:02.657695+0000","last_active":"2024-01-19T05:18:04.513670+0000","last_peered":"2024-01-19T05:18:04.513670+0000","last_clean":"2024-01-19T05:18:04.513670+0000","last_became_active":"2024-01-19T05:18:02.656870+0000","last_became_peered":"2024-01-19T05:18:02.656870+0000","last_unstale":"2024-01-19T05:18:04.513670+0000","last_undegraded":"2024-01-19T05:18:04.513670+0000","last_fullsized":"2024-01-19T05:18:04.513670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513835+0000","last_change":"2024-01-19T05:18:03.534680+0000","last_active":"2024-01-19T05:18:04.513835+0000","last_peered":"2024-01-19T05:18:04.513835+0000","last_clean":"2024-01-19T05:18:04.513835+0000","last_became_active":"2024-01-19T05:18:03.533937+0000","last_became_peered":"2024-01-19T05:18:03.533937+0000","last_unstale":"2024-01-19T05:18:04.513835+0000","last_undegraded":"2024-01-19T05:18:04.513835+0000","last_fullsized":"2024-01-19T05:18:04.513835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727901+0000","last_change":"2024-01-19T05:18:02.650559+0000","last_active":"2024-01-19T05:18:04.727901+0000","last_peered":"2024-01-19T05:18:04.727901+0000","last_clean":"2024-01-19T05:18:04.727901+0000","last_became_active":"2024-01-19T05:18:02.649764+0000","last_became_peered":"2024-01-19T05:18:02.649764+0000","last_unstale":"2024-01-19T05:18:04.727901+0000","last_undegraded":"2024-01-19T05:18:04.727901+0000","last_fullsized":"2024-01-19T05:18:04.727901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:39:17.423681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729375+0000","last_change":"2024-01-19T05:18:03.550709+0000","last_active":"2024-01-19T05:18:04.729375+0000","last_peered":"2024-01-19T05:18:04.729375+0000","last_clean":"2024-01-19T05:18:04.729375+0000","last_became_active":"2024-01-19T05:18:03.550073+0000","last_became_peered":"2024-01-19T05:18:03.550073+0000","last_unstale":"2024-01-19T05:18:04.729375+0000","last_undegraded":"2024-01-19T05:18:04.729375+0000","last_fullsized":"2024-01-19T05:18:04.729375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:15:01.043573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.516191+0000","last_change":"2024-01-19T05:18:02.655120+0000","last_active":"2024-01-19T05:18:04.516191+0000","last_peered":"2024-01-19T05:18:04.516191+0000","last_clean":"2024-01-19T05:18:04.516191+0000","last_became_active":"2024-01-19T05:18:02.654360+0000","last_became_peered":"2024-01-19T05:18:02.654360+0000","last_unstale":"2024-01-19T05:18:04.516191+0000","last_undegraded":"2024-01-19T05:18:04.516191+0000","last_fullsized":"2024-01-19T05:18:04.516191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:32:02.214385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730500+0000","last_change":"2024-01-19T05:18:03.543739+0000","last_active":"2024-01-19T05:18:04.730500+0000","last_peered":"2024-01-19T05:18:04.730500+0000","last_clean":"2024-01-19T05:18:04.730500+0000","last_became_active":"2024-01-19T05:18:03.543142+0000","last_became_peered":"2024-01-19T05:18:03.543142+0000","last_unstale":"2024-01-19T05:18:04.730500+0000","last_undegraded":"2024-01-19T05:18:04.730500+0000","last_fullsized":"2024-01-19T05:18:04.730500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:05:25.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728061+0000","last_change":"2024-01-19T05:18:02.662915+0000","last_active":"2024-01-19T05:18:04.728061+0000","last_peered":"2024-01-19T05:18:04.728061+0000","last_clean":"2024-01-19T05:18:04.728061+0000","last_became_active":"2024-01-19T05:18:02.662617+0000","last_became_peered":"2024-01-19T05:18:02.662617+0000","last_unstale":"2024-01-19T05:18:04.728061+0000","last_undegraded":"2024-01-19T05:18:04.728061+0000","last_fullsized":"2024-01-19T05:18:04.728061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729905+0000","last_change":"2024-01-19T05:18:03.543521+0000","last_active":"2024-01-19T05:18:04.729905+0000","last_peered":"2024-01-19T05:18:04.729905+0000","last_clean":"2024-01-19T05:18:04.729905+0000","last_became_active":"2024-01-19T05:18:03.542803+0000","last_became_peered":"2024-01-19T05:18:03.542803+0000","last_unstale":"2024-01-19T05:18:04.729905+0000","last_undegraded":"2024-01-19T05:18:04.729905+0000","last_fullsized":"2024-01-19T05:18:04.729905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513101+0000","last_change":"2024-01-19T05:18:02.650642+0000","last_active":"2024-01-19T05:18:04.513101+0000","last_peered":"2024-01-19T05:18:04.513101+0000","last_clean":"2024-01-19T05:18:04.513101+0000","last_became_active":"2024-01-19T05:18:02.650319+0000","last_became_peered":"2024-01-19T05:18:02.650319+0000","last_unstale":"2024-01-19T05:18:04.513101+0000","last_undegraded":"2024-01-19T05:18:04.513101+0000","last_fullsized":"2024-01-19T05:18:04.513101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.565837+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.564725+0000","last_became_peered":"2024-01-19T05:18:03.564725+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727937+0000","last_change":"2024-01-19T05:18:02.656957+0000","last_active":"2024-01-19T05:18:04.727937+0000","last_peered":"2024-01-19T05:18:04.727937+0000","last_clean":"2024-01-19T05:18:04.727937+0000","last_became_active":"2024-01-19T05:18:02.656536+0000","last_became_peered":"2024-01-19T05:18:02.656536+0000","last_unstale":"2024-01-19T05:18:04.727937+0000","last_undegraded":"2024-01-19T05:18:04.727937+0000","last_fullsized":"2024-01-19T05:18:04.727937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:49:33.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729922+0000","last_change":"2024-01-19T05:18:03.571256+0000","last_active":"2024-01-19T05:18:04.729922+0000","last_peered":"2024-01-19T05:18:04.729922+0000","last_clean":"2024-01-19T05:18:04.729922+0000","last_became_active":"2024-01-19T05:18:03.570499+0000","last_became_peered":"2024-01-19T05:18:03.570499+0000","last_unstale":"2024-01-19T05:18:04.729922+0000","last_undegraded":"2024-01-19T05:18:04.729922+0000","last_fullsized":"2024-01-19T05:18:04.729922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:57:16.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-19T05:18:03.520367+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:03.520367+0000","last_peered":"2024-01-19T05:18:03.520367+0000","last_clean":"2024-01-19T05:18:03.520367+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:03.520367+0000","last_undegraded":"2024-01-19T05:18:03.520367+0000","last_fullsized":"2024-01-19T05:18:03.520367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730433+0000","last_change":"2024-01-19T05:18:02.650789+0000","last_active":"2024-01-19T05:18:04.730433+0000","last_peered":"2024-01-19T05:18:04.730433+0000","last_clean":"2024-01-19T05:18:04.730433+0000","last_became_active":"2024-01-19T05:18:02.649923+0000","last_became_peered":"2024-01-19T05:18:02.649923+0000","last_unstale":"2024-01-19T05:18:04.730433+0000","last_undegraded":"2024-01-19T05:18:04.730433+0000","last_fullsized":"2024-01-19T05:18:04.730433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:14:12.078445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729614+0000","last_change":"2024-01-19T05:18:03.569109+0000","last_active":"2024-01-19T05:18:04.729614+0000","last_peered":"2024-01-19T05:18:04.729614+0000","last_clean":"2024-01-19T05:18:04.729614+0000","last_became_active":"2024-01-19T05:18:03.568602+0000","last_became_peered":"2024-01-19T05:18:03.568602+0000","last_unstale":"2024-01-19T05:18:04.729614+0000","last_undegraded":"2024-01-19T05:18:04.729614+0000","last_fullsized":"2024-01-19T05:18:04.729614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729626+0000","last_change":"2024-01-19T05:18:02.671990+0000","last_active":"2024-01-19T05:18:04.729626+0000","last_peered":"2024-01-19T05:18:04.729626+0000","last_clean":"2024-01-19T05:18:04.729626+0000","last_became_active":"2024-01-19T05:18:02.671477+0000","last_became_peered":"2024-01-19T05:18:02.671477+0000","last_unstale":"2024-01-19T05:18:04.729626+0000","last_undegraded":"2024-01-19T05:18:04.729626+0000","last_fullsized":"2024-01-19T05:18:04.729626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728522+0000","last_change":"2024-01-19T05:18:03.551760+0000","last_active":"2024-01-19T05:18:04.728522+0000","last_peered":"2024-01-19T05:18:04.728522+0000","last_clean":"2024-01-19T05:18:04.728522+0000","last_became_active":"2024-01-19T05:18:03.550881+0000","last_became_peered":"2024-01-19T05:18:03.550881+0000","last_unstale":"2024-01-19T05:18:04.728522+0000","last_undegraded":"2024-01-19T05:18:04.728522+0000","last_fullsized":"2024-01-19T05:18:04.728522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:07:36.395197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.727890+0000","last_change":"2024-01-19T05:18:02.663101+0000","last_active":"2024-01-19T05:18:04.727890+0000","last_peered":"2024-01-19T05:18:04.727890+0000","last_clean":"2024-01-19T05:18:04.727890+0000","last_became_active":"2024-01-19T05:18:02.662604+0000","last_became_peered":"2024-01-19T05:18:02.662604+0000","last_unstale":"2024-01-19T05:18:04.727890+0000","last_undegraded":"2024-01-19T05:18:04.727890+0000","last_fullsized":"2024-01-19T05:18:04.727890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512852+0000","last_change":"2024-01-19T05:18:03.537638+0000","last_active":"2024-01-19T05:18:04.512852+0000","last_peered":"2024-01-19T05:18:04.512852+0000","last_clean":"2024-01-19T05:18:04.512852+0000","last_became_active":"2024-01-19T05:18:03.536862+0000","last_became_peered":"2024-01-19T05:18:03.536862+0000","last_unstale":"2024-01-19T05:18:04.512852+0000","last_undegraded":"2024-01-19T05:18:04.512852+0000","last_fullsized":"2024-01-19T05:18:04.512852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731398+0000","last_change":"2024-01-19T05:18:02.655462+0000","last_active":"2024-01-19T05:18:04.731398+0000","last_peered":"2024-01-19T05:18:04.731398+0000","last_clean":"2024-01-19T05:18:04.731398+0000","last_became_active":"2024-01-19T05:18:02.654363+0000","last_became_peered":"2024-01-19T05:18:02.654363+0000","last_unstale":"2024-01-19T05:18:04.731398+0000","last_undegraded":"2024-01-19T05:18:04.731398+0000","last_fullsized":"2024-01-19T05:18:04.731398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:40.854099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515031+0000","last_change":"2024-01-19T05:18:03.540906+0000","last_active":"2024-01-19T05:18:04.515031+0000","last_peered":"2024-01-19T05:18:04.515031+0000","last_clean":"2024-01-19T05:18:04.515031+0000","last_became_active":"2024-01-19T05:18:03.540116+0000","last_became_peered":"2024-01-19T05:18:03.540116+0000","last_unstale":"2024-01-19T05:18:04.515031+0000","last_undegraded":"2024-01-19T05:18:04.515031+0000","last_fullsized":"2024-01-19T05:18:04.515031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:37.646122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512849+0000","last_change":"2024-01-19T05:18:02.657808+0000","last_active":"2024-01-19T05:18:04.512849+0000","last_peered":"2024-01-19T05:18:04.512849+0000","last_clean":"2024-01-19T05:18:04.512849+0000","last_became_active":"2024-01-19T05:18:02.657357+0000","last_became_peered":"2024-01-19T05:18:02.657357+0000","last_unstale":"2024-01-19T05:18:04.512849+0000","last_undegraded":"2024-01-19T05:18:04.512849+0000","last_fullsized":"2024-01-19T05:18:04.512849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731379+0000","last_change":"2024-01-19T05:18:03.566199+0000","last_active":"2024-01-19T05:18:04.731379+0000","last_peered":"2024-01-19T05:18:04.731379+0000","last_clean":"2024-01-19T05:18:04.731379+0000","last_became_active":"2024-01-19T05:18:03.565571+0000","last_became_peered":"2024-01-19T05:18:03.565571+0000","last_unstale":"2024-01-19T05:18:04.731379+0000","last_undegraded":"2024-01-19T05:18:04.731379+0000","last_fullsized":"2024-01-19T05:18:04.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:50:35.742468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730213+0000","last_change":"2024-01-19T05:18:02.674805+0000","last_active":"2024-01-19T05:18:04.730213+0000","last_peered":"2024-01-19T05:18:04.730213+0000","last_clean":"2024-01-19T05:18:04.730213+0000","last_became_active":"2024-01-19T05:18:02.674331+0000","last_became_peered":"2024-01-19T05:18:02.674331+0000","last_unstale":"2024-01-19T05:18:04.730213+0000","last_undegraded":"2024-01-19T05:18:04.730213+0000","last_fullsized":"2024-01-19T05:18:04.730213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:41.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513263+0000","last_change":"2024-01-19T05:18:03.535625+0000","last_active":"2024-01-19T05:18:04.513263+0000","last_peered":"2024-01-19T05:18:04.513263+0000","last_clean":"2024-01-19T05:18:04.513263+0000","last_became_active":"2024-01-19T05:18:03.534935+0000","last_became_peered":"2024-01-19T05:18:03.534935+0000","last_unstale":"2024-01-19T05:18:04.513263+0000","last_undegraded":"2024-01-19T05:18:04.513263+0000","last_fullsized":"2024-01-19T05:18:04.513263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:30:02.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:05.378485+0000","last_change":"2024-01-19T05:18:02.660485+0000","last_active":"2024-01-19T05:18:05.378485+0000","last_peered":"2024-01-19T05:18:05.378485+0000","last_clean":"2024-01-19T05:18:05.378485+0000","last_became_active":"2024-01-19T05:18:02.660172+0000","last_became_peered":"2024-01-19T05:18:02.660172+0000","last_unstale":"2024-01-19T05:18:05.378485+0000","last_undegraded":"2024-01-19T05:18:05.378485+0000","last_fullsized":"2024-01-19T05:18:05.378485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730089+0000","last_change":"2024-01-19T05:18:03.549395+0000","last_active":"2024-01-19T05:18:04.730089+0000","last_peered":"2024-01-19T05:18:04.730089+0000","last_clean":"2024-01-19T05:18:04.730089+0000","last_became_active":"2024-01-19T05:18:03.548645+0000","last_became_peered":"2024-01-19T05:18:03.548645+0000","last_unstale":"2024-01-19T05:18:04.730089+0000","last_undegraded":"2024-01-19T05:18:04.730089+0000","last_fullsized":"2024-01-19T05:18:04.730089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:29:45.847483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.515120+0000","last_change":"2024-01-19T05:18:02.665544+0000","last_active":"2024-01-19T05:18:04.515120+0000","last_peered":"2024-01-19T05:18:04.515120+0000","last_clean":"2024-01-19T05:18:04.515120+0000","last_became_active":"2024-01-19T05:18:02.665011+0000","last_became_peered":"2024-01-19T05:18:02.665011+0000","last_unstale":"2024-01-19T05:18:04.515120+0000","last_undegraded":"2024-01-19T05:18:04.515120+0000","last_fullsized":"2024-01-19T05:18:04.515120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728406+0000","last_change":"2024-01-19T05:18:03.546972+0000","last_active":"2024-01-19T05:18:04.728406+0000","last_peered":"2024-01-19T05:18:04.728406+0000","last_clean":"2024-01-19T05:18:04.728406+0000","last_became_active":"2024-01-19T05:18:03.546258+0000","last_became_peered":"2024-01-19T05:18:03.546258+0000","last_unstale":"2024-01-19T05:18:04.728406+0000","last_undegraded":"2024-01-19T05:18:04.728406+0000","last_fullsized":"2024-01-19T05:18:04.728406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728783+0000","last_change":"2024-01-19T05:18:02.668468+0000","last_active":"2024-01-19T05:18:04.728783+0000","last_peered":"2024-01-19T05:18:04.728783+0000","last_clean":"2024-01-19T05:18:04.728783+0000","last_became_active":"2024-01-19T05:18:02.668005+0000","last_became_peered":"2024-01-19T05:18:02.668005+0000","last_unstale":"2024-01-19T05:18:04.728783+0000","last_undegraded":"2024-01-19T05:18:04.728783+0000","last_fullsized":"2024-01-19T05:18:04.728783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:07:43.510278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.514090+0000","last_change":"2024-01-19T05:18:03.545257+0000","last_active":"2024-01-19T05:18:04.514090+0000","last_peered":"2024-01-19T05:18:04.514090+0000","last_clean":"2024-01-19T05:18:04.514090+0000","last_became_active":"2024-01-19T05:18:03.542709+0000","last_became_peered":"2024-01-19T05:18:03.542709+0000","last_unstale":"2024-01-19T05:18:04.514090+0000","last_undegraded":"2024-01-19T05:18:04.514090+0000","last_fullsized":"2024-01-19T05:18:04.514090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:31.698937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.512995+0000","last_change":"2024-01-19T05:18:02.664537+0000","last_active":"2024-01-19T05:18:04.512995+0000","last_peered":"2024-01-19T05:18:04.512995+0000","last_clean":"2024-01-19T05:18:04.512995+0000","last_became_active":"2024-01-19T05:18:02.664286+0000","last_became_peered":"2024-01-19T05:18:02.664286+0000","last_unstale":"2024-01-19T05:18:04.512995+0000","last_undegraded":"2024-01-19T05:18:04.512995+0000","last_fullsized":"2024-01-19T05:18:04.512995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729156+0000","last_change":"2024-01-19T05:18:03.554862+0000","last_active":"2024-01-19T05:18:04.729156+0000","last_peered":"2024-01-19T05:18:04.729156+0000","last_clean":"2024-01-19T05:18:04.729156+0000","last_became_active":"2024-01-19T05:18:03.550546+0000","last_became_peered":"2024-01-19T05:18:03.550546+0000","last_unstale":"2024-01-19T05:18:04.729156+0000","last_undegraded":"2024-01-19T05:18:04.729156+0000","last_fullsized":"2024-01-19T05:18:04.729156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:53:08.858824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513140+0000","last_change":"2024-01-19T05:18:02.663145+0000","last_active":"2024-01-19T05:18:04.513140+0000","last_peered":"2024-01-19T05:18:04.513140+0000","last_clean":"2024-01-19T05:18:04.513140+0000","last_became_active":"2024-01-19T05:18:02.662788+0000","last_became_peered":"2024-01-19T05:18:02.662788+0000","last_unstale":"2024-01-19T05:18:04.513140+0000","last_undegraded":"2024-01-19T05:18:04.513140+0000","last_fullsized":"2024-01-19T05:18:04.513140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:07:30.690278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729679+0000","last_change":"2024-01-19T05:18:03.551324+0000","last_active":"2024-01-19T05:18:04.729679+0000","last_peered":"2024-01-19T05:18:04.729679+0000","last_clean":"2024-01-19T05:18:04.729679+0000","last_became_active":"2024-01-19T05:18:03.549215+0000","last_became_peered":"2024-01-19T05:18:03.549215+0000","last_unstale":"2024-01-19T05:18:04.729679+0000","last_undegraded":"2024-01-19T05:18:04.729679+0000","last_fullsized":"2024-01-19T05:18:04.729679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:33:37.145476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.730060+0000","last_change":"2024-01-19T05:18:02.670360+0000","last_active":"2024-01-19T05:18:04.730060+0000","last_peered":"2024-01-19T05:18:04.730060+0000","last_clean":"2024-01-19T05:18:04.730060+0000","last_became_active":"2024-01-19T05:18:02.669751+0000","last_became_peered":"2024-01-19T05:18:02.669751+0000","last_unstale":"2024-01-19T05:18:04.730060+0000","last_undegraded":"2024-01-19T05:18:04.730060+0000","last_fullsized":"2024-01-19T05:18:04.730060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:40:39.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.513640+0000","last_change":"2024-01-19T05:18:03.531197+0000","last_active":"2024-01-19T05:18:04.513640+0000","last_peered":"2024-01-19T05:18:04.513640+0000","last_clean":"2024-01-19T05:18:04.513640+0000","last_became_active":"2024-01-19T05:18:03.530484+0000","last_became_peered":"2024-01-19T05:18:03.530484+0000","last_unstale":"2024-01-19T05:18:04.513640+0000","last_undegraded":"2024-01-19T05:18:04.513640+0000","last_fullsized":"2024-01-19T05:18:04.513640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:57.633127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731287+0000","last_change":"2024-01-19T05:18:03.562891+0000","last_active":"2024-01-19T05:18:04.731287+0000","last_peered":"2024-01-19T05:18:04.731287+0000","last_clean":"2024-01-19T05:18:04.731287+0000","last_became_active":"2024-01-19T05:18:03.558374+0000","last_became_peered":"2024-01-19T05:18:03.558374+0000","last_unstale":"2024-01-19T05:18:04.731287+0000","last_undegraded":"2024-01-19T05:18:04.731287+0000","last_fullsized":"2024-01-19T05:18:04.731287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:27:37.928139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729394+0000","last_change":"2024-01-19T05:18:02.672001+0000","last_active":"2024-01-19T05:18:04.729394+0000","last_peered":"2024-01-19T05:18:04.729394+0000","last_clean":"2024-01-19T05:18:04.729394+0000","last_became_active":"2024-01-19T05:18:02.671437+0000","last_became_peered":"2024-01-19T05:18:02.671437+0000","last_unstale":"2024-01-19T05:18:04.729394+0000","last_undegraded":"2024-01-19T05:18:04.729394+0000","last_fullsized":"2024-01-19T05:18:04.729394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:07:36.637463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.731196+0000","last_change":"2024-01-19T05:18:03.565321+0000","last_active":"2024-01-19T05:18:04.731196+0000","last_peered":"2024-01-19T05:18:04.731196+0000","last_clean":"2024-01-19T05:18:04.731196+0000","last_became_active":"2024-01-19T05:18:03.563207+0000","last_became_peered":"2024-01-19T05:18:03.563207+0000","last_unstale":"2024-01-19T05:18:04.731196+0000","last_undegraded":"2024-01-19T05:18:04.731196+0000","last_fullsized":"2024-01-19T05:18:04.731196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:39:36.137331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729996+0000","last_change":"2024-01-19T05:18:02.673614+0000","last_active":"2024-01-19T05:18:04.729996+0000","last_peered":"2024-01-19T05:18:04.729996+0000","last_clean":"2024-01-19T05:18:04.729996+0000","last_became_active":"2024-01-19T05:18:02.673106+0000","last_became_peered":"2024-01-19T05:18:02.673106+0000","last_unstale":"2024-01-19T05:18:04.729996+0000","last_undegraded":"2024-01-19T05:18:04.729996+0000","last_fullsized":"2024-01-19T05:18:04.729996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T08:00:29.410333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728334+0000","last_change":"2024-01-19T05:18:03.570972+0000","last_active":"2024-01-19T05:18:04.728334+0000","last_peered":"2024-01-19T05:18:04.728334+0000","last_clean":"2024-01-19T05:18:04.728334+0000","last_became_active":"2024-01-19T05:18:03.570555+0000","last_became_peered":"2024-01-19T05:18:03.570555+0000","last_unstale":"2024-01-19T05:18:04.728334+0000","last_undegraded":"2024-01-19T05:18:04.728334+0000","last_fullsized":"2024-01-19T05:18:04.728334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:39:41.862758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729948+0000","last_change":"2024-01-19T05:18:02.661127+0000","last_active":"2024-01-19T05:18:04.729948+0000","last_peered":"2024-01-19T05:18:04.729948+0000","last_clean":"2024-01-19T05:18:04.729948+0000","last_became_active":"2024-01-19T05:18:02.660171+0000","last_became_peered":"2024-01-19T05:18:02.660171+0000","last_unstale":"2024-01-19T05:18:04.729948+0000","last_undegraded":"2024-01-19T05:18:04.729948+0000","last_fullsized":"2024-01-19T05:18:04.729948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.729899+0000","last_change":"2024-01-19T05:18:03.546643+0000","last_active":"2024-01-19T05:18:04.729899+0000","last_peered":"2024-01-19T05:18:04.729899+0000","last_clean":"2024-01-19T05:18:04.729899+0000","last_became_active":"2024-01-19T05:18:03.545889+0000","last_became_peered":"2024-01-19T05:18:03.545889+0000","last_unstale":"2024-01-19T05:18:04.729899+0000","last_undegraded":"2024-01-19T05:18:04.729899+0000","last_fullsized":"2024-01-19T05:18:04.729899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:02.624304+0000","last_clean_scrub_stamp":"2024-01-19T05:18:02.624304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:37:29.525224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-19T05:18:04.728691+0000","last_change":"2024-01-19T05:18:02.666057+0000","last_active":"2024-01-19T05:18:04.728691+0000","last_peered":"2024-01-19T05:18:04.728691+0000","last_clean":"2024-01-19T05:18:04.728691+0000","last_became_active":"2024-01-19T05:18:02.665663+0000","last_became_peered":"2024-01-19T05:18:02.665663+0000","last_unstale":"2024-01-19T05:18:04.728691+0000","last_undegraded":"2024-01-19T05:18:04.728691+0000","last_fullsized":"2024-01-19T05:18:04.728691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:01.615645+0000","last_clean_scrub_stamp":"2024-01-19T05:18:01.615645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:36:05.209144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:15.638 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-19T05:18:15.638 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-19T05:18:15.638 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-19T05:18:15.638 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-19T05:18:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd37b20640 1 Processor -- start 2024-01-19T05:18:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd37b20640 1 -- start start 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd37b20640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcd300b2ce0 0x7fcd30071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd37b20640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3006f620 con 0x7fcd301441d0 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd37b20640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd30143610 con 0x7fcd300b1870 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd37b20640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd30141000 con 0x7fcd300b2ce0 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd360bd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcd301441d0 0x7fcd3014dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33358/0 (socket says 172.21.15.99:33358) 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd360bd640 1 -- 172.21.15.99:0/505285685 learned_addr learned my addr 172.21.15.99:0/505285685 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947391236 0 0) 0x7fcd3006f620 con 0x7fcd301441d0 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd358bc640 1 --2- 172.21.15.99:0/505285685 >> v2:172.21.15.157:3300/0 conn(0x7fcd300b2ce0 0x7fcd30071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1c005740 con 0x7fcd301441d0 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 907694629 0 0) 0x7fcd1c005740 con 0x7fcd301441d0 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 >> v2:172.21.15.157:3300/0 conn(0x7fcd300b2ce0 msgr2=0x7fcd30071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 --2- 172.21.15.99:0/505285685 >> v2:172.21.15.157:3300/0 conn(0x7fcd300b2ce0 0x7fcd30071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 >> v1:172.21.15.157:6789/0 conn(0x7fcd300b1870 legacy=0x7fcd30143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300b30c0 con 0x7fcd301441d0 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fcd28001a20 con 0x7fcd301441d0 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 >> v1:172.21.15.99:6789/0 conn(0x7fcd301441d0 legacy=0x7fcd3014dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd1c005b90 0x7fcd1c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1c0069e0 0x7fcd1c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c0073a0 0x7fcd1c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30141000 con 0x7fcd1c005b90 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c00e2f0 con 0x7fcd1c0073a0 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c00e4b0 con 0x7fcd1c0069e0 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.785+0000 7fcd358bc640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd1c005b90 0x7fcd1c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd350bb640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1c0069e0 0x7fcd1c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd358bc640 1 -- 172.21.15.99:0/505285685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1c0069e0 msgr2=0x7fcd1c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd358bc640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1c0069e0 0x7fcd1c006e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd360bd640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c0073a0 0x7fcd1c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd358bc640 1 -- 172.21.15.99:0/505285685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c0073a0 msgr2=0x7fcd1c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd358bc640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c0073a0 0x7fcd1c00dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd358bc640 1 -- 172.21.15.99:0/505285685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c005740 con 0x7fcd1c005b90 2024-01-19T05:18:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd360bd640 1 -- 172.21.15.99:0/505285685 reap_dead start 2024-01-19T05:18:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd358bc640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd1c005b90 0x7fcd1c005fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000ba30 tx=0x7fcd2001c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d867c265a6d9ae server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200ab640 con 0x7fcd1c005b90 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd200ab7a0 con 0x7fcd1c005b90 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd348ba640 1 -- 172.21.15.99:0/505285685 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200abb50 con 0x7fcd1c005b90 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 -- 172.21.15.99:0/505285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd1c005b90 msgr2=0x7fcd1c005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd1c005b90 0x7fcd1c005fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000ba30 tx=0x7fcd2001c650 comp rx=0 tx=0).stop 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 -- 172.21.15.99:0/505285685 shutdown_connections 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 --2- 172.21.15.99:0/505285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd1c005b90 0x7fcd1c005fb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 -- 172.21.15.99:0/505285685 >> 172.21.15.99:0/505285685 conn(0x7fcd300b8080 msgr2=0x7fcd300b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 -- 172.21.15.99:0/505285685 shutdown_connections 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 -- 172.21.15.99:0/505285685 wait complete. 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 Processor -- start 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.789+0000 7fcd37b20640 1 -- start start 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c005b90 0x7fcd300b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd3013bbc0 0x7fcd3013c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd30135270 0x7fcd301356f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30070940 con 0x7fcd3013bbc0 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3006ffb0 con 0x7fcd1c005b90 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300705f0 con 0x7fcd30135270 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd3013bbc0 0x7fcd3013c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd3013bbc0 0x7fcd3013c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55348/0 (socket says 172.21.15.99:55348) 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 -- 172.21.15.99:0/3242393200 learned_addr learned my addr 172.21.15.99:0/3242393200 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd360bd640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd30135270 0x7fcd301356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd358bc640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c005b90 0x7fcd300b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 -- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd30135270 msgr2=0x7fcd301356f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd30135270 0x7fcd301356f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 -- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c005b90 msgr2=0x7fcd300b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c005b90 0x7fcd300b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 -- 172.21.15.99:0/3242393200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3013c580 con 0x7fcd3013bbc0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd360bd640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd30135270 0x7fcd301356f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd350bb640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd3013bbc0 0x7fcd3013c040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00d570 tx=0x7fcd2c00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd267fc640 1 -- 172.21.15.99:0/3242393200 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c005480 con 0x7fcd3013bbc0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd267fc640 1 -- 172.21.15.99:0/3242393200 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c003620 con 0x7fcd3013bbc0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd300b7570 con 0x7fcd3013bbc0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd267fc640 1 -- 172.21.15.99:0/3242393200 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c003990 con 0x7fcd3013bbc0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd30144660 con 0x7fcd3013bbc0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30070a80 con 0x7fcd3013bbc0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd267fc640 1 -- 172.21.15.99:0/3242393200 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcd2c003af0 con 0x7fcd3013bbc0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd267fc640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcd14066500 0x7fcd140689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd358bc640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcd14066500 0x7fcd140689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd267fc640 1 -- 172.21.15.99:0/3242393200 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd2c083d50 con 0x7fcd3013bbc0 2024-01-19T05:18:15.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.793+0000 7fcd358bc640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcd14066500 0x7fcd140689c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd200af000 tx=0x7fcd200046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:15.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.797+0000 7fcd267fc640 1 -- 172.21.15.99:0/3242393200 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcd30070a80 con 0x7fcd3013bbc0 2024-01-19T05:18:15.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcd30070a80 con 0x7fcd3013bbc0 2024-01-19T05:18:15.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd267fc640 1 -- 172.21.15.99:0/3242393200 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcd30070a80 con 0x7fcd3013bbc0 2024-01-19T05:18:15.975 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:15.976 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-19T05:18:15.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcd14066500 msgr2=0x7fcd140689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcd14066500 0x7fcd140689c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd200af000 tx=0x7fcd200046d0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd3013bbc0 msgr2=0x7fcd3013c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd3013bbc0 0x7fcd3013c040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00d570 tx=0x7fcd2c00da30 comp rx=0 tx=0).stop 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 shutdown_connections 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcd14066500 0x7fcd140689c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd30135270 0x7fcd301356f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd3013bbc0 0x7fcd3013c040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 --2- 172.21.15.99:0/3242393200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1c005b90 0x7fcd300b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 >> 172.21.15.99:0/3242393200 conn(0x7fcd300b8080 msgr2=0x7fcd300ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 shutdown_connections 2024-01-19T05:18:15.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:15.973+0000 7fcd37b20640 1 -- 172.21.15.99:0/3242393200 wait complete. 2024-01-19T05:18:15.993 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-19T05:18:15.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b95de640 1 Processor -- start 2024-01-19T05:18:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b95de640 1 -- start start 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b95de640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9b40b96f0 0x7fb9b40b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b95de640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b40b87f0 con 0x7fb9b4140e90 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b95de640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b40b9ad0 con 0x7fb9b40b7c40 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b95de640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b40b81e0 con 0x7fb9b40b96f0 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b37fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb9b4140e90 0x7fb9b41511c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33362/0 (socket says 172.21.15.99:33362) 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b37fe640 1 -- 172.21.15.99:0/3969432061 learned_addr learned my addr 172.21.15.99:0/3969432061 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721036155 0 0) 0x7fb9b40b87f0 con 0x7fb9b4140e90 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b2ffd640 1 --2- 172.21.15.99:0/3969432061 >> v2:172.21.15.157:3300/0 conn(0x7fb9b40b96f0 0x7fb9b40b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a0003530 con 0x7fb9b4140e90 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4239542231 0 0) 0x7fb9a0003530 con 0x7fb9b4140e90 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 >> v2:172.21.15.157:3300/0 conn(0x7fb9b40b96f0 msgr2=0x7fb9b40b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 --2- 172.21.15.99:0/3969432061 >> v2:172.21.15.157:3300/0 conn(0x7fb9b40b96f0 0x7fb9b40b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 >> v1:172.21.15.157:6789/0 conn(0x7fb9b40b7c40 legacy=0x7fb9b4140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b406ba20 con 0x7fb9b4140e90 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fb9ac001680 con 0x7fb9b4140e90 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 >> v1:172.21.15.99:6789/0 conn(0x7fb9b4140e90 legacy=0x7fb9b41511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9a00039d0 0x7fb9a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a00047d0 0x7fb9a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9a0005190 0x7fb9a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40b81e0 con 0x7fb9a00039d0 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a000c0c0 con 0x7fb9a00047d0 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a000c280 con 0x7fb9a0005190 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b2ffd640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9a00039d0 0x7fb9a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b2ffd640 1 -- 172.21.15.99:0/3969432061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9a0005190 msgr2=0x7fb9a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b2ffd640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9a0005190 0x7fb9a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b2ffd640 1 -- 172.21.15.99:0/3969432061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a00047d0 msgr2=0x7fb9a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b2ffd640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a00047d0 0x7fb9a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b2ffd640 1 -- 172.21.15.99:0/3969432061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0003530 con 0x7fb9a00039d0 2024-01-19T05:18:16.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.105+0000 7fb9b37fe640 1 -- 172.21.15.99:0/3969432061 reap_dead start 2024-01-19T05:18:16.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b2ffd640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9a00039d0 0x7fb9a0003e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009ae0 tx=0x7fb99c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b189098f7183f547 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0a6510 con 0x7fb9a00039d0 2024-01-19T05:18:16.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c0a6670 con 0x7fb9a00039d0 2024-01-19T05:18:16.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b1ffb640 1 -- 172.21.15.99:0/3969432061 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0a6a20 con 0x7fb9a00039d0 2024-01-19T05:18:16.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- 172.21.15.99:0/3969432061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9a00039d0 msgr2=0x7fb9a0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9a00039d0 0x7fb9a0003e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009ae0 tx=0x7fb99c01ca20 comp rx=0 tx=0).stop 2024-01-19T05:18:16.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- 172.21.15.99:0/3969432061 shutdown_connections 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 --2- 172.21.15.99:0/3969432061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9a00039d0 0x7fb9a0003e10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- 172.21.15.99:0/3969432061 >> 172.21.15.99:0/3969432061 conn(0x7fb9b409e600 msgr2=0x7fb9b40b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- 172.21.15.99:0/3969432061 shutdown_connections 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- 172.21.15.99:0/3969432061 wait complete. 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 Processor -- start 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- start start 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9a00039d0 0x7fb9b413f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9b4144900 0x7fb9b4145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b41e2b40 0x7fb9b41e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4144f00 con 0x7fb9b4144900 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4147330 con 0x7fb9b41e2b40 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4147610 con 0x7fb9a00039d0 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9b4144900 0x7fb9b4145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9b4144900 0x7fb9b4145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55356/0 (socket says 172.21.15.99:55356) 2024-01-19T05:18:16.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 -- 172.21.15.99:0/1524686289 learned_addr learned my addr 172.21.15.99:0/1524686289 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b2ffd640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9a00039d0 0x7fb9b413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b37fe640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b41e2b40 0x7fb9b41e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 -- 172.21.15.99:0/1524686289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9a00039d0 msgr2=0x7fb9b413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9a00039d0 0x7fb9b413f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 -- 172.21.15.99:0/1524686289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b41e2b40 msgr2=0x7fb9b41e2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b41e2b40 0x7fb9b41e2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 -- 172.21.15.99:0/1524686289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b41467c0 con 0x7fb9b4144900 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b27fc640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9b4144900 0x7fb9b4145390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400c800 tx=0x7fb9a400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9ab7fe640 1 -- 172.21.15.99:0/1524686289 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4003b80 con 0x7fb9b4144900 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9ab7fe640 1 -- 172.21.15.99:0/1524686289 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a4003d00 con 0x7fb9b4144900 2024-01-19T05:18:16.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b413fe40 con 0x7fb9b4144900 2024-01-19T05:18:16.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9ab7fe640 1 -- 172.21.15.99:0/1524686289 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a400aa90 con 0x7fb9b4144900 2024-01-19T05:18:16.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.109+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b4147100 con 0x7fb9b4144900 2024-01-19T05:18:16.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.113+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b4067bf0 con 0x7fb9b4144900 2024-01-19T05:18:16.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.113+0000 7fb9ab7fe640 1 -- 172.21.15.99:0/1524686289 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb9a400abf0 con 0x7fb9b4144900 2024-01-19T05:18:16.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.113+0000 7fb9ab7fe640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb994066500 0x7fb9940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.113+0000 7fb9b2ffd640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb994066500 0x7fb9940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.113+0000 7fb9ab7fe640 1 -- 172.21.15.99:0/1524686289 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9a4083cc0 con 0x7fb9b4144900 2024-01-19T05:18:16.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.113+0000 7fb9b2ffd640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb994066500 0x7fb9940689c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0af000 tx=0x7fb99c0046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.117+0000 7fb9ab7fe640 1 -- 172.21.15.99:0/1524686289 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb9a4050ff0 con 0x7fb9b4144900 2024-01-19T05:18:16.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.261+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9b40696e0 con 0x7fb9b4144900 2024-01-19T05:18:16.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9ab7fe640 1 -- 172.21.15.99:0/1524686289 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fb9a4054610 con 0x7fb9b4144900 2024-01-19T05:18:16.266 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:16.266 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:16.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb994066500 msgr2=0x7fb9940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb994066500 0x7fb9940689c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0af000 tx=0x7fb99c0046d0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9b4144900 msgr2=0x7fb9b4145390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9b4144900 0x7fb9b4145390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400c800 tx=0x7fb9a400ccc0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 shutdown_connections 2024-01-19T05:18:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb994066500 0x7fb9940689c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9b41e2b40 0x7fb9b41e2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9b4144900 0x7fb9b4145390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 --2- 172.21.15.99:0/1524686289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9a00039d0 0x7fb9b413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 >> 172.21.15.99:0/1524686289 conn(0x7fb9b409e600 msgr2=0x7fb9b409a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 shutdown_connections 2024-01-19T05:18:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.265+0000 7fb9b95de640 1 -- 172.21.15.99:0/1524686289 wait complete. 2024-01-19T05:18:16.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:16.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:16.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.397+0000 7fc0ebcd7640 1 Processor -- start 2024-01-19T05:18:16.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.397+0000 7fc0ebcd7640 1 -- start start 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0ebcd7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 0x7fc0e41528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0ebcd7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e40b87f0 con 0x7fc0e40b96f0 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0ebcd7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e40b9ad0 con 0x7fc0e4140780 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0ebcd7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40b81e0 con 0x7fc0e4140be0 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9a73640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc0e40b96f0 0x7fc0e40b7700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33368/0 (socket says 172.21.15.99:33368) 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9a73640 1 -- 172.21.15.99:0/911711064 learned_addr learned my addr 172.21.15.99:0/911711064 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929896682 0 0) 0x7fc0e40b87f0 con 0x7fc0e40b96f0 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0ea274640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 0x7fc0e41528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d0003530 con 0x7fc0e40b96f0 2024-01-19T05:18:16.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3270656730 0 0) 0x7fc0d0003530 con 0x7fc0e40b96f0 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 msgr2=0x7fc0e41528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 0x7fc0e41528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 >> v1:172.21.15.157:6789/0 conn(0x7fc0e4140780 legacy=0x7fc0e414f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e406ba20 con 0x7fc0e40b96f0 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fc0e0001680 con 0x7fc0e40b96f0 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 >> v1:172.21.15.99:6789/0 conn(0x7fc0e40b96f0 legacy=0x7fc0e40b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00039b0 0x7fc0d0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 0x7fc0d0005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40b81e0 con 0x7fc0d00047d0 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d000bb50 con 0x7fc0d00039b0 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d000bd10 con 0x7fc0e4140be0 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9272640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9a73640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00039b0 0x7fc0d0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0ea274640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 0x7fc0d0005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9272640 1 -- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 msgr2=0x7fc0d0005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9272640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 0x7fc0d0005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9272640 1 -- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00039b0 msgr2=0x7fc0d0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9272640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00039b0 0x7fc0d0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9272640 1 -- 172.21.15.99:0/911711064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d0003530 con 0x7fc0d00047d0 2024-01-19T05:18:16.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0ea274640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e4140be0 0x7fc0d0005240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e9272640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4001780 tx=0x7fc0d401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8092f6215e7057f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40052d0 con 0x7fc0d00047d0 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d40a7050 con 0x7fc0d00047d0 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.401+0000 7fc0e8a71640 1 -- 172.21.15.99:0/911711064 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4003600 con 0x7fc0d00047d0 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/911711064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0d00047d0 msgr2=0x7fc0d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 --2- 172.21.15.99:0/911711064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4001780 tx=0x7fc0d401c3a0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 -- 172.21.15.99:0/911711064 reap_dead start 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/911711064 shutdown_connections 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/911711064 >> 172.21.15.99:0/911711064 conn(0x7fc0e409e600 msgr2=0x7fc0e40b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/911711064 shutdown_connections 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/911711064 wait complete. 2024-01-19T05:18:16.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 Processor -- start 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- start start 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00047d0 0x7fc0e40a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e413fe10 0x7fc0e4144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0e41452e0 0x7fc0e413a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e41475e0 con 0x7fc0e41452e0 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4145760 con 0x7fc0d00047d0 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4146f20 con 0x7fc0e413fe10 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0e41452e0 0x7fc0e413a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0e41452e0 0x7fc0e413a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55366/0 (socket says 172.21.15.99:55366) 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 -- 172.21.15.99:0/1468926177 learned_addr learned my addr 172.21.15.99:0/1468926177 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0e9a73640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00047d0 0x7fc0e40a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0e9272640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e413fe10 0x7fc0e4144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 -- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e413fe10 msgr2=0x7fc0e4144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e413fe10 0x7fc0e4144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 -- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00047d0 msgr2=0x7fc0e40a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00047d0 0x7fc0e40a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 -- 172.21.15.99:0/1468926177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e4147200 con 0x7fc0e41452e0 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0e9a73640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00047d0 0x7fc0e40a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ea274640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0e41452e0 0x7fc0e413a480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0e414af50 tx=0x7fc0dc009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0da7fc640 1 -- 172.21.15.99:0/1468926177 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc007d50 con 0x7fc0e41452e0 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0da7fc640 1 -- 172.21.15.99:0/1468926177 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc014400 con 0x7fc0e41452e0 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e4146680 con 0x7fc0e41452e0 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0da7fc640 1 -- 172.21.15.99:0/1468926177 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0147b0 con 0x7fc0e41452e0 2024-01-19T05:18:16.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e413f620 con 0x7fc0e41452e0 2024-01-19T05:18:16.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.405+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e4147390 con 0x7fc0e41452e0 2024-01-19T05:18:16.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.409+0000 7fc0da7fc640 1 -- 172.21.15.99:0/1468926177 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc0dc01d3b0 con 0x7fc0e41452e0 2024-01-19T05:18:16.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.409+0000 7fc0da7fc640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc0c8066500 0x7fc0c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.409+0000 7fc0e9a73640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc0c8066500 0x7fc0c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.409+0000 7fc0da7fc640 1 -- 172.21.15.99:0/1468926177 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0dc083c00 con 0x7fc0e41452e0 2024-01-19T05:18:16.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.409+0000 7fc0e9a73640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc0c8066500 0x7fc0c80689c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00017b0 tx=0x7fc0e0001120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.413+0000 7fc0da7fc640 1 -- 172.21.15.99:0/1468926177 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc0dc08a080 con 0x7fc0e41452e0 2024-01-19T05:18:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0e40696e0 con 0x7fc0e41452e0 2024-01-19T05:18:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0da7fc640 1 -- 172.21.15.99:0/1468926177 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0dc019020 con 0x7fc0e41452e0 2024-01-19T05:18:16.559 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc0c8066500 msgr2=0x7fc0c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc0c8066500 0x7fc0c80689c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00017b0 tx=0x7fc0e0001120 comp rx=0 tx=0).stop 2024-01-19T05:18:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0e41452e0 msgr2=0x7fc0e413a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0e41452e0 0x7fc0e413a480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0e414af50 tx=0x7fc0dc009dc0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 shutdown_connections 2024-01-19T05:18:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc0c8066500 0x7fc0c80689c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0e41452e0 0x7fc0e413a480 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc0e413fe10 0x7fc0e4144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 --2- 172.21.15.99:0/1468926177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0d00047d0 0x7fc0e40a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 >> 172.21.15.99:0/1468926177 conn(0x7fc0e409e600 msgr2=0x7fc0e409a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 shutdown_connections 2024-01-19T05:18:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.557+0000 7fc0ebcd7640 1 -- 172.21.15.99:0/1468926177 wait complete. 2024-01-19T05:18:16.576 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:16.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.681+0000 7fa90d130640 1 Processor -- start 2024-01-19T05:18:16.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.681+0000 7fa90d130640 1 -- start start 2024-01-19T05:18:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b1870 0x7fa908143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa908144000 0x7fa90814dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90806f620 con 0x7fa9080b2ce0 2024-01-19T05:18:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa908141000 con 0x7fa908144000 2024-01-19T05:18:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908143610 con 0x7fa9080b1870 2024-01-19T05:18:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90759e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa908144000 0x7fa90814dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90759e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa908144000 0x7fa90814dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55372/0 (socket says 172.21.15.99:55372) 2024-01-19T05:18:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa906d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa9080b2ce0 0x7fa908071f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33372/0 (socket says 172.21.15.99:33372) 2024-01-19T05:18:16.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90759e640 1 -- 172.21.15.99:0/745795450 learned_addr learned my addr 172.21.15.99:0/745795450 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:16.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90659c640 1 --2- 172.21.15.99:0/745795450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b1870 0x7fa908143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90759e640 1 -- 172.21.15.99:0/745795450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b1870 msgr2=0x7fa908143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90759e640 1 --2- 172.21.15.99:0/745795450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b1870 0x7fa908143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90759e640 1 -- 172.21.15.99:0/745795450 >> v1:172.21.15.99:6789/0 conn(0x7fa9080b2ce0 legacy=0x7fa908071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90759e640 1 -- 172.21.15.99:0/745795450 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908144480 con 0x7fa908144000 2024-01-19T05:18:16.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa905d9b640 1 -- 172.21.15.99:0/745795450 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310724555 0 0) 0x7fa90806f620 con 0x7fa9080b2ce0 2024-01-19T05:18:16.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90659c640 1 --2- 172.21.15.99:0/745795450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b1870 0x7fa908143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:16.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90759e640 1 --2- 172.21.15.99:0/745795450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa90814dda0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa900009e50 tx=0x7fa90001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a45580b941c015 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa905d9b640 1 -- 172.21.15.99:0/745795450 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000a58e0 con 0x7fa908144000 2024-01-19T05:18:16.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa905d9b640 1 -- 172.21.15.99:0/745795450 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9000a5a40 con 0x7fa908144000 2024-01-19T05:18:16.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa905d9b640 1 -- 172.21.15.99:0/745795450 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000a5dd0 con 0x7fa908144000 2024-01-19T05:18:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 -- 172.21.15.99:0/745795450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 msgr2=0x7fa90814dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 --2- 172.21.15.99:0/745795450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa90814dda0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa900009e50 tx=0x7fa90001ca10 comp rx=0 tx=0).stop 2024-01-19T05:18:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 -- 172.21.15.99:0/745795450 shutdown_connections 2024-01-19T05:18:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 --2- 172.21.15.99:0/745795450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa90814dda0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 --2- 172.21.15.99:0/745795450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b1870 0x7fa908143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.685+0000 7fa90d130640 1 -- 172.21.15.99:0/745795450 >> 172.21.15.99:0/745795450 conn(0x7fa9080b8080 msgr2=0x7fa9080b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- 172.21.15.99:0/745795450 shutdown_connections 2024-01-19T05:18:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- 172.21.15.99:0/745795450 wait complete. 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 Processor -- start 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- start start 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b2ce0 0x7fa90813ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa908151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa908152870 0x7fa9081e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9081522b0 con 0x7fa908144000 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9081e1990 con 0x7fa908152870 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908150d60 con 0x7fa9080b2ce0 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa908151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa908151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55376/0 (socket says 172.21.15.99:55376) 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 -- 172.21.15.99:0/3817429543 learned_addr learned my addr 172.21.15.99:0/3817429543 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa906d9d640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b2ce0 0x7fa90813ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 -- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b2ce0 msgr2=0x7fa90813ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b2ce0 0x7fa90813ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 -- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa908152870 msgr2=0x7fa9081e2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90759e640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa908152870 0x7fa9081e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa908152870 0x7fa9081e2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 -- 172.21.15.99:0/3817429543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900009b30 con 0x7fa908144000 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa906d9d640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b2ce0 0x7fa90813ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90659c640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa908151d70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c7c0 tx=0x7fa8f000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa8ff7fe640 1 -- 172.21.15.99:0/3817429543 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0007a30 con 0x7fa908144000 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa8ff7fe640 1 -- 172.21.15.99:0/3817429543 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0007b90 con 0x7fa908144000 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9081d7a20 con 0x7fa908144000 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa8ff7fe640 1 -- 172.21.15.99:0/3817429543 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000ce70 con 0x7fa908144000 2024-01-19T05:18:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9081e1be0 con 0x7fa908144000 2024-01-19T05:18:16.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9080696e0 con 0x7fa908144000 2024-01-19T05:18:16.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.689+0000 7fa8ff7fe640 1 -- 172.21.15.99:0/3817429543 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa8f00113f0 con 0x7fa908144000 2024-01-19T05:18:16.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.693+0000 7fa8ff7fe640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8e8066530 0x7fa8e80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.693+0000 7fa8ff7fe640 1 -- 172.21.15.99:0/3817429543 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8f00842b0 con 0x7fa908144000 2024-01-19T05:18:16.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.693+0000 7fa906d9d640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8e8066530 0x7fa8e80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.693+0000 7fa906d9d640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8e8066530 0x7fa8e80689f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8000f70 tx=0x7fa8f8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.697+0000 7fa8ff7fe640 1 -- 172.21.15.99:0/3817429543 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa8f00515e0 con 0x7fa908144000 2024-01-19T05:18:16.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.841+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa90806f060 con 0x7fa908144000 2024-01-19T05:18:16.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa8ff7fe640 1 -- 172.21.15.99:0/3817429543 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8f0054c00 con 0x7fa908144000 2024-01-19T05:18:16.846 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8e8066530 msgr2=0x7fa8e80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8e8066530 0x7fa8e80689f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8000f70 tx=0x7fa8f8009040 comp rx=0 tx=0).stop 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 msgr2=0x7fa908151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa908151d70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c7c0 tx=0x7fa8f000cc80 comp rx=0 tx=0).stop 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 shutdown_connections 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8e8066530 0x7fa8e80689f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa908152870 0x7fa9081e2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa908144000 0x7fa908151d70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 --2- 172.21.15.99:0/3817429543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa9080b2ce0 0x7fa90813ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 >> 172.21.15.99:0/3817429543 conn(0x7fa9080b8080 msgr2=0x7fa908141470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 shutdown_connections 2024-01-19T05:18:16.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.845+0000 7fa90d130640 1 -- 172.21.15.99:0/3817429543 wait complete. 2024-01-19T05:18:16.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:16.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.973+0000 7f45a41a6640 1 Processor -- start 2024-01-19T05:18:16.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.973+0000 7f45a41a6640 1 -- start start 2024-01-19T05:18:16.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a41a6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c06ebe0 0x7f459c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a41a6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f459c072320 0x7f459c14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a41a6640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c070680 con 0x7f459c0b19f0 2024-01-19T05:18:16.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a41a6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c070410 con 0x7f459c072320 2024-01-19T05:18:16.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a41a6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c06f040 con 0x7f459c06ebe0 2024-01-19T05:18:16.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f459c0b19f0 0x7f459c144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33376/0 (socket says 172.21.15.99:33376) 2024-01-19T05:18:16.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 -- 172.21.15.99:0/2776146221 learned_addr learned my addr 172.21.15.99:0/2776146221 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897294406 0 0) 0x7f459c070680 con 0x7f459c0b19f0 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4584003530 con 0x7f459c0b19f0 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a2743640 1 --2- 172.21.15.99:0/2776146221 >> v2:172.21.15.157:3300/0 conn(0x7f459c072320 0x7f459c14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1741640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c06ebe0 0x7f459c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402493937 0 0) 0x7f4584003530 con 0x7f459c0b19f0 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c06ebe0 msgr2=0x7f459c071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c06ebe0 0x7f459c071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 >> v2:172.21.15.157:3300/0 conn(0x7f459c072320 msgr2=0x7f459c14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 --2- 172.21.15.99:0/2776146221 >> v2:172.21.15.157:3300/0 conn(0x7f459c072320 0x7f459c14ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c144790 con 0x7f459c0b19f0 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f4594001680 con 0x7f459c0b19f0 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 >> v1:172.21.15.99:6789/0 conn(0x7f459c0b19f0 legacy=0x7f459c144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4584003980 0x7f4584003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c06ebe0 0x7f45840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4584004d10 0x7f4584005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c070410 con 0x7f4584003980 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c06f040 con 0x7f4584004d10 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458400baf0 con 0x7f459c06ebe0 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4584003980 0x7f4584003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a2743640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4584004d10 0x7f4584005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1741640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c06ebe0 0x7f45840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 -- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c06ebe0 msgr2=0x7f45840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c06ebe0 0x7f45840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 -- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4584004d10 msgr2=0x7f4584005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4584004d10 0x7f4584005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 -- 172.21.15.99:0/2776146221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584003530 con 0x7f4584003980 2024-01-19T05:18:16.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.977+0000 7f45a1f42640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4584003980 0x7f4584003dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f459400c210 tx=0x7f459401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc0d380f9f9e12a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45940058e0 con 0x7f4584003980 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594005a40 con 0x7f4584003980 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a0f40640 1 -- 172.21.15.99:0/2776146221 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594005e30 con 0x7f4584003980 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- 172.21.15.99:0/2776146221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4584003980 msgr2=0x7f4584003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 --2- 172.21.15.99:0/2776146221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4584003980 0x7f4584003dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f459400c210 tx=0x7f459401cc30 comp rx=0 tx=0).stop 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 -- 172.21.15.99:0/2776146221 reap_dead start 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- 172.21.15.99:0/2776146221 shutdown_connections 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- 172.21.15.99:0/2776146221 >> 172.21.15.99:0/2776146221 conn(0x7f459c0b8080 msgr2=0x7f459c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- 172.21.15.99:0/2776146221 shutdown_connections 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- 172.21.15.99:0/2776146221 wait complete. 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 Processor -- start 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- start start 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f459c149fd0 0x7f459c0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c14d170 0x7f459c1e2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f459c13a2e0 0x7f459c13a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c14a3b0 con 0x7f459c13a2e0 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c14d650 con 0x7f459c149fd0 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0af620 con 0x7f459c14d170 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f459c13a2e0 0x7f459c13a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f459c13a2e0 0x7f459c13a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55392/0 (socket says 172.21.15.99:55392) 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 -- 172.21.15.99:0/1326715353 learned_addr learned my addr 172.21.15.99:0/1326715353 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a1f42640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f459c149fd0 0x7f459c0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 -- 172.21.15.99:0/1326715353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c14d170 msgr2=0x7f459c1e2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a1741640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c14d170 0x7f459c1e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c14d170 0x7f459c1e2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 -- 172.21.15.99:0/1326715353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f459c149fd0 msgr2=0x7f459c0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f459c149fd0 0x7f459c0afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 -- 172.21.15.99:0/1326715353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c14abb0 con 0x7f459c13a2e0 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a2743640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f459c13a2e0 0x7f459c13a770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f459c0702d0 tx=0x7f458c00f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45927fc640 1 -- 172.21.15.99:0/1326715353 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c004440 con 0x7f459c13a2e0 2024-01-19T05:18:16.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45927fc640 1 -- 172.21.15.99:0/1326715353 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c00be60 con 0x7f459c13a2e0 2024-01-19T05:18:16.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c13acb0 con 0x7f459c13a2e0 2024-01-19T05:18:16.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45927fc640 1 -- 172.21.15.99:0/1326715353 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c003840 con 0x7f459c13a2e0 2024-01-19T05:18:16.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c0b0a00 con 0x7f459c13a2e0 2024-01-19T05:18:16.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.981+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c143050 con 0x7f459c13a2e0 2024-01-19T05:18:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.985+0000 7f45927fc640 1 -- 172.21.15.99:0/1326715353 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f458c0039a0 con 0x7f459c13a2e0 2024-01-19T05:18:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.985+0000 7f45927fc640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4588066530 0x7f45880689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.985+0000 7f45927fc640 1 -- 172.21.15.99:0/1326715353 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f458c083980 con 0x7f459c13a2e0 2024-01-19T05:18:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.985+0000 7f45a1f42640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4588066530 0x7f45880689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.985+0000 7f45a1f42640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4588066530 0x7f45880689f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f45940aa000 tx=0x7f4594001a10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:16.989+0000 7f45927fc640 1 -- 172.21.15.99:0/1326715353 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f458c050cb0 con 0x7f459c13a2e0 2024-01-19T05:18:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f459c145300 con 0x7f459c13a2e0 2024-01-19T05:18:17.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45927fc640 1 -- 172.21.15.99:0/1326715353 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f458c0542d0 con 0x7f459c13a2e0 2024-01-19T05:18:17.135 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4588066530 msgr2=0x7f45880689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4588066530 0x7f45880689f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f45940aa000 tx=0x7f4594001a10 comp rx=0 tx=0).stop 2024-01-19T05:18:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f459c13a2e0 msgr2=0x7f459c13a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f459c13a2e0 0x7f459c13a770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f459c0702d0 tx=0x7f458c00f7e0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 shutdown_connections 2024-01-19T05:18:17.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4588066530 0x7f45880689f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f459c13a2e0 0x7f459c13a770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f459c14d170 0x7f459c1e2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 --2- 172.21.15.99:0/1326715353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f459c149fd0 0x7f459c0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 >> 172.21.15.99:0/1326715353 conn(0x7f459c0b8080 msgr2=0x7f459c142560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 shutdown_connections 2024-01-19T05:18:17.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.133+0000 7f45a41a6640 1 -- 172.21.15.99:0/1326715353 wait complete. 2024-01-19T05:18:17.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:17.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.253+0000 7efcfd309640 1 Processor -- start 2024-01-19T05:18:17.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.253+0000 7efcfd309640 1 -- start start 2024-01-19T05:18:17.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf80b1870 0x7efcf8143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efcf8144000 0x7efcf814dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf806f620 con 0x7efcf80b2ce0 2024-01-19T05:18:17.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf8141000 con 0x7efcf8144000 2024-01-19T05:18:17.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8143610 con 0x7efcf80b1870 2024-01-19T05:18:17.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf77fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efcf8144000 0x7efcf814dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf77fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efcf8144000 0x7efcf814dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55400/0 (socket says 172.21.15.99:55400) 2024-01-19T05:18:17.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf77fe640 1 -- 172.21.15.99:0/1844259475 learned_addr learned my addr 172.21.15.99:0/1844259475 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:17.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcee7fc640 1 --2- 172.21.15.99:0/1844259475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf80b1870 0x7efcf8143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf77fe640 1 -- 172.21.15.99:0/1844259475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf80b1870 msgr2=0x7efcf8143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:17.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf77fe640 1 --2- 172.21.15.99:0/1844259475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf80b1870 0x7efcf8143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf77fe640 1 -- 172.21.15.99:0/1844259475 >> v1:172.21.15.157:6789/0 conn(0x7efcf80b2ce0 legacy=0x7efcf8071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:17.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf77fe640 1 -- 172.21.15.99:0/1844259475 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8144480 con 0x7efcf8144000 2024-01-19T05:18:17.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf77fe640 1 --2- 172.21.15.99:0/1844259475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf814dda0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efcf000d150 tx=0x7efcf001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b525832c919a15 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf67fc640 1 -- 172.21.15.99:0/1844259475 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00a7ce0 con 0x7efcf8144000 2024-01-19T05:18:17.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf67fc640 1 -- 172.21.15.99:0/1844259475 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00a7e40 con 0x7efcf8144000 2024-01-19T05:18:17.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcf67fc640 1 -- 172.21.15.99:0/1844259475 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000b2f0 con 0x7efcf8144000 2024-01-19T05:18:17.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 -- 172.21.15.99:0/1844259475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 msgr2=0x7efcf814dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 --2- 172.21.15.99:0/1844259475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf814dda0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efcf000d150 tx=0x7efcf001ec10 comp rx=0 tx=0).stop 2024-01-19T05:18:17.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 -- 172.21.15.99:0/1844259475 shutdown_connections 2024-01-19T05:18:17.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 --2- 172.21.15.99:0/1844259475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf814dda0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 --2- 172.21.15.99:0/1844259475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf80b1870 0x7efcf8143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 -- 172.21.15.99:0/1844259475 >> 172.21.15.99:0/1844259475 conn(0x7efcf80b8080 msgr2=0x7efcf80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:17.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 -- 172.21.15.99:0/1844259475 shutdown_connections 2024-01-19T05:18:17.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.257+0000 7efcfd309640 1 -- 172.21.15.99:0/1844259475 wait complete. 2024-01-19T05:18:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 Processor -- start 2024-01-19T05:18:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 -- start start 2024-01-19T05:18:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcf80b2ce0 0x7efcf813f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf81dec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf81e2df0 0x7efcf814c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81e29d0 con 0x7efcf8144000 2024-01-19T05:18:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81e2350 con 0x7efcf80b2ce0 2024-01-19T05:18:17.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81df180 con 0x7efcf81e2df0 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf81dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf81dec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55416/0 (socket says 172.21.15.99:55416) 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 -- 172.21.15.99:0/2379897742 learned_addr learned my addr 172.21.15.99:0/2379897742 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 -- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf81e2df0 msgr2=0x7efcf814c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcf77fe640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf81e2df0 0x7efcf814c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcf6ffd640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcf80b2ce0 0x7efcf813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf81e2df0 0x7efcf814c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 -- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcf80b2ce0 msgr2=0x7efcf813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcf80b2ce0 0x7efcf813f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 -- 172.21.15.99:0/2379897742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf000bd40 con 0x7efcf8144000 2024-01-19T05:18:17.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcf77fe640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf81e2df0 0x7efcf814c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcee7fc640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf81dec40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efce000d800 tx=0x7efce000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efceffff640 1 -- 172.21.15.99:0/2379897742 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000b6c0 con 0x7efcf8144000 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efceffff640 1 -- 172.21.15.99:0/2379897742 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000b860 con 0x7efcf8144000 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf8147310 con 0x7efcf8144000 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efceffff640 1 -- 172.21.15.99:0/2379897742 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000bc10 con 0x7efcf8144000 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf81e25f0 con 0x7efcf8144000 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf81e21b0 con 0x7efcf8144000 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.261+0000 7efceffff640 1 -- 172.21.15.99:0/2379897742 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efce001e460 con 0x7efcf8144000 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.265+0000 7efceffff640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efcd8066500 0x7efcd80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.265+0000 7efceffff640 1 -- 172.21.15.99:0/2379897742 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efce00843e0 con 0x7efcf8144000 2024-01-19T05:18:17.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.265+0000 7efcf6ffd640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efcd8066500 0x7efcd80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.265+0000 7efcf6ffd640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efcd8066500 0x7efcd80689c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efce8007fd0 tx=0x7efce8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.269+0000 7efceffff640 1 -- 172.21.15.99:0/2379897742 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efcf81e21b0 con 0x7efcf8144000 2024-01-19T05:18:17.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcf81e2b10 con 0x7efcf8144000 2024-01-19T05:18:17.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efceffff640 1 -- 172.21.15.99:0/2379897742 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3352 (secure 0 0 0) 0x7efcf81e2b10 con 0x7efcf8144000 2024-01-19T05:18:17.447 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:17.447 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:02.994909+0000","modified":"2024-01-19T05:18:04.990494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:18:17.448 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-19T05:18:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efcd8066500 msgr2=0x7efcd80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efcd8066500 0x7efcd80689c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efce8007fd0 tx=0x7efce8009040 comp rx=0 tx=0).stop 2024-01-19T05:18:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 msgr2=0x7efcf81dec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf81dec40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efce000d800 tx=0x7efce000dcc0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 shutdown_connections 2024-01-19T05:18:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efcd8066500 0x7efcd80689c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efcf81e2df0 0x7efcf814c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf8144000 0x7efcf81dec40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 --2- 172.21.15.99:0/2379897742 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcf80b2ce0 0x7efcf813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 >> 172.21.15.99:0/2379897742 conn(0x7efcf80b8080 msgr2=0x7efcf8142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 shutdown_connections 2024-01-19T05:18:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.445+0000 7efcfd309640 1 -- 172.21.15.99:0/2379897742 wait complete. 2024-01-19T05:18:17.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:17.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f659ac54640 1 Processor -- start 2024-01-19T05:18:17.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f659ac54640 1 -- start start 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f659ac54640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f65940b19f0 0x7f659406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f659ac54640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f65940724f0 0x7f6594145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f659ac54640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6594070680 con 0x7f6594144c70 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f659ac54640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6594070410 con 0x7f65940b19f0 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f659ac54640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6594144790 con 0x7f65940724f0 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f65989f0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f65940b19f0 0x7f659406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f65989f0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f65940b19f0 0x7f659406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55422/0 (socket says 172.21.15.99:55422) 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f65989f0640 1 -- 172.21.15.99:0/2127254887 learned_addr learned my addr 172.21.15.99:0/2127254887 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:17.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f65991f1640 1 --2- 172.21.15.99:0/2127254887 >> v2:172.21.15.157:3300/0 conn(0x7f65940724f0 0x7f6594145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f65989f0640 1 -- 172.21.15.99:0/2127254887 >> v2:172.21.15.157:3300/0 conn(0x7f65940724f0 msgr2=0x7f6594145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:17.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.569+0000 7f65989f0640 1 --2- 172.21.15.99:0/2127254887 >> v2:172.21.15.157:3300/0 conn(0x7f65940724f0 0x7f6594145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f65989f0640 1 -- 172.21.15.99:0/2127254887 >> v1:172.21.15.157:6789/0 conn(0x7f6594144c70 legacy=0x7f6594071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:17.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f65989f0640 1 -- 172.21.15.99:0/2127254887 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659406f2b0 con 0x7f65940b19f0 2024-01-19T05:18:17.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f65989f0640 1 --2- 172.21.15.99:0/2127254887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f659406ebe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f659406d030 tx=0x7f658c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1349ff4af107821e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f65937fe640 1 -- 172.21.15.99:0/2127254887 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0a5740 con 0x7f65940b19f0 2024-01-19T05:18:17.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f65937fe640 1 -- 172.21.15.99:0/2127254887 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0a58a0 con 0x7f65940b19f0 2024-01-19T05:18:17.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f65937fe640 1 -- 172.21.15.99:0/2127254887 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0a5c30 con 0x7f65940b19f0 2024-01-19T05:18:17.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f659ac54640 1 -- 172.21.15.99:0/2127254887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 msgr2=0x7f659406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f659ac54640 1 --2- 172.21.15.99:0/2127254887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f659406ebe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f659406d030 tx=0x7f658c01c8e0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f659ac54640 1 -- 172.21.15.99:0/2127254887 shutdown_connections 2024-01-19T05:18:17.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f659ac54640 1 --2- 172.21.15.99:0/2127254887 >> v2:172.21.15.157:3300/0 conn(0x7f65940724f0 0x7f6594145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f659ac54640 1 --2- 172.21.15.99:0/2127254887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f659406ebe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f659ac54640 1 -- 172.21.15.99:0/2127254887 >> 172.21.15.99:0/2127254887 conn(0x7f65940b8080 msgr2=0x7f65940b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:17.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f659ac54640 1 -- 172.21.15.99:0/2127254887 shutdown_connections 2024-01-19T05:18:17.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.573+0000 7f659ac54640 1 -- 172.21.15.99:0/2127254887 wait complete. 2024-01-19T05:18:17.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 Processor -- start 2024-01-19T05:18:17.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 -- start start 2024-01-19T05:18:17.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65940724f0 0x7f6594137190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f65941376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6594144c70 0x7f65941e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65941411e0 con 0x7f65940b19f0 2024-01-19T05:18:17.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940a8a00 con 0x7f65940724f0 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6594137c10 con 0x7f6594144c70 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f65941376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f65941376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55434/0 (socket says 172.21.15.99:55434) 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 -- 172.21.15.99:0/4280701023 learned_addr learned my addr 172.21.15.99:0/4280701023 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 -- 172.21.15.99:0/4280701023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6594144c70 msgr2=0x7f65941e05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6594144c70 0x7f65941e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 -- 172.21.15.99:0/4280701023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65940724f0 msgr2=0x7f6594137190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65940724f0 0x7f6594137190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 -- 172.21.15.99:0/4280701023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c009b30 con 0x7f65940b19f0 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f6593fff640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f65941376d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c480 tx=0x7f657c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f65917fa640 1 -- 172.21.15.99:0/4280701023 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c012830 con 0x7f65940b19f0 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f65917fa640 1 -- 172.21.15.99:0/4280701023 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c0129b0 con 0x7f65940b19f0 2024-01-19T05:18:17.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6594140c20 con 0x7f65940b19f0 2024-01-19T05:18:17.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f65917fa640 1 -- 172.21.15.99:0/4280701023 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c012d60 con 0x7f65940b19f0 2024-01-19T05:18:17.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6594144260 con 0x7f65940b19f0 2024-01-19T05:18:17.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65940696e0 con 0x7f65940b19f0 2024-01-19T05:18:17.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f65917fa640 1 -- 172.21.15.99:0/4280701023 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f657c01c460 con 0x7f65940b19f0 2024-01-19T05:18:17.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f65917fa640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6578066500 0x7f65780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f65989f0640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6578066500 0x7f65780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f65917fa640 1 -- 172.21.15.99:0/4280701023 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f657c083cd0 con 0x7f65940b19f0 2024-01-19T05:18:17.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.577+0000 7f65989f0640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6578066500 0x7f65780689c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f658c0ae000 tx=0x7f658c004ac0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.581+0000 7f65917fa640 1 -- 172.21.15.99:0/4280701023 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f657c051000 con 0x7f65940b19f0 2024-01-19T05:18:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.741+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65940b6a60 con 0x7f65940b19f0 2024-01-19T05:18:17.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f65917fa640 1 -- 172.21.15.99:0/4280701023 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f657c054620 con 0x7f65940b19f0 2024-01-19T05:18:17.748 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:17.748 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6578066500 msgr2=0x7f65780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6578066500 0x7f65780689c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f658c0ae000 tx=0x7f658c004ac0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 msgr2=0x7f65941376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f65941376d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c480 tx=0x7f657c00c940 comp rx=0 tx=0).stop 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 shutdown_connections 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6578066500 0x7f65780689c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6594144c70 0x7f65941e05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65940b19f0 0x7f65941376d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.745+0000 7f659ac54640 1 --2- 172.21.15.99:0/4280701023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65940724f0 0x7f6594137190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.749+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 >> 172.21.15.99:0/4280701023 conn(0x7f65940b8080 msgr2=0x7f65940b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.749+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 shutdown_connections 2024-01-19T05:18:17.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.749+0000 7f659ac54640 1 -- 172.21.15.99:0/4280701023 wait complete. 2024-01-19T05:18:17.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:17.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:17.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10ea241640 1 Processor -- start 2024-01-19T05:18:17.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10ea241640 1 -- start start 2024-01-19T05:18:17.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10ea241640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f10e406ebe0 0x7f10e4071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10ea241640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f10e4072320 0x7f10e414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10ea241640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e406f070 con 0x7f10e40b19f0 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10ea241640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e4070680 con 0x7f10e406ebe0 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10ea241640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e4070410 con 0x7f10e4072320 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e2ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f10e406ebe0 0x7f10e4071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e2ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f10e406ebe0 0x7f10e4071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55452/0 (socket says 172.21.15.99:55452) 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e2ffd640 1 -- 172.21.15.99:0/3810365388 learned_addr learned my addr 172.21.15.99:0/3810365388 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e2ffd640 1 -- 172.21.15.99:0/3810365388 >> v2:172.21.15.157:3300/0 conn(0x7f10e4072320 msgr2=0x7f10e414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e3fff640 1 --2- 172.21.15.99:0/3810365388 >> v2:172.21.15.157:3300/0 conn(0x7f10e4072320 0x7f10e414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e2ffd640 1 --2- 172.21.15.99:0/3810365388 >> v2:172.21.15.157:3300/0 conn(0x7f10e4072320 0x7f10e414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e2ffd640 1 -- 172.21.15.99:0/3810365388 >> v1:172.21.15.157:6789/0 conn(0x7f10e40b19f0 legacy=0x7f10e4144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e2ffd640 1 -- 172.21.15.99:0/3810365388 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4144790 con 0x7f10e406ebe0 2024-01-19T05:18:17.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.889+0000 7f10e3fff640 1 --2- 172.21.15.99:0/3810365388 >> v2:172.21.15.157:3300/0 conn(0x7f10e4072320 0x7f10e414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:17.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10e2ffd640 1 --2- 172.21.15.99:0/3810365388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e406ebe0 0x7f10e4071de0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f10e40b9070 tx=0x7f10d801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b078b7bccb213e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10e27fc640 1 -- 172.21.15.99:0/3810365388 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80ab620 con 0x7f10e406ebe0 2024-01-19T05:18:17.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10e27fc640 1 -- 172.21.15.99:0/3810365388 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80ab780 con 0x7f10e406ebe0 2024-01-19T05:18:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10e27fc640 1 -- 172.21.15.99:0/3810365388 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80abb10 con 0x7f10e406ebe0 2024-01-19T05:18:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 -- 172.21.15.99:0/3810365388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e406ebe0 msgr2=0x7f10e4071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 --2- 172.21.15.99:0/3810365388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e406ebe0 0x7f10e4071de0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f10e40b9070 tx=0x7f10d801c400 comp rx=0 tx=0).stop 2024-01-19T05:18:17.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 -- 172.21.15.99:0/3810365388 shutdown_connections 2024-01-19T05:18:17.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 --2- 172.21.15.99:0/3810365388 >> v2:172.21.15.157:3300/0 conn(0x7f10e4072320 0x7f10e414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 --2- 172.21.15.99:0/3810365388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e406ebe0 0x7f10e4071de0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 -- 172.21.15.99:0/3810365388 >> 172.21.15.99:0/3810365388 conn(0x7f10e40b8080 msgr2=0x7f10e40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:17.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 -- 172.21.15.99:0/3810365388 shutdown_connections 2024-01-19T05:18:17.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 -- 172.21.15.99:0/3810365388 wait complete. 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 Processor -- start 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.893+0000 7f10ea241640 1 -- start start 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10e406ebe0 0x7f10e4140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e4072320 0x7f10e4141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10e40b19f0 0x7f10e40adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e413c990 con 0x7f10e4072320 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e41dd0c0 con 0x7f10e40b19f0 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e41dd340 con 0x7f10e406ebe0 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e4072320 0x7f10e4141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e4072320 0x7f10e4141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55456/0 (socket says 172.21.15.99:55456) 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 -- 172.21.15.99:0/2501043936 learned_addr learned my addr 172.21.15.99:0/2501043936 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:17.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 -- 172.21.15.99:0/2501043936 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10e406ebe0 msgr2=0x7f10e4140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10e406ebe0 0x7f10e4140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 -- 172.21.15.99:0/2501043936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10e40b19f0 msgr2=0x7f10e40adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10e40b19f0 0x7f10e40adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 -- 172.21.15.99:0/2501043936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80094d0 con 0x7f10e4072320 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e2ffd640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e4072320 0x7f10e4141060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f10d801a030 tx=0x7f10d801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10cbfff640 1 -- 172.21.15.99:0/2501043936 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80be3f0 con 0x7f10e4072320 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10cbfff640 1 -- 172.21.15.99:0/2501043936 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80be570 con 0x7f10e4072320 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e41dd680 con 0x7f10e4072320 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10cbfff640 1 -- 172.21.15.99:0/2501043936 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80be920 con 0x7f10e4072320 2024-01-19T05:18:17.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e41409a0 con 0x7f10e4072320 2024-01-19T05:18:17.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e40696e0 con 0x7f10e4072320 2024-01-19T05:18:17.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10cbfff640 1 -- 172.21.15.99:0/2501043936 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f10d80c7440 con 0x7f10e4072320 2024-01-19T05:18:17.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10cbfff640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f10d0066500 0x7f10d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:17.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e37fe640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f10d0066500 0x7f10d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:17.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10cbfff640 1 -- 172.21.15.99:0/2501043936 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10d811e4b0 con 0x7f10e4072320 2024-01-19T05:18:17.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.897+0000 7f10e37fe640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f10d0066500 0x7f10d00689c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10dc007fd0 tx=0x7f10dc007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:17.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:17.901+0000 7f10cbfff640 1 -- 172.21.15.99:0/2501043936 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f10d80eb7e0 con 0x7f10e4072320 2024-01-19T05:18:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.045+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10e406f070 con 0x7f10e4072320 2024-01-19T05:18:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.045+0000 7f10cbfff640 1 -- 172.21.15.99:0/2501043936 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10e406f070 con 0x7f10e4072320 2024-01-19T05:18:18.048 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f10d0066500 msgr2=0x7f10d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f10d0066500 0x7f10d00689c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10dc007fd0 tx=0x7f10dc007d40 comp rx=0 tx=0).stop 2024-01-19T05:18:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e4072320 msgr2=0x7f10e4141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e4072320 0x7f10e4141060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f10d801a030 tx=0x7f10d801ac40 comp rx=0 tx=0).stop 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 shutdown_connections 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f10d0066500 0x7f10d00689c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10e40b19f0 0x7f10e40adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10e4072320 0x7f10e4141060 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 --2- 172.21.15.99:0/2501043936 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10e406ebe0 0x7f10e4140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 >> 172.21.15.99:0/2501043936 conn(0x7f10e40b8080 msgr2=0x7f10e413de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 shutdown_connections 2024-01-19T05:18:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.049+0000 7f10ea241640 1 -- 172.21.15.99:0/2501043936 wait complete. 2024-01-19T05:18:18.065 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efeeb34b640 1 Processor -- start 2024-01-19T05:18:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efeeb34b640 1 -- start start 2024-01-19T05:18:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efeeb34b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efee4140780 0x7efee4140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efeeb34b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee40b87f0 con 0x7efee414f1b0 2024-01-19T05:18:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efeeb34b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee40b9ad0 con 0x7efee40b96f0 2024-01-19T05:18:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efeeb34b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee4141120 con 0x7efee4140780 2024-01-19T05:18:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee88e6640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efee4140780 0x7efee4140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee98e8640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7efee414f1b0 0x7efee41515a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33388/0 (socket says 172.21.15.99:33388) 2024-01-19T05:18:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee98e8640 1 -- 172.21.15.99:0/904846531 learned_addr learned my addr 172.21.15.99:0/904846531 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee88e6640 1 -- 172.21.15.99:0/904846531 >> v1:172.21.15.157:6789/0 conn(0x7efee40b96f0 legacy=0x7efee40b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee88e6640 1 -- 172.21.15.99:0/904846531 >> v1:172.21.15.99:6789/0 conn(0x7efee414f1b0 legacy=0x7efee41515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee3fff640 1 -- 172.21.15.99:0/904846531 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651635971 0 0) 0x7efee40b87f0 con 0x7efee414f1b0 2024-01-19T05:18:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee88e6640 1 -- 172.21.15.99:0/904846531 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee40b81e0 con 0x7efee4140780 2024-01-19T05:18:18.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee88e6640 1 --2- 172.21.15.99:0/904846531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee4140780 0x7efee4140be0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efee4141260 tx=0x7efed801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3f0f4d8d132e81 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.181+0000 7efee3fff640 1 -- 172.21.15.99:0/904846531 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed80a59b0 con 0x7efee4140780 2024-01-19T05:18:18.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee3fff640 1 -- 172.21.15.99:0/904846531 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed80a5b10 con 0x7efee4140780 2024-01-19T05:18:18.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee3fff640 1 -- 172.21.15.99:0/904846531 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed80a5ea0 con 0x7efee4140780 2024-01-19T05:18:18.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- 172.21.15.99:0/904846531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee4140780 msgr2=0x7efee4140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 --2- 172.21.15.99:0/904846531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee4140780 0x7efee4140be0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efee4141260 tx=0x7efed801c8f0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- 172.21.15.99:0/904846531 shutdown_connections 2024-01-19T05:18:18.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 --2- 172.21.15.99:0/904846531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee4140780 0x7efee4140be0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- 172.21.15.99:0/904846531 >> 172.21.15.99:0/904846531 conn(0x7efee409e600 msgr2=0x7efee40b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:18.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- 172.21.15.99:0/904846531 shutdown_connections 2024-01-19T05:18:18.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- 172.21.15.99:0/904846531 wait complete. 2024-01-19T05:18:18.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 Processor -- start 2024-01-19T05:18:18.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- start start 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee40b96f0 0x7efee409fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee4140780 0x7efee40a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee414f1b0 0x7efee41382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee40a1110 con 0x7efee40b96f0 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee414ff50 con 0x7efee4140780 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee414fac0 con 0x7efee414f1b0 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee40b96f0 0x7efee409fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee40b96f0 0x7efee409fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55474/0 (socket says 172.21.15.99:55474) 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 -- 172.21.15.99:0/31865682 learned_addr learned my addr 172.21.15.99:0/31865682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee88e6640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee4140780 0x7efee40a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee98e8640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee414f1b0 0x7efee41382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 -- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee414f1b0 msgr2=0x7efee41382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee414f1b0 0x7efee41382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 -- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee4140780 msgr2=0x7efee40a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee4140780 0x7efee40a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 -- 172.21.15.99:0/31865682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8009a70 con 0x7efee40b96f0 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee98e8640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee414f1b0 0x7efee41382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee90e7640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee40b96f0 0x7efee409fff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efed400c450 tx=0x7efed400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee1ffb640 1 -- 172.21.15.99:0/31865682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4012830 con 0x7efee40b96f0 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee1ffb640 1 -- 172.21.15.99:0/31865682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed40129b0 con 0x7efee40b96f0 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efee1ffb640 1 -- 172.21.15.99:0/31865682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4012d60 con 0x7efee40b96f0 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee41392c0 con 0x7efee40b96f0 2024-01-19T05:18:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.185+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee40b6a40 con 0x7efee40b96f0 2024-01-19T05:18:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.189+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee414f840 con 0x7efee40b96f0 2024-01-19T05:18:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.189+0000 7efee1ffb640 1 -- 172.21.15.99:0/31865682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efed401c460 con 0x7efee40b96f0 2024-01-19T05:18:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.189+0000 7efee1ffb640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efed0066500 0x7efed00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.189+0000 7efee1ffb640 1 -- 172.21.15.99:0/31865682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efed4083c30 con 0x7efee40b96f0 2024-01-19T05:18:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.189+0000 7efee88e6640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efed0066500 0x7efed00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.189+0000 7efee88e6640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efed0066500 0x7efed00689c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efed80af000 tx=0x7efed80a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.193+0000 7efee1ffb640 1 -- 172.21.15.99:0/31865682 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efed4050f60 con 0x7efee40b96f0 2024-01-19T05:18:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.337+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efee40696e0 con 0x7efee40b96f0 2024-01-19T05:18:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.337+0000 7efee1ffb640 1 -- 172.21.15.99:0/31865682 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7efed4054580 con 0x7efee40b96f0 2024-01-19T05:18:18.340 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efed0066500 msgr2=0x7efed00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efed0066500 0x7efed00689c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efed80af000 tx=0x7efed80a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee40b96f0 msgr2=0x7efee409fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee40b96f0 0x7efee409fff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efed400c450 tx=0x7efed400c910 comp rx=0 tx=0).stop 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 shutdown_connections 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7efed0066500 0x7efed00689c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee414f1b0 0x7efee41382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee4140780 0x7efee40a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 --2- 172.21.15.99:0/31865682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efee40b96f0 0x7efee409fff0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 >> 172.21.15.99:0/31865682 conn(0x7efee409e600 msgr2=0x7efee40ba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 shutdown_connections 2024-01-19T05:18:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.341+0000 7efeeb34b640 1 -- 172.21.15.99:0/31865682 wait complete. 2024-01-19T05:18:18.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:18.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.473+0000 7fb7e58a8640 1 Processor -- start 2024-01-19T05:18:18.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.473+0000 7fb7e58a8640 1 -- start start 2024-01-19T05:18:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7e58a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e006ebe0 0x7fb7e0071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7e58a8640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb7e0072320 0x7fb7e014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7e58a8640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0070680 con 0x7fb7e00b19f0 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7e58a8640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e0070410 con 0x7fb7e0072320 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7e58a8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e006f040 con 0x7fb7e006ebe0 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7deffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb7e00b19f0 0x7fb7e0144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33402/0 (socket says 172.21.15.99:33402) 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7deffd640 1 -- 172.21.15.99:0/340204100 learned_addr learned my addr 172.21.15.99:0/340204100 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7df7fe640 1 --2- 172.21.15.99:0/340204100 >> v2:172.21.15.99:3300/0 conn(0x7fb7e0072320 0x7fb7e014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7ddffb640 1 -- 172.21.15.99:0/340204100 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878635384 0 0) 0x7fb7e0070680 con 0x7fb7e00b19f0 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7ddffb640 1 -- 172.21.15.99:0/340204100 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7cc003530 con 0x7fb7e00b19f0 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7de7fc640 1 --2- 172.21.15.99:0/340204100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e006ebe0 0x7fb7e0071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7df7fe640 1 -- 172.21.15.99:0/340204100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e006ebe0 msgr2=0x7fb7e0071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7df7fe640 1 --2- 172.21.15.99:0/340204100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e006ebe0 0x7fb7e0071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7ddffb640 1 -- 172.21.15.99:0/340204100 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 301908930 0 0) 0x7fb7cc003530 con 0x7fb7e00b19f0 2024-01-19T05:18:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7df7fe640 1 -- 172.21.15.99:0/340204100 >> v1:172.21.15.99:6789/0 conn(0x7fb7e00b19f0 legacy=0x7fb7e0144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7df7fe640 1 -- 172.21.15.99:0/340204100 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0144790 con 0x7fb7e0072320 2024-01-19T05:18:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7df7fe640 1 --2- 172.21.15.99:0/340204100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e0072320 0x7fb7e014ee90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0070810 tx=0x7fb7d801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779caa103e515d35 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7ddffb640 1 -- 172.21.15.99:0/340204100 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8001680 con 0x7fb7e0072320 2024-01-19T05:18:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7ddffb640 1 -- 172.21.15.99:0/340204100 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80a7050 con 0x7fb7e0072320 2024-01-19T05:18:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.477+0000 7fb7ddffb640 1 -- 172.21.15.99:0/340204100 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80ab620 con 0x7fb7e0072320 2024-01-19T05:18:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- 172.21.15.99:0/340204100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e0072320 msgr2=0x7fb7e014ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/340204100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e0072320 0x7fb7e014ee90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0070810 tx=0x7fb7d801c2e0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- 172.21.15.99:0/340204100 shutdown_connections 2024-01-19T05:18:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/340204100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e0072320 0x7fb7e014ee90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/340204100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e006ebe0 0x7fb7e0071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- 172.21.15.99:0/340204100 >> 172.21.15.99:0/340204100 conn(0x7fb7e00b8080 msgr2=0x7fb7e00b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- 172.21.15.99:0/340204100 shutdown_connections 2024-01-19T05:18:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- 172.21.15.99:0/340204100 wait complete. 2024-01-19T05:18:18.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 Processor -- start 2024-01-19T05:18:18.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- start start 2024-01-19T05:18:18.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e006ebe0 0x7fb7e0133360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e0072320 0x7fb7e01e0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e00b19f0 0x7fb7e013a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e01e0090 con 0x7fb7e00b19f0 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b7b80 con 0x7fb7e006ebe0 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0133c40 con 0x7fb7e0072320 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e00b19f0 0x7fb7e013a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e00b19f0 0x7fb7e013a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55500/0 (socket says 172.21.15.99:55500) 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 -- 172.21.15.99:0/2264633261 learned_addr learned my addr 172.21.15.99:0/2264633261 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7deffd640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e006ebe0 0x7fb7e0133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7de7fc640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e0072320 0x7fb7e01e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 -- 172.21.15.99:0/2264633261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e0072320 msgr2=0x7fb7e01e0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e0072320 0x7fb7e01e0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 -- 172.21.15.99:0/2264633261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e006ebe0 msgr2=0x7fb7e0133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e006ebe0 0x7fb7e0133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 -- 172.21.15.99:0/2264633261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d8009420 con 0x7fb7e00b19f0 2024-01-19T05:18:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7df7fe640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e00b19f0 0x7fb7e013a080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80ae040 tx=0x7fb7d801ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7d7fff640 1 -- 172.21.15.99:0/2264633261 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80b7450 con 0x7fb7e00b19f0 2024-01-19T05:18:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7d7fff640 1 -- 172.21.15.99:0/2264633261 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d80b75b0 con 0x7fb7e00b19f0 2024-01-19T05:18:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7d7fff640 1 -- 172.21.15.99:0/2264633261 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80b7920 con 0x7fb7e00b19f0 2024-01-19T05:18:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e01dfd20 con 0x7fb7e00b19f0 2024-01-19T05:18:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.481+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e0138ca0 con 0x7fb7e00b19f0 2024-01-19T05:18:18.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.485+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e01e0240 con 0x7fb7e00b19f0 2024-01-19T05:18:18.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.485+0000 7fb7d7fff640 1 -- 172.21.15.99:0/2264633261 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb7d80b7a80 con 0x7fb7e00b19f0 2024-01-19T05:18:18.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.485+0000 7fb7d7fff640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb7c0066500 0x7fb7c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.485+0000 7fb7d7fff640 1 -- 172.21.15.99:0/2264633261 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d811e7b0 con 0x7fb7e00b19f0 2024-01-19T05:18:18.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.485+0000 7fb7deffd640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb7c0066500 0x7fb7c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.485+0000 7fb7deffd640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb7c0066500 0x7fb7c00689c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8007a10 tx=0x7fb7c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.489+0000 7fb7d7fff640 1 -- 172.21.15.99:0/2264633261 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb7e01e0240 con 0x7fb7e00b19f0 2024-01-19T05:18:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7e01dfeb0 con 0x7fb7e00b19f0 2024-01-19T05:18:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7d7fff640 1 -- 172.21.15.99:0/2264633261 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7d80b00a0 con 0x7fb7e00b19f0 2024-01-19T05:18:18.647 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb7c0066500 msgr2=0x7fb7c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb7c0066500 0x7fb7c00689c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8007a10 tx=0x7fb7c8009040 comp rx=0 tx=0).stop 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e00b19f0 msgr2=0x7fb7e013a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e00b19f0 0x7fb7e013a080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80ae040 tx=0x7fb7d801ab20 comp rx=0 tx=0).stop 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 shutdown_connections 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb7c0066500 0x7fb7c00689c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7e00b19f0 0x7fb7e013a080 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb7e0072320 0x7fb7e01e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 --2- 172.21.15.99:0/2264633261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7e006ebe0 0x7fb7e0133360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 >> 172.21.15.99:0/2264633261 conn(0x7fb7e00b8080 msgr2=0x7fb7e00715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:18.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 shutdown_connections 2024-01-19T05:18:18.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.645+0000 7fb7e58a8640 1 -- 172.21.15.99:0/2264633261 wait complete. 2024-01-19T05:18:18.666 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.777+0000 7f4eb1cde640 1 Processor -- start 2024-01-19T05:18:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.777+0000 7f4eb1cde640 1 -- start start 2024-01-19T05:18:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eb1cde640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0b2ce0 0x7f4eac071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eb1cde640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4eac0b1870 0x7f4eac072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eb1cde640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac06f620 con 0x7f4eac143ac0 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eb1cde640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac141000 con 0x7f4eac0b1870 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eb1cde640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac143610 con 0x7f4eac0b2ce0 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4eac143ac0 0x7f4eac146a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33412/0 (socket says 172.21.15.99:33412) 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 -- 172.21.15.99:0/1969408608 learned_addr learned my addr 172.21.15.99:0/1969408608 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaaffd640 1 --2- 172.21.15.99:0/1969408608 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0b1870 0x7f4eac072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eab7fe640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0b2ce0 0x7f4eac071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114428604 0 0) 0x7f4eac06f620 con 0x7f4eac143ac0 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e8c003530 con 0x7f4eac143ac0 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2277040185 0 0) 0x7f4e8c003530 con 0x7f4eac143ac0 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0b2ce0 msgr2=0x7f4eac071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0b2ce0 0x7f4eac071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0b1870 msgr2=0x7f4eac072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 --2- 172.21.15.99:0/1969408608 >> v2:172.21.15.157:3300/0 conn(0x7f4eac0b1870 0x7f4eac072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0b30c0 con 0x7f4eac143ac0 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f4e9c001680 con 0x7f4eac143ac0 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 >> v1:172.21.15.99:6789/0 conn(0x7f4eac143ac0 legacy=0x7f4eac146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0b2ce0 0x7f4e8c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e8c003f00 0x7f4e8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8c004d10 0x7f4e8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac141000 con 0x7f4e8c004d10 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac143610 con 0x7f4e8c003f00 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c00b990 con 0x7f4eac0b2ce0 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8c004d10 0x7f4e8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eab7fe640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0b2ce0 0x7f4e8c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eaaffd640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e8c003f00 0x7f4e8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 -- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0b2ce0 msgr2=0x7f4e8c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac0b2ce0 0x7f4e8c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 -- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e8c003f00 msgr2=0x7f4e8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e8c003f00 0x7f4e8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 -- 172.21.15.99:0/1969408608 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c003530 con 0x7f4e8c004d10 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.781+0000 7f4eabfff640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8c004d10 0x7f4e8c005190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00c290 tx=0x7f4e9c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae9a5bf775eaaf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0a5950 con 0x7f4e8c004d10 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0a5ab0 con 0x7f4e8c004d10 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eaa7fc640 1 -- 172.21.15.99:0/1969408608 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0a5e60 con 0x7f4e8c004d10 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- 172.21.15.99:0/1969408608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8c004d10 msgr2=0x7f4e8c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 --2- 172.21.15.99:0/1969408608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8c004d10 0x7f4e8c005190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00c290 tx=0x7f4e9c01cc80 comp rx=0 tx=0).stop 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 -- 172.21.15.99:0/1969408608 reap_dead start 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- 172.21.15.99:0/1969408608 shutdown_connections 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- 172.21.15.99:0/1969408608 >> 172.21.15.99:0/1969408608 conn(0x7f4eac0b8080 msgr2=0x7f4eac0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- 172.21.15.99:0/1969408608 shutdown_connections 2024-01-19T05:18:18.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- 172.21.15.99:0/1969408608 wait complete. 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 Processor -- start 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- start start 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac1cec40 0x7f4eac0a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0a9c30 0x7f4eac0a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac1df3f0 0x7f4eac1df880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0ab7a0 con 0x7f4eac1df3f0 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac1cf020 con 0x7f4eac0a9c30 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0aa0c0 con 0x7f4eac1cec40 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac1df3f0 0x7f4eac1df880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac1df3f0 0x7f4eac1df880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55504/0 (socket says 172.21.15.99:55504) 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 -- 172.21.15.99:0/2064084805 learned_addr learned my addr 172.21.15.99:0/2064084805 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eaaffd640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0a9c30 0x7f4eac0a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eab7fe640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac1cec40 0x7f4eac0a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 -- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac1cec40 msgr2=0x7f4eac0a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac1cec40 0x7f4eac0a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 -- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0a9c30 msgr2=0x7f4eac0a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0a9c30 0x7f4eac0a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 -- 172.21.15.99:0/2064084805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0ab430 con 0x7f4eac1df3f0 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eaaffd640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0a9c30 0x7f4eac0a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eabfff640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac1df3f0 0x7f4eac1df880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c01b390 tx=0x7f4e8c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4ea3fff640 1 -- 172.21.15.99:0/2064084805 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0a5950 con 0x7f4eac1df3f0 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4ea3fff640 1 -- 172.21.15.99:0/2064084805 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0072d0 con 0x7f4eac1df3f0 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac0b7b50 con 0x7f4eac1df3f0 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4ea3fff640 1 -- 172.21.15.99:0/2064084805 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c007660 con 0x7f4eac1df3f0 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac0aae50 con 0x7f4eac1df3f0 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.785+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac0ab910 con 0x7f4eac1df3f0 2024-01-19T05:18:18.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.789+0000 7f4ea3fff640 1 -- 172.21.15.99:0/2064084805 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4e9c0ae430 con 0x7f4eac1df3f0 2024-01-19T05:18:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.789+0000 7f4ea3fff640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4e90066500 0x7f4e900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.789+0000 7f4eab7fe640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4e90066500 0x7f4e900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.789+0000 7f4ea3fff640 1 -- 172.21.15.99:0/2064084805 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e9c0b4070 con 0x7f4eac1df3f0 2024-01-19T05:18:18.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.789+0000 7f4eab7fe640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4e90066500 0x7f4e900689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009970 tx=0x7f4e94008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:18.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.793+0000 7f4ea3fff640 1 -- 172.21.15.99:0/2064084805 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4e9c0eac30 con 0x7f4eac1df3f0 2024-01-19T05:18:18.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.981+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4eac0696e0 con 0x7f4eac1df3f0 2024-01-19T05:18:18.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.981+0000 7f4ea3fff640 1 -- 172.21.15.99:0/2064084805 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3352 (secure 0 0 0) 0x7f4e9c001c90 con 0x7f4eac1df3f0 2024-01-19T05:18:18.984 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:18.985 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:02.994909+0000","modified":"2024-01-19T05:18:04.990494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:18:18.985 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-19T05:18:18.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4e90066500 msgr2=0x7f4e900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4e90066500 0x7f4e900689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009970 tx=0x7f4e94008040 comp rx=0 tx=0).stop 2024-01-19T05:18:18.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac1df3f0 msgr2=0x7f4eac1df880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac1df3f0 0x7f4eac1df880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c01b390 tx=0x7f4e8c005800 comp rx=0 tx=0).stop 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 shutdown_connections 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4e90066500 0x7f4e900689c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eac1df3f0 0x7f4eac1df880 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4eac0a9c30 0x7f4eac0a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 --2- 172.21.15.99:0/2064084805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4eac1cec40 0x7f4eac0a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 >> 172.21.15.99:0/2064084805 conn(0x7f4eac0b8080 msgr2=0x7f4eac0b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 shutdown_connections 2024-01-19T05:18:18.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:18.985+0000 7f4eb1cde640 1 -- 172.21.15.99:0/2064084805 wait complete. 2024-01-19T05:18:19.002 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:19.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.105+0000 7f8680200640 1 Processor -- start 2024-01-19T05:18:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.105+0000 7f8680200640 1 -- start start 2024-01-19T05:18:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.105+0000 7f8680200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86780b96f0 0x7f86780b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.105+0000 7f8680200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b7c40 0x7f8678140780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.105+0000 7f8680200640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780b87f0 con 0x7f8678140cc0 2024-01-19T05:18:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.105+0000 7f8680200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8678141150 con 0x7f86780b96f0 2024-01-19T05:18:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.105+0000 7f8680200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780b9ad0 con 0x7f86780b7c40 2024-01-19T05:18:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.105+0000 7f867df9c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86780b96f0 0x7f86780b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867df9c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86780b96f0 0x7f86780b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55520/0 (socket says 172.21.15.99:55520) 2024-01-19T05:18:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867df9c640 1 -- 172.21.15.99:0/3466914632 learned_addr learned my addr 172.21.15.99:0/3466914632 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867d79b640 1 --2- 172.21.15.99:0/3466914632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b7c40 0x7f8678140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867df9c640 1 -- 172.21.15.99:0/3466914632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b7c40 msgr2=0x7f8678140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867df9c640 1 --2- 172.21.15.99:0/3466914632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b7c40 0x7f8678140780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867df9c640 1 -- 172.21.15.99:0/3466914632 >> v1:172.21.15.157:6789/0 conn(0x7f8678140cc0 legacy=0x7f8678149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867df9c640 1 -- 172.21.15.99:0/3466914632 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780b81e0 con 0x7f86780b96f0 2024-01-19T05:18:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867d79b640 1 --2- 172.21.15.99:0/3466914632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b7c40 0x7f8678140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:19.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867df9c640 1 --2- 172.21.15.99:0/3466914632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b96f0 0x7f86780b7700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f867401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78622faa0ac788de server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867cf9a640 1 -- 172.21.15.99:0/3466914632 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740ac640 con 0x7f86780b96f0 2024-01-19T05:18:19.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867cf9a640 1 -- 172.21.15.99:0/3466914632 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740ac7a0 con 0x7f86780b96f0 2024-01-19T05:18:19.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f867cf9a640 1 -- 172.21.15.99:0/3466914632 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740acb30 con 0x7f86780b96f0 2024-01-19T05:18:19.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f8680200640 1 -- 172.21.15.99:0/3466914632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b96f0 msgr2=0x7f86780b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f8680200640 1 --2- 172.21.15.99:0/3466914632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b96f0 0x7f86780b7700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f867401c500 comp rx=0 tx=0).stop 2024-01-19T05:18:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f8680200640 1 -- 172.21.15.99:0/3466914632 shutdown_connections 2024-01-19T05:18:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f8680200640 1 --2- 172.21.15.99:0/3466914632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b7c40 0x7f8678140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f8680200640 1 --2- 172.21.15.99:0/3466914632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b96f0 0x7f86780b7700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f8680200640 1 -- 172.21.15.99:0/3466914632 >> 172.21.15.99:0/3466914632 conn(0x7f867809e600 msgr2=0x7f86780b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f8680200640 1 -- 172.21.15.99:0/3466914632 shutdown_connections 2024-01-19T05:18:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.109+0000 7f8680200640 1 -- 172.21.15.99:0/3466914632 wait complete. 2024-01-19T05:18:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 Processor -- start 2024-01-19T05:18:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 -- start start 2024-01-19T05:18:19.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b7c40 0x7f8678138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b96f0 0x7f867809fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678140cc0 0x7f86780b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8678138e60 con 0x7f86780b7c40 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780b23c0 con 0x7f8678140cc0 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867809d420 con 0x7f86780b96f0 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b7c40 0x7f8678138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b7c40 0x7f8678138920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55528/0 (socket says 172.21.15.99:55528) 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 -- 172.21.15.99:0/3152014635 learned_addr learned my addr 172.21.15.99:0/3152014635 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867d79b640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b96f0 0x7f867809fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867e79d640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678140cc0 0x7f86780b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 -- 172.21.15.99:0/3152014635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b96f0 msgr2=0x7f867809fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b96f0 0x7f867809fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 -- 172.21.15.99:0/3152014635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678140cc0 msgr2=0x7f86780b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678140cc0 0x7f86780b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 -- 172.21.15.99:0/3152014635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740094d0 con 0x7f86780b7c40 2024-01-19T05:18:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f867df9c640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b7c40 0x7f8678138920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f86740af040 tx=0x7f86740192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f866e7fc640 1 -- 172.21.15.99:0/3152014635 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740ba070 con 0x7f86780b7c40 2024-01-19T05:18:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867809f640 con 0x7f86780b7c40 2024-01-19T05:18:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f866e7fc640 1 -- 172.21.15.99:0/3152014635 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740ab6f0 con 0x7f86780b7c40 2024-01-19T05:18:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f866e7fc640 1 -- 172.21.15.99:0/3152014635 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740abac0 con 0x7f86780b7c40 2024-01-19T05:18:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867809cc20 con 0x7f86780b7c40 2024-01-19T05:18:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86780696e0 con 0x7f86780b7c40 2024-01-19T05:18:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.113+0000 7f866e7fc640 1 -- 172.21.15.99:0/3152014635 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f86740b3070 con 0x7f86780b7c40 2024-01-19T05:18:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.117+0000 7f866e7fc640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f865c066530 0x7f865c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.117+0000 7f866e7fc640 1 -- 172.21.15.99:0/3152014635 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f867411e450 con 0x7f86780b7c40 2024-01-19T05:18:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.117+0000 7f867d79b640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f865c066530 0x7f865c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.117+0000 7f867d79b640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f865c066530 0x7f865c0689f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f86781521a0 tx=0x7f8668008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.121+0000 7f866e7fc640 1 -- 172.21.15.99:0/3152014635 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f86740eb7a0 con 0x7f86780b7c40 2024-01-19T05:18:19.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.265+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8678099e10 con 0x7f86780b7c40 2024-01-19T05:18:19.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.265+0000 7f866e7fc640 1 -- 172.21.15.99:0/3152014635 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f86740b1090 con 0x7f86780b7c40 2024-01-19T05:18:19.269 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:19.269 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:19.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f865c066530 msgr2=0x7f865c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f865c066530 0x7f865c0689f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f86781521a0 tx=0x7f8668008040 comp rx=0 tx=0).stop 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b7c40 msgr2=0x7f8678138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b7c40 0x7f8678138920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f86740af040 tx=0x7f86740192a0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 shutdown_connections 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f865c066530 0x7f865c0689f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678140cc0 0x7f86780b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780b96f0 0x7f867809fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 --2- 172.21.15.99:0/3152014635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86780b7c40 0x7f8678138920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 >> 172.21.15.99:0/3152014635 conn(0x7f867809e600 msgr2=0x7f86780ba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 shutdown_connections 2024-01-19T05:18:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.269+0000 7f8680200640 1 -- 172.21.15.99:0/3152014635 wait complete. 2024-01-19T05:18:19.287 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe91e128640 1 Processor -- start 2024-01-19T05:18:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe91e128640 1 -- start start 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe91e128640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe91806ebe0 0x7fe918071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe91e128640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe918072320 0x7fe91814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe91e128640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91806f070 con 0x7fe9180b19f0 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe91e128640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe918070680 con 0x7fe918072320 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe91e128640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe918070410 con 0x7fe91806ebe0 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe917fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe918072320 0x7fe91814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe9177fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe9180b19f0 0x7fe918144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33416/0 (socket says 172.21.15.99:33416) 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe9177fe640 1 -- 172.21.15.99:0/3642020433 learned_addr learned my addr 172.21.15.99:0/3642020433 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe916ffd640 1 --2- 172.21.15.99:0/3642020433 >> v2:172.21.15.157:3300/0 conn(0x7fe91806ebe0 0x7fe918071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe917fff640 1 -- 172.21.15.99:0/3642020433 >> v2:172.21.15.157:3300/0 conn(0x7fe91806ebe0 msgr2=0x7fe918071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe917fff640 1 --2- 172.21.15.99:0/3642020433 >> v2:172.21.15.157:3300/0 conn(0x7fe91806ebe0 0x7fe918071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe9167fc640 1 -- 172.21.15.99:0/3642020433 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192775933 0 0) 0x7fe9100014a0 con 0x7fe9180b19f0 2024-01-19T05:18:19.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe917fff640 1 -- 172.21.15.99:0/3642020433 >> v1:172.21.15.99:6789/0 conn(0x7fe9180b19f0 legacy=0x7fe918144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.393+0000 7fe917fff640 1 -- 172.21.15.99:0/3642020433 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918144790 con 0x7fe918072320 2024-01-19T05:18:19.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe917fff640 1 --2- 172.21.15.99:0/3642020433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918072320 0x7fe91814ee90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe918072cc0 tx=0x7fe90801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca3c608f5b03568 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe9167fc640 1 -- 172.21.15.99:0/3642020433 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080ac620 con 0x7fe918072320 2024-01-19T05:18:19.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe9167fc640 1 -- 172.21.15.99:0/3642020433 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9080ac780 con 0x7fe918072320 2024-01-19T05:18:19.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe9167fc640 1 -- 172.21.15.99:0/3642020433 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080acb10 con 0x7fe918072320 2024-01-19T05:18:19.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe91e128640 1 -- 172.21.15.99:0/3642020433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918072320 msgr2=0x7fe91814ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe91e128640 1 --2- 172.21.15.99:0/3642020433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918072320 0x7fe91814ee90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe918072cc0 tx=0x7fe90801c3a0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe91e128640 1 -- 172.21.15.99:0/3642020433 shutdown_connections 2024-01-19T05:18:19.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe91e128640 1 --2- 172.21.15.99:0/3642020433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918072320 0x7fe91814ee90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe91e128640 1 --2- 172.21.15.99:0/3642020433 >> v2:172.21.15.157:3300/0 conn(0x7fe91806ebe0 0x7fe918071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe91e128640 1 -- 172.21.15.99:0/3642020433 >> 172.21.15.99:0/3642020433 conn(0x7fe9180b8080 msgr2=0x7fe9180b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe91e128640 1 -- 172.21.15.99:0/3642020433 shutdown_connections 2024-01-19T05:18:19.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.397+0000 7fe91e128640 1 -- 172.21.15.99:0/3642020433 wait complete. 2024-01-19T05:18:19.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 Processor -- start 2024-01-19T05:18:19.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 -- start start 2024-01-19T05:18:19.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91806ebe0 0x7fe9180a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918072320 0x7fe918140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9180b19f0 0x7fe9181dd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe918141690 con 0x7fe9180b19f0 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181dcc70 con 0x7fe918072320 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91813e520 con 0x7fe91806ebe0 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9180b19f0 0x7fe9181dd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9180b19f0 0x7fe9181dd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55540/0 (socket says 172.21.15.99:55540) 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 -- 172.21.15.99:0/1495880815 learned_addr learned my addr 172.21.15.99:0/1495880815 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe916ffd640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918072320 0x7fe918140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe9177fe640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91806ebe0 0x7fe9180a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 -- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91806ebe0 msgr2=0x7fe9180a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91806ebe0 0x7fe9180a8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 -- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918072320 msgr2=0x7fe918140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918072320 0x7fe918140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 -- 172.21.15.99:0/1495880815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908009420 con 0x7fe9180b19f0 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe9177fe640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91806ebe0 0x7fe9180a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe916ffd640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918072320 0x7fe918140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe917fff640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9180b19f0 0x7fe9181dd3a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe9080af040 tx=0x7fe908019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe90ffff640 1 -- 172.21.15.99:0/1495880815 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080b5410 con 0x7fe9180b19f0 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe90ffff640 1 -- 172.21.15.99:0/1495880815 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9080b5590 con 0x7fe9180b19f0 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe918140420 con 0x7fe9180b19f0 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe90ffff640 1 -- 172.21.15.99:0/1495880815 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080b5940 con 0x7fe9180b19f0 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9181dce80 con 0x7fe9180b19f0 2024-01-19T05:18:19.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9180aa150 con 0x7fe9180b19f0 2024-01-19T05:18:19.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe90ffff640 1 -- 172.21.15.99:0/1495880815 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe9080b3040 con 0x7fe9180b19f0 2024-01-19T05:18:19.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.401+0000 7fe90ffff640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe8f8066500 0x7fe8f80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.405+0000 7fe90ffff640 1 -- 172.21.15.99:0/1495880815 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe90811e880 con 0x7fe9180b19f0 2024-01-19T05:18:19.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.405+0000 7fe9177fe640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe8f8066500 0x7fe8f80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.405+0000 7fe9177fe640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe8f8066500 0x7fe8f80689c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9100012f0 tx=0x7fe910009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.405+0000 7fe90ffff640 1 -- 172.21.15.99:0/1495880815 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe9080ebb70 con 0x7fe9180b19f0 2024-01-19T05:18:19.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe91806a870 con 0x7fe9180b19f0 2024-01-19T05:18:19.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe90ffff640 1 -- 172.21.15.99:0/1495880815 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3352 (secure 0 0 0) 0x7fe9080b1090 con 0x7fe9180b19f0 2024-01-19T05:18:19.599 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:02.994909+0000","modified":"2024-01-19T05:18:04.990494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:18:19.600 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-19T05:18:19.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe8f8066500 msgr2=0x7fe8f80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe8f8066500 0x7fe8f80689c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9100012f0 tx=0x7fe910009040 comp rx=0 tx=0).stop 2024-01-19T05:18:19.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9180b19f0 msgr2=0x7fe9181dd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9180b19f0 0x7fe9181dd3a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe9080af040 tx=0x7fe908019140 comp rx=0 tx=0).stop 2024-01-19T05:18:19.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 shutdown_connections 2024-01-19T05:18:19.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe8f8066500 0x7fe8f80689c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9180b19f0 0x7fe9181dd3a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918072320 0x7fe918140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 --2- 172.21.15.99:0/1495880815 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe91806ebe0 0x7fe9180a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 >> 172.21.15.99:0/1495880815 conn(0x7fe9180b8080 msgr2=0x7fe9181437a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 shutdown_connections 2024-01-19T05:18:19.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.597+0000 7fe91e128640 1 -- 172.21.15.99:0/1495880815 wait complete. 2024-01-19T05:18:19.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-19T05:18:02.994909+0000', 'modified': '2024-01-19T05:18:04.990494+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4232}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4232': {'gid': 4232, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6833/355732632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 355732632}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 355732632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-19T05:18:19.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-19T05:18:19.818 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-19T05:18:19.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc9057d9640 1 Processor -- start 2024-01-19T05:18:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc9057d9640 1 -- start start 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc9057d9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc90006e0c0 0x7fc900146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc9057d9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9001472e0 con 0x7fc900149ea0 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc9057d9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900071bf0 con 0x7fc900146e70 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc9057d9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90006e4a0 con 0x7fc90006e0c0 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8fe7fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc900149ea0 0x7fc900070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33422/0 (socket says 172.21.15.99:33422) 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8fe7fc640 1 -- 172.21.15.99:0/2647447824 learned_addr learned my addr 172.21.15.99:0/2647447824 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8feffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc90006e0c0 0x7fc900146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8fdffb640 1 -- 172.21.15.99:0/2647447824 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383339721 0 0) 0x7fc9001472e0 con 0x7fc900149ea0 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8fdffb640 1 -- 172.21.15.99:0/2647447824 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e8003530 con 0x7fc900149ea0 2024-01-19T05:18:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8feffd640 1 -- 172.21.15.99:0/2647447824 >> v1:172.21.15.157:6789/0 conn(0x7fc900146e70 legacy=0x7fc9000714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8fdffb640 1 -- 172.21.15.99:0/2647447824 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862893225 0 0) 0x7fc8e8003530 con 0x7fc900149ea0 2024-01-19T05:18:19.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8feffd640 1 -- 172.21.15.99:0/2647447824 >> v1:172.21.15.99:6789/0 conn(0x7fc900149ea0 legacy=0x7fc900070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.945+0000 7fc8feffd640 1 -- 172.21.15.99:0/2647447824 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90014a410 con 0x7fc90006e0c0 2024-01-19T05:18:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 --2- 172.21.15.99:0/2647447824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc900146930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00097c0 tx=0x7fc8f001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d23e471ca46be7f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8fdffb640 1 -- 172.21.15.99:0/2647447824 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4001680 con 0x7fc90006e0c0 2024-01-19T05:18:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8fdffb640 1 -- 172.21.15.99:0/2647447824 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f00a7050 con 0x7fc90006e0c0 2024-01-19T05:18:19.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8fdffb640 1 -- 172.21.15.99:0/2647447824 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00ab600 con 0x7fc90006e0c0 2024-01-19T05:18:19.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- 172.21.15.99:0/2647447824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 msgr2=0x7fc900146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 --2- 172.21.15.99:0/2647447824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc900146930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00097c0 tx=0x7fc8f001c2e0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- 172.21.15.99:0/2647447824 shutdown_connections 2024-01-19T05:18:19.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 --2- 172.21.15.99:0/2647447824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc900146930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- 172.21.15.99:0/2647447824 >> 172.21.15.99:0/2647447824 conn(0x7fc9000ba500 msgr2=0x7fc9000ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- 172.21.15.99:0/2647447824 shutdown_connections 2024-01-19T05:18:19.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- 172.21.15.99:0/2647447824 wait complete. 2024-01-19T05:18:19.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 Processor -- start 2024-01-19T05:18:19.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- start start 2024-01-19T05:18:19.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc9001df160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc900146e70 0x7fc9000afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900149ea0 0x7fc9000b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9001e0110 con 0x7fc90006e0c0 2024-01-19T05:18:19.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9000b0340 con 0x7fc900146e70 2024-01-19T05:18:19.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9000af250 con 0x7fc900149ea0 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc9001df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc9001df160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55554/0 (socket says 172.21.15.99:55554) 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 -- 172.21.15.99:0/2271321351 learned_addr learned my addr 172.21.15.99:0/2271321351 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 -- 172.21.15.99:0/2271321351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900149ea0 msgr2=0x7fc9000b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900149ea0 0x7fc9000b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 -- 172.21.15.99:0/2271321351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc900146e70 msgr2=0x7fc9000afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc900146e70 0x7fc9000afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 -- 172.21.15.99:0/2271321351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0009420 con 0x7fc90006e0c0 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8feffd640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc9001df160 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0019f10 tx=0x7fc8f0019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8e77fe640 1 -- 172.21.15.99:0/2271321351 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0003ab0 con 0x7fc90006e0c0 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8e77fe640 1 -- 172.21.15.99:0/2271321351 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f0003c10 con 0x7fc90006e0c0 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- 172.21.15.99:0/2271321351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9000af530 con 0x7fc90006e0c0 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc8e77fe640 1 -- 172.21.15.99:0/2271321351 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00b4400 con 0x7fc90006e0c0 2024-01-19T05:18:19.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.949+0000 7fc9057d9640 1 -- 172.21.15.99:0/2271321351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9001df6a0 con 0x7fc90006e0c0 2024-01-19T05:18:19.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8e77fe640 1 -- 172.21.15.99:0/2271321351 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc8f00b2040 con 0x7fc90006e0c0 2024-01-19T05:18:19.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8e77fe640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc8ec066500 0x7fc8ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8e77fe640 1 -- 172.21.15.99:0/2271321351 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8f011dd80 con 0x7fc90006e0c0 2024-01-19T05:18:19.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8fe7fc640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc8ec066500 0x7fc8ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8fe7fc640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc8ec066500 0x7fc8ec0689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4000c10 tx=0x7fc8f40011b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc908936000 1 Processor -- start 2024-01-19T05:18:19.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc908936000 1 -- start start 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc908936000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc908936000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 0x5557485f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc908936000 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc908936000 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574841dd70 con 0x5557485f21c0 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc908936000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555748419ba0 con 0x5557485ed130 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc908936000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557484170d0 con 0x5557485ec810 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8ff7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8ff7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55556/0 (socket says 172.21.15.99:55556) 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/203232700 learned_addr learned my addr 172.21.15.99:0/203232700 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8feffd640 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8fe7fc640 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 0x5557485f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/203232700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 msgr2=0x5557485ecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485ecbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/203232700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 msgr2=0x5557485f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 0x5557485f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.953+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/203232700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555748109890 con 0x5557485f21c0 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f25a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8001bc0 tx=0x7fc8f8002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac1a146b1820bc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8e4ff9640 1 -- 172.21.15.99:0/203232700 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8006d60 con 0x5557485f21c0 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8e4ff9640 1 -- 172.21.15.99:0/203232700 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f800c990 con 0x5557485f21c0 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8e4ff9640 1 -- 172.21.15.99:0/203232700 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800cd80 con 0x5557485f21c0 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- 172.21.15.99:0/203232700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 msgr2=0x5557485f25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f25a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8001bc0 tx=0x7fc8f8002080 comp rx=0 tx=0).stop 2024-01-19T05:18:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- 172.21.15.99:0/203232700 shutdown_connections 2024-01-19T05:18:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f25a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 0x5557485f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 --2- 172.21.15.99:0/203232700 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- 172.21.15.99:0/203232700 >> 172.21.15.99:0/203232700 conn(0x5557485eda30 msgr2=0x5557485efe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- 172.21.15.99:0/203232700 shutdown_connections 2024-01-19T05:18:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- 172.21.15.99:0/203232700 wait complete. 2024-01-19T05:18:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- start start 2024-01-19T05:18:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 Processor -- start 2024-01-19T05:18:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 0x5557485f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557484129c0 con 0x5557485f21c0 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557483ca040 con 0x5557485ed130 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557483cfee0 con 0x5557485ec810 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 10 client.0 _ll_register_callbacks cb 0x5557483cd1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55568/0 (socket says 172.21.15.99:55568) 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/297449502 learned_addr learned my addr 172.21.15.99:0/297449502 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8fe7fc640 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 0x5557485f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8feffd640 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 msgr2=0x5557485c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 msgr2=0x5557485f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 0x5557485f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/297449502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc900071bf0 con 0x5557485f21c0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8feffd640 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f84c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8014040 tx=0x7fc8f8001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bccf5024ad3b85 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ddffb640 1 -- 172.21.15.99:0/297449502 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8003e50 con 0x5557485f21c0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ddffb640 1 -- 172.21.15.99:0/297449502 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8f800c990 con 0x5557485f21c0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- 172.21.15.99:0/297449502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555748398e30 con 0x5557485f21c0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ddffb640 1 -- 172.21.15.99:0/297449502 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8f800cb50 con 0x5557485f21c0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 10 client.4647 fetch_fsmap learned FSMap version 6 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- 172.21.15.99:0/297449502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5557483d25e0 con 0x5557485f21c0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ddffb640 1 -- 172.21.15.99:0/297449502 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555748398e30 con 0x5557485f21c0 2024-01-19T05:18:19.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8ddffb640 1 -- 172.21.15.99:0/297449502 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 6) v1 ==== 2144+0+0 (secure 0 0 0) 0x7fc8f800ccb0 con 0x5557485f21c0 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 10 client.4647 fetch_fsmap finished waiting for FSMap version 6 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 10 client.4647 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 20 client.4647 populate_metadata read hostname 'smithi099' 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] conn(0x5557485f8a00 0x5557485f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 4 client.4647 mds_command: new command op to 4232 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc908936000 1 -- 172.21.15.99:0/297449502 --> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557483cf870 con 0x5557485f8a00 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.957+0000 7fc8feffd640 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] conn(0x5557485f8a00 0x5557485f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc8ddffb640 10 client.4647 ms_handle_connect on v2:172.21.15.157:6832/355732632 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc8feffd640 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] conn(0x5557485f8a00 0x5557485f8de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81a8f6e2f12f9583 server_cookie=20e8409edc346e5e in_seq=0 out_seq=0 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc8ddffb640 1 -- 172.21.15.99:0/297449502 <== mds.0 v2:172.21.15.157:6832/355732632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5557483cf870 con 0x5557485f8a00 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc8ddffb640 10 client.4647 handle_command_reply: tid=0 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 client.4647 shutdown 2024-01-19T05:18:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 -- 172.21.15.99:0/297449502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 msgr2=0x5557485f84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f84c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8014040 tx=0x7fc8f8001520 comp rx=0 tx=0).stop 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 -- 172.21.15.99:0/297449502 shutdown_connections 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] conn(0x5557485f8a00 0x5557485f8de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f21c0 0x5557485f84c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485ed130 0x5557485f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc8ddffb640 0 client.4647 ms_handle_reset on v2:172.21.15.157:6832/355732632 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 --2- 172.21.15.99:0/297449502 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x5557485c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 -- 172.21.15.99:0/297449502 >> 172.21.15.99:0/297449502 conn(0x5557485eda30 msgr2=0x5557485c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 -- 172.21.15.99:0/297449502 shutdown_connections 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 1 -- 172.21.15.99:0/297449502 wait complete. 2024-01-19T05:18:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.961+0000 7fc908936000 20 client.4647 trim_cache size 0 max 16384 2024-01-19T05:18:19.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 Processor -- start 2024-01-19T05:18:19.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- start start 2024-01-19T05:18:19.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485f3160 0x5557485f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485eda30 0x5557485c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485ec810 0x5557485c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557480ca940 con 0x5557485ec810 2024-01-19T05:18:19.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574841a5f0 con 0x5557485f3160 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55574840e330 con 0x5557485eda30 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485ec810 0x5557485c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485ec810 0x5557485c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55572/0 (socket says 172.21.15.99:55572) 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/514126825 learned_addr learned my addr 172.21.15.99:0/514126825 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8fe7fc640 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485eda30 0x5557485c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8feffd640 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485f3160 0x5557485f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/514126825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485eda30 msgr2=0x5557485c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485eda30 0x5557485c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/514126825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485f3160 msgr2=0x5557485f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485f3160 0x5557485f7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/514126825 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557483b88e0 con 0x5557485ec810 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485ec810 0x5557485c6100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8001ae0 tx=0x7fc8f801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651c71f8c88ccb4a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8dffff640 1 -- 172.21.15.99:0/514126825 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800c990 con 0x5557485ec810 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8dffff640 1 -- 172.21.15.99:0/514126825 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f800b030 con 0x5557485ec810 2024-01-19T05:18:19.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8dffff640 1 -- 172.21.15.99:0/514126825 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800cd90 con 0x5557485ec810 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/514126825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485ec810 msgr2=0x5557485c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485ec810 0x5557485c6100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8001ae0 tx=0x7fc8f801e000 comp rx=0 tx=0).stop 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/514126825 shutdown_connections 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485ec810 0x5557485c6100 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485eda30 0x5557485c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/514126825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485f3160 0x5557485f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/514126825 >> 172.21.15.99:0/514126825 conn(0x5557485be320 msgr2=0x5557485fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/514126825 shutdown_connections 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/514126825 wait complete. 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- start start 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 Processor -- start 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x555748627d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485eda30 0x555748628270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f3160 0x5557486287b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574840ccc0 con 0x5557485f3160 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557483dbe30 con 0x5557485eda30 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557483d4720 con 0x5557485ec810 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 10 client.0 _ll_register_callbacks cb 0x55574840c130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f3160 0x5557486287b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f3160 0x5557486287b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55588/0 (socket says 172.21.15.99:55588) 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/3740967673 learned_addr learned my addr 172.21.15.99:0/3740967673 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8feffd640 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x555748627d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 msgr2=0x555748627d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8fe7fc640 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485eda30 0x555748628270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x555748627d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485eda30 msgr2=0x555748628270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485eda30 0x555748628270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 -- 172.21.15.99:0/3740967673 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557483d25e0 con 0x5557485f3160 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ff7fe640 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f3160 0x5557486287b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8001230 tx=0x7fc8f8001720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4e6d29ba8a8974 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 1 -- 172.21.15.99:0/3740967673 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f801e4c0 con 0x5557485f3160 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 1 -- 172.21.15.99:0/3740967673 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8f801e620 con 0x5557485f3160 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/3740967673 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557483c44f0 con 0x5557485f3160 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 1 -- 172.21.15.99:0/3740967673 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8f801e800 con 0x5557485f3160 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 10 client.4653 fetch_fsmap learned FSMap version 6 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/3740967673 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x555748109cc0 con 0x5557485f3160 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 1 -- 172.21.15.99:0/3740967673 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557483c44f0 con 0x5557485f3160 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 1 -- 172.21.15.99:0/3740967673 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 6) v1 ==== 2144+0+0 (secure 0 0 0) 0x7fc8f8012ce0 con 0x5557485f3160 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 10 client.4653 fetch_fsmap finished waiting for FSMap version 6 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-19T05:18:19.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 20 client.4653 populate_metadata read hostname 'smithi099' 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] conn(0x5557485ed130 0x55574865f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 4 client.4653 mds_command: new command op to 4232 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/3740967673 --> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555748411310 con 0x5557485ed130 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8feffd640 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] conn(0x5557485ed130 0x55574865f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 10 client.4653 ms_handle_connect on v2:172.21.15.157:6832/355732632 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8feffd640 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] conn(0x5557485ed130 0x55574865f8c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce7e98c478c81a9a server_cookie=8b2bda232b4f516a in_seq=0 out_seq=0 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 1 -- 172.21.15.99:0/3740967673 <== mds.0 v2:172.21.15.157:6832/355732632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555748411310 con 0x5557485ed130 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 10 client.4653 handle_command_reply: tid=0 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 client.4653 shutdown 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/3740967673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f3160 msgr2=0x5557486287b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f3160 0x5557486287b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8001230 tx=0x7fc8f8001720 comp rx=0 tx=0).stop 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/3740967673 shutdown_connections 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:6832/355732632,v1:172.21.15.157:6833/355732632] conn(0x5557485ed130 0x55574865f8c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557485f3160 0x5557486287b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc8ddffb640 0 client.4653 ms_handle_reset on v2:172.21.15.157:6832/355732632 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557485eda30 0x555748628270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 --2- 172.21.15.99:0/3740967673 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5557485ec810 0x555748627d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/3740967673 >> 172.21.15.99:0/3740967673 conn(0x5557485be320 msgr2=0x5557485c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/3740967673 shutdown_connections 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 1 -- 172.21.15.99:0/3740967673 wait complete. 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc908936000 20 client.4653 trim_cache size 0 max 16384 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "7f059d9d-1406-48ae-9584-fdafb673a966", 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-01-19T05:18:19.991 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4232, 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 16.322492254, 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 6, 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 20, 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 20, 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 23.109957046000002 2024-01-19T05:18:19.992 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:18:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 -- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc8ec066500 msgr2=0x7fc8ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc8ec066500 0x7fc8ec0689c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4000c10 tx=0x7fc8f40011b0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 -- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 msgr2=0x7fc9001df160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc9001df160 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0019f10 tx=0x7fc8f0019080 comp rx=0 tx=0).stop 2024-01-19T05:18:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 -- 172.21.15.99:0/2271321351 shutdown_connections 2024-01-19T05:18:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc8ec066500 0x7fc8ec0689c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc900149ea0 0x7fc9000b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc900146e70 0x7fc9000afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 --2- 172.21.15.99:0/2271321351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc90006e0c0 0x7fc9001df160 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 -- 172.21.15.99:0/2271321351 >> 172.21.15.99:0/2271321351 conn(0x7fc9000ba500 msgr2=0x7fc9000b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 -- 172.21.15.99:0/2271321351 shutdown_connections 2024-01-19T05:18:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:19.981+0000 7fc9057d9640 1 -- 172.21.15.99:0/2271321351 wait complete. 2024-01-19T05:18:20.000 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-01-19T05:18:20.027 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-01-19T05:18:20.027 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-01-19T05:18:20.027 INFO:tasks.ceph_fuse:client.0 config is {} 2024-01-19T05:18:20.027 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-19T05:18:20.027 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:20.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.027 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-01-19T05:18:20.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.035 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-01-19T05:18:20.084 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-01-19T05:18:20.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:18:20.085 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-01-19T05:18:20.085 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T05:18:20.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6332e28640 1 Processor -- start 2024-01-19T05:18:20.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6332e28640 1 -- start start 2024-01-19T05:18:20.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6332e28640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f632c0b4500 0x7f632c142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:20.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6332e28640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c1433d0 0x7f632c143880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:20.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6332e28640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632c06ed10 con 0x7f632c0b1120 2024-01-19T05:18:20.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6332e28640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632c0b22b0 con 0x7f632c0b4500 2024-01-19T05:18:20.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6332e28640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0b16d0 con 0x7f632c1433d0 2024-01-19T05:18:20.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f63313c5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c1433d0 0x7f632c143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f632bfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f632c0b4500 0x7f632c142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6330bc4640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f632c0b1120 0x7f632c0b3df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:33450/0 (socket says 172.21.15.99:33450) 2024-01-19T05:18:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f6330bc4640 1 -- 172.21.15.99:0/3321994426 learned_addr learned my addr 172.21.15.99:0/3321994426 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f632bfff640 1 -- 172.21.15.99:0/3321994426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c1433d0 msgr2=0x7f632c143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f632bfff640 1 --2- 172.21.15.99:0/3321994426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c1433d0 0x7f632c143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f632bfff640 1 -- 172.21.15.99:0/3321994426 >> v1:172.21.15.157:6789/0 conn(0x7f632c0b1120 legacy=0x7f632c0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:20.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.241+0000 7f632bfff640 1 -- 172.21.15.99:0/3321994426 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0721c0 con 0x7f632c0b4500 2024-01-19T05:18:20.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f632bfff640 1 --2- 172.21.15.99:0/3321994426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 0x7f632c142e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63200097f0 tx=0x7f632001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b366838950f42775 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:20.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f632b7fe640 1 -- 172.21.15.99:0/3321994426 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200ab600 con 0x7f632c0b4500 2024-01-19T05:18:20.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f632b7fe640 1 -- 172.21.15.99:0/3321994426 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63200a7050 con 0x7f632c0b4500 2024-01-19T05:18:20.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f632b7fe640 1 -- 172.21.15.99:0/3321994426 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200ab980 con 0x7f632c0b4500 2024-01-19T05:18:20.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- 172.21.15.99:0/3321994426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 msgr2=0x7f632c142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:20.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 --2- 172.21.15.99:0/3321994426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 0x7f632c142e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63200097f0 tx=0x7f632001c360 comp rx=0 tx=0).stop 2024-01-19T05:18:20.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- 172.21.15.99:0/3321994426 shutdown_connections 2024-01-19T05:18:20.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 --2- 172.21.15.99:0/3321994426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c1433d0 0x7f632c143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 --2- 172.21.15.99:0/3321994426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 0x7f632c142e90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- 172.21.15.99:0/3321994426 >> 172.21.15.99:0/3321994426 conn(0x7f632c0b8080 msgr2=0x7f632c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:20.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- 172.21.15.99:0/3321994426 shutdown_connections 2024-01-19T05:18:20.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- 172.21.15.99:0/3321994426 wait complete. 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 Processor -- start 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- start start 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c0b1120 0x7f632c13af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 0x7f632c13a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f632c1433d0 0x7f632c13cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c1386d0 con 0x7f632c1433d0 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c1363e0 con 0x7f632c0b4500 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6332e28640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0a8990 con 0x7f632c0b1120 2024-01-19T05:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f632c1433d0 0x7f632c13cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f632c1433d0 0x7f632c13cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55602/0 (socket says 172.21.15.99:55602) 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 -- 172.21.15.99:0/2788716283 learned_addr learned my addr 172.21.15.99:0/2788716283 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f632bfff640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 0x7f632c13a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f6330bc4640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c0b1120 0x7f632c13af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 -- 172.21.15.99:0/2788716283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c0b1120 msgr2=0x7f632c13af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c0b1120 0x7f632c13af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 -- 172.21.15.99:0/2788716283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 msgr2=0x7f632c13a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 0x7f632c13a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 -- 172.21.15.99:0/2788716283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320009420 con 0x7f632c1433d0 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.245+0000 7f63313c5640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f632c1433d0 0x7f632c13cc20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f632400efc0 tx=0x7f632400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f63297fa640 1 -- 172.21.15.99:0/2788716283 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324014480 con 0x7f632c1433d0 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f63297fa640 1 -- 172.21.15.99:0/2788716283 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632400f040 con 0x7f632c1433d0 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632c1dd350 con 0x7f632c1433d0 2024-01-19T05:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f63297fa640 1 -- 172.21.15.99:0/2788716283 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324014820 con 0x7f632c1433d0 2024-01-19T05:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c1dd910 con 0x7f632c1433d0 2024-01-19T05:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632c0696e0 con 0x7f632c1433d0 2024-01-19T05:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f63297fa640 1 -- 172.21.15.99:0/2788716283 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6324014980 con 0x7f632c1433d0 2024-01-19T05:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f63297fa640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6310066500 0x7f63100689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f6330bc4640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6310066500 0x7f63100689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f63297fa640 1 -- 172.21.15.99:0/2788716283 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63240849d0 con 0x7f632c1433d0 2024-01-19T05:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.249+0000 7f6330bc4640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6310066500 0x7f63100689c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6318000f70 tx=0x7f6318009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:20.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.253+0000 7f63297fa640 1 -- 172.21.15.99:0/2788716283 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6324051d00 con 0x7f632c1433d0 2024-01-19T05:18:20.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.445+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f632c0b0d10 con 0x7f632c1433d0 2024-01-19T05:18:20.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.445+0000 7f63297fa640 1 -- 172.21.15.99:0/2788716283 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6324018070 con 0x7f632c1433d0 2024-01-19T05:18:20.445 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T05:18:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6310066500 msgr2=0x7f63100689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6310066500 0x7f63100689c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6318000f70 tx=0x7f6318009040 comp rx=0 tx=0).stop 2024-01-19T05:18:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f632c1433d0 msgr2=0x7f632c13cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f632c1433d0 0x7f632c13cc20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f632400efc0 tx=0x7f632400c490 comp rx=0 tx=0).stop 2024-01-19T05:18:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 shutdown_connections 2024-01-19T05:18:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6310066500 0x7f63100689c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f632c1433d0 0x7f632c13cc20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f632c0b4500 0x7f632c13a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 --2- 172.21.15.99:0/2788716283 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f632c0b1120 0x7f632c13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 >> 172.21.15.99:0/2788716283 conn(0x7f632c0b8080 msgr2=0x7f632c142390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 shutdown_connections 2024-01-19T05:18:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:20.449+0000 7f6332e28640 1 -- 172.21.15.99:0/2788716283 wait complete. 2024-01-19T05:18:20.462 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-19T05:18:20.462 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T05:18:20.463 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-01-19T05:18:20.463 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-19T05:18:20.463 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:20.463 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-19T05:18:20.463 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-19T05:18:20.463 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T05:18:20.463 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T05:18:20.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.463 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-01-19T05:18:20.469 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T05:18:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T05:18:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T05:18:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-01-19T05:18:20.469 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:20.469 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42529sec preferred_lft 42529sec 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:20.470 INFO:teuthology.orchestra.run.smithi099.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T05:18:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 02:42:63:a0:fe:6e brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T05:18:20.471 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:20.471 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-19T05:18:20.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.471 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-19T05:18:20.471 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-19T05:18:20.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-01-19T05:18:20.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-01-19T05:18:20.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-01-19T05:18:20.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-19T05:18:20.472 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-19T05:18:20.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.542 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T05:18:20.597 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-01-19T05:18:20.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.599 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T05:18:20.672 INFO:teuthology.orchestra.run.smithi099.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T05:18:20.673 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T05:18:20.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.673 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-19T05:18:20.673 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-19T05:18:20.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T05:18:20.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T05:18:20.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T05:18:20.673 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-19T05:18:20.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.746 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-01-19T05:18:20.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.795 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-01-19T05:18:20.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.843 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-19T05:18:20.843 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-19T05:18:20.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:20.843 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-19T05:18:20.843 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-19T05:18:20.912 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-19T05:18:20.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:20.912 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-19T05:18:20.912 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-19T05:18:20.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-19T05:18:20.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-19T05:18:20.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-19T05:18:20.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-19T05:18:20.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-19T05:18:20.913 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-19T05:18:21.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:21.021 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-19T05:18:21.021 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-19T05:18:21.022 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-01-19T05:18:21.022 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-01-19T05:18:21.022 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-19T05:18:21.040 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-19T05:18:21.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T05:18:21.041 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:21.086 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-19T05:18:21.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T05:18:21.087 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:21.134 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-01-19T05:18:21.192 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T05:18:21.243 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-01-19T05:18:21.243 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-01-19T05:18:21.243 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-01-19T05:18:21.244 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-01-19T05:18:21.244 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-01-19T05:18:21.244 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-01-19T05:18:21.244 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-01-19T05:18:21.244 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-01-19T05:18:21.244 INFO:teuthology.orchestra.run.smithi099.stdout:/run/lock 2024-01-19T05:18:21.244 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/bpf 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/fs/nfsd 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/run/rpc_pipefs 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-01-19T05:18:21.245 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-01-19T05:18:21.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T05:18:21.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T05:18:21.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T05:18:21.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T05:18:21.246 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-01-19T05:18:21.246 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:21.246 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:21.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:21.247 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-01-19T05:18:21.294 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-19T05:18:21.294 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-19T05:18:21.339 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-01-19T05:18:21.354 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T05:18:21.403 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-01-19T05:18:21.403 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/run/lock 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/bpf 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-01-19T05:18:21.404 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/fs/nfsd 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/run/rpc_pipefs 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T05:18:21.405 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-01-19T05:18:21.406 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:21.406 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:21.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:21.406 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-01-19T05:18:21.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:2024-01-19T05:18:21.425+0000 7f72841ce580 -1 init, newargv = 0x561b8dc50f20 newargc=15 2024-01-19T05:18:21.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[35058]: starting ceph client 2024-01-19T05:18:21.432 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[35058]: starting fuse 2024-01-19T05:18:22.529 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-01-19T05:18:22.545 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T05:18:22.593 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-01-19T05:18:22.593 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-01-19T05:18:22.593 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-01-19T05:18:22.593 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-01-19T05:18:22.593 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-01-19T05:18:22.593 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-01-19T05:18:22.593 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/run/lock 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/bpf 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/fs/nfsd 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/run/rpc_pipefs 2024-01-19T05:18:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:22.595 INFO:teuthology.orchestra.run.smithi099.stdout:/home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:22.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:22.596 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-01-19T05:18:22.643 INFO:teuthology.orchestra.run.smithi099.stdout:45 2024-01-19T05:18:22.643 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-01-19T05:18:22.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo stdin-killer -- python3 -c ' 2024-01-19T05:18:22.643 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2024-01-19T05:18:22.643 DEBUG:teuthology.orchestra.run.smithi099:> import re 2024-01-19T05:18:22.643 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-01-19T05:18:22.643 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-01-19T05:18:22.643 DEBUG:teuthology.orchestra.run.smithi099:> 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-19T05:18:22.644 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2024-01-19T05:18:22.645 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2024-01-19T05:18:22.645 DEBUG:teuthology.orchestra.run.smithi099:> return f 2024-01-19T05:18:22.645 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-19T05:18:22.645 DEBUG:teuthology.orchestra.run.smithi099:> 2024-01-19T05:18:22.645 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.0")) 2024-01-19T05:18:22.645 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-01-19T05:18:22.768 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.0.35058.asok 2024-01-19T05:18:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-19T05:18:22.779 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35058.asok 2024-01-19T05:18:22.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:22.779 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35058.asok status 2024-01-19T05:18:22.936 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:18:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "0edf41a622739843d6b978b179ff3227b476dd9d", 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 19.0.0-766-g0edf41a6 (0edf41a622739843d6b978b179ff3227b476dd9d) squid (dev)", 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "0", 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "35058", 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4662, 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2024-01-19T05:18:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 4662 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2771903278 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2771903278 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.4662 192.168.0.1:0/2771903278", 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "192.168.0.1:0/2771903278", 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2024-01-19T05:18:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 6, 2024-01-19T05:18:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 20, 2024-01-19T05:18:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2024-01-19T05:18:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2024-01-19T05:18:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2024-01-19T05:18:22.939 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:18:22.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:22.950 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2024-01-19T05:18:22.950 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:22.957 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2024-01-19T05:18:22.957 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:22.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:22.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:23.015 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-19T05:18:23.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:23.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.181+0000 7f433bce5640 1 Processor -- start 2024-01-19T05:18:23.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.181+0000 7f433bce5640 1 -- start start 2024-01-19T05:18:23.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f43340b1870 0x7f4334143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4334144000 0x7f433414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433406f620 con 0x7f43340b2ce0 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4334141000 con 0x7f43340b1870 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4334143610 con 0x7f4334144000 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4339280640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f43340b1870 0x7f4334143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4339280640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f43340b1870 0x7f4334143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40694/0 (socket says 172.21.15.99:40694) 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4339280640 1 -- 172.21.15.99:0/4122330249 learned_addr learned my addr 172.21.15.99:0/4122330249 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433a282640 1 --2- 172.21.15.99:0/4122330249 >> v2:172.21.15.157:3300/0 conn(0x7f4334144000 0x7f433414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4339280640 1 -- 172.21.15.99:0/4122330249 >> v2:172.21.15.157:3300/0 conn(0x7f4334144000 msgr2=0x7f433414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4339280640 1 --2- 172.21.15.99:0/4122330249 >> v2:172.21.15.157:3300/0 conn(0x7f4334144000 0x7f433414dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4339280640 1 -- 172.21.15.99:0/4122330249 >> v1:172.21.15.157:6789/0 conn(0x7f43340b2ce0 legacy=0x7f4334071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:23.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4339280640 1 -- 172.21.15.99:0/4122330249 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334144470 con 0x7f43340b1870 2024-01-19T05:18:23.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4339280640 1 --2- 172.21.15.99:0/4122330249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43340b1870 0x7f4334143ac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f43340b10f0 tx=0x7f432801eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b82c77b0015d5e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4338a7f640 1 -- 172.21.15.99:0/4122330249 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280a7b60 con 0x7f43340b1870 2024-01-19T05:18:23.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4338a7f640 1 -- 172.21.15.99:0/4122330249 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280a7cc0 con 0x7f43340b1870 2024-01-19T05:18:23.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f4338a7f640 1 -- 172.21.15.99:0/4122330249 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280af660 con 0x7f43340b1870 2024-01-19T05:18:23.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 -- 172.21.15.99:0/4122330249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43340b1870 msgr2=0x7f4334143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 --2- 172.21.15.99:0/4122330249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43340b1870 0x7f4334143ac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f43340b10f0 tx=0x7f432801eb90 comp rx=0 tx=0).stop 2024-01-19T05:18:23.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 -- 172.21.15.99:0/4122330249 shutdown_connections 2024-01-19T05:18:23.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 --2- 172.21.15.99:0/4122330249 >> v2:172.21.15.157:3300/0 conn(0x7f4334144000 0x7f433414dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 --2- 172.21.15.99:0/4122330249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43340b1870 0x7f4334143ac0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 -- 172.21.15.99:0/4122330249 >> 172.21.15.99:0/4122330249 conn(0x7f43340b8080 msgr2=0x7f43340b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:23.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 -- 172.21.15.99:0/4122330249 shutdown_connections 2024-01-19T05:18:23.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.185+0000 7f433bce5640 1 -- 172.21.15.99:0/4122330249 wait complete. 2024-01-19T05:18:23.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 Processor -- start 2024-01-19T05:18:23.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 -- start start 2024-01-19T05:18:23.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43340b2ce0 0x7f43341de530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4334144000 0x7f4334132d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43340b6ed0 0x7f433413b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433413dd50 con 0x7f4334144000 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433413b470 con 0x7f43340b2ce0 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433413d8c0 con 0x7f43340b6ed0 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4334144000 0x7f4334132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4334144000 0x7f4334132d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40704/0 (socket says 172.21.15.99:40704) 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 -- 172.21.15.99:0/1552975538 learned_addr learned my addr 172.21.15.99:0/1552975538 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 -- 172.21.15.99:0/1552975538 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43340b6ed0 msgr2=0x7f433413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43340b6ed0 0x7f433413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 -- 172.21.15.99:0/1552975538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43340b2ce0 msgr2=0x7f43341de530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339a81640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43340b2ce0 0x7f43341de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43340b2ce0 0x7f43341de530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 -- 172.21.15.99:0/1552975538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432800b770 con 0x7f4334144000 2024-01-19T05:18:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f4339280640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4334144000 0x7f4334132d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f432800b2c0 tx=0x7f432801b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f43267fc640 1 -- 172.21.15.99:0/1552975538 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328006ee0 con 0x7f4334144000 2024-01-19T05:18:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f43267fc640 1 -- 172.21.15.99:0/1552975538 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280b8600 con 0x7f4334144000 2024-01-19T05:18:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433413e9a0 con 0x7f4334144000 2024-01-19T05:18:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f43267fc640 1 -- 172.21.15.99:0/1552975538 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280b89b0 con 0x7f4334144000 2024-01-19T05:18:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43341de010 con 0x7f4334144000 2024-01-19T05:18:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.189+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43340696e0 con 0x7f4334144000 2024-01-19T05:18:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.193+0000 7f43267fc640 1 -- 172.21.15.99:0/1552975538 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f43280b6040 con 0x7f4334144000 2024-01-19T05:18:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.193+0000 7f43267fc640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4318066500 0x7f43180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.193+0000 7f43267fc640 1 -- 172.21.15.99:0/1552975538 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4328121060 con 0x7f4334144000 2024-01-19T05:18:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.193+0000 7f4339a81640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4318066500 0x7f43180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.193+0000 7f4339a81640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4318066500 0x7f43180689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4330003d60 tx=0x7f4330009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.197+0000 7f43267fc640 1 -- 172.21.15.99:0/1552975538 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f43281524d0 con 0x7f4334144000 2024-01-19T05:18:23.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.353+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43341de1d0 con 0x7f4334144000 2024-01-19T05:18:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f43267fc640 1 -- 172.21.15.99:0/1552975538 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f43280b4090 con 0x7f4334144000 2024-01-19T05:18:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:23.355 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:23.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4318066500 msgr2=0x7f43180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4318066500 0x7f43180689c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4330003d60 tx=0x7f4330009040 comp rx=0 tx=0).stop 2024-01-19T05:18:23.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4334144000 msgr2=0x7f4334132d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4334144000 0x7f4334132d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f432800b2c0 tx=0x7f432801b930 comp rx=0 tx=0).stop 2024-01-19T05:18:23.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 shutdown_connections 2024-01-19T05:18:23.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4318066500 0x7f43180689c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43340b6ed0 0x7f433413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4334144000 0x7f4334132d90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 --2- 172.21.15.99:0/1552975538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43340b2ce0 0x7f43341de530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 >> 172.21.15.99:0/1552975538 conn(0x7f43340b8080 msgr2=0x7f4334141db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:23.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 shutdown_connections 2024-01-19T05:18:23.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.357+0000 7f433bce5640 1 -- 172.21.15.99:0/1552975538 wait complete. 2024-01-19T05:18:23.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:23.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3fed0640 1 Processor -- start 2024-01-19T05:18:23.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3fed0640 1 -- start start 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3fed0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a3806ebe0 0x7f6a38071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3fed0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3806f070 con 0x7f6a380b19f0 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3fed0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a38070680 con 0x7f6a38072320 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3fed0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a38070410 con 0x7f6a3806ebe0 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3dc6c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6a380b19f0 0x7f6a38144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60876/0 (socket says 172.21.15.99:60876) 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3dc6c640 1 -- 172.21.15.99:0/3984723351 learned_addr learned my addr 172.21.15.99:0/3984723351 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3d46b640 1 --2- 172.21.15.99:0/3984723351 >> v2:172.21.15.157:3300/0 conn(0x7f6a3806ebe0 0x7f6a38071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.489+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43593792 0 0) 0x7f6a34001120 con 0x7f6a380b19f0 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a24003530 con 0x7f6a380b19f0 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678366695 0 0) 0x7f6a24003530 con 0x7f6a380b19f0 2024-01-19T05:18:23.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 >> v2:172.21.15.157:3300/0 conn(0x7f6a3806ebe0 msgr2=0x7f6a38071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 --2- 172.21.15.99:0/3984723351 >> v2:172.21.15.157:3300/0 conn(0x7f6a3806ebe0 0x7f6a38071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 >> v1:172.21.15.157:6789/0 conn(0x7f6a38072320 legacy=0x7f6a3814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38144790 con 0x7f6a380b19f0 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f6a34001810 con 0x7f6a380b19f0 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 >> v1:172.21.15.99:6789/0 conn(0x7f6a380b19f0 legacy=0x7f6a38144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a24003980 0x7f6a24003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a240047d0 0x7f6a24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38070410 con 0x7f6a24005190 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2400c130 con 0x7f6a24003980 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2400c2f0 con 0x7f6a240047d0 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3e46d640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3dc6c640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a24003980 0x7f6a24003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3d46b640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a240047d0 0x7f6a24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3e46d640 1 -- 172.21.15.99:0/3984723351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a240047d0 msgr2=0x7f6a24004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:23.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3e46d640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a240047d0 0x7f6a24004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3e46d640 1 -- 172.21.15.99:0/3984723351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a24003980 msgr2=0x7f6a24003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:23.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3e46d640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a24003980 0x7f6a24003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3e46d640 1 -- 172.21.15.99:0/3984723351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a24003530 con 0x7f6a24005190 2024-01-19T05:18:23.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3e46d640 1 -- 172.21.15.99:0/3984723351 reap_dead start 2024-01-19T05:18:23.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3e46d640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a2400b990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a30001e70 tx=0x7f6a3001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaede19f23754ca server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30003b80 con 0x7f6a24005190 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a30003d20 con 0x7f6a24005190 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3cc6a640 1 -- 172.21.15.99:0/3984723351 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30005260 con 0x7f6a24005190 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3fed0640 1 -- 172.21.15.99:0/3984723351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 msgr2=0x7f6a2400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3fed0640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a2400b990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a30001e70 tx=0x7f6a3001c760 comp rx=0 tx=0).stop 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3fed0640 1 -- 172.21.15.99:0/3984723351 shutdown_connections 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3fed0640 1 --2- 172.21.15.99:0/3984723351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a2400b990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3fed0640 1 -- 172.21.15.99:0/3984723351 >> 172.21.15.99:0/3984723351 conn(0x7f6a380b8080 msgr2=0x7f6a380b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3fed0640 1 -- 172.21.15.99:0/3984723351 shutdown_connections 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.493+0000 7f6a3fed0640 1 -- 172.21.15.99:0/3984723351 wait complete. 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 Processor -- start 2024-01-19T05:18:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 -- start start 2024-01-19T05:18:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a381cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a380addf0 0x7f6a381dd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380ae250 0x7f6a3813f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a381cc530 con 0x7f6a24005190 2024-01-19T05:18:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a381cb430 con 0x7f6a380ae250 2024-01-19T05:18:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a381cc770 con 0x7f6a380addf0 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a381cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a381cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40720/0 (socket says 172.21.15.99:40720) 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 -- 172.21.15.99:0/2579536368 learned_addr learned my addr 172.21.15.99:0/2579536368 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3d46b640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a380addf0 0x7f6a381dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3e46d640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380ae250 0x7f6a3813f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 -- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a380addf0 msgr2=0x7f6a381dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a380addf0 0x7f6a381dd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 -- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380ae250 msgr2=0x7f6a3813f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380ae250 0x7f6a3813f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 -- 172.21.15.99:0/2579536368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a381cb8c0 con 0x7f6a24005190 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3d46b640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a380addf0 0x7f6a381dd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3dc6c640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a381cbff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a34011810 tx=0x7f6a34011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a2e7fc640 1 -- 172.21.15.99:0/2579536368 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400f960 con 0x7f6a24005190 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a2e7fc640 1 -- 172.21.15.99:0/2579536368 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400fac0 con 0x7f6a24005190 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a2e7fc640 1 -- 172.21.15.99:0/2579536368 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400fe70 con 0x7f6a24005190 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a380acfd0 con 0x7f6a24005190 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a38140020 con 0x7f6a24005190 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a380696e0 con 0x7f6a24005190 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.497+0000 7f6a2e7fc640 1 -- 172.21.15.99:0/2579536368 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6a3401f460 con 0x7f6a24005190 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.501+0000 7f6a2e7fc640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a1c066530 0x7f6a1c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.501+0000 7f6a2e7fc640 1 -- 172.21.15.99:0/2579536368 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a34086ea0 con 0x7f6a24005190 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.501+0000 7f6a3d46b640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a1c066530 0x7f6a1c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.501+0000 7f6a3d46b640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a1c066530 0x7f6a1c0689f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a381dae20 tx=0x7f6a28008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.505+0000 7f6a2e7fc640 1 -- 172.21.15.99:0/2579536368 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6a34057bc0 con 0x7f6a24005190 2024-01-19T05:18:23.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.649+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a3806f070 con 0x7f6a24005190 2024-01-19T05:18:23.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.649+0000 7f6a2e7fc640 1 -- 172.21.15.99:0/2579536368 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a3806f070 con 0x7f6a24005190 2024-01-19T05:18:23.650 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a1c066530 msgr2=0x7f6a1c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a1c066530 0x7f6a1c0689f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a381dae20 tx=0x7f6a28008040 comp rx=0 tx=0).stop 2024-01-19T05:18:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 msgr2=0x7f6a381cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a381cbff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a34011810 tx=0x7f6a34011cd0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 shutdown_connections 2024-01-19T05:18:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a1c066530 0x7f6a1c0689f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a380ae250 0x7f6a3813f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a380addf0 0x7f6a381dd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 --2- 172.21.15.99:0/2579536368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a24005190 0x7f6a381cbff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 >> 172.21.15.99:0/2579536368 conn(0x7f6a380b8080 msgr2=0x7f6a380b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:23.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 shutdown_connections 2024-01-19T05:18:23.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.653+0000 7f6a3fed0640 1 -- 172.21.15.99:0/2579536368 wait complete. 2024-01-19T05:18:23.666 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:23.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.789+0000 7f5542d10640 1 Processor -- start 2024-01-19T05:18:23.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.789+0000 7f5542d10640 1 -- start start 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f553c06ebe0 0x7f553c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f553c072320 0x7f553c14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c06f070 con 0x7f553c0b19f0 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c070680 con 0x7f553c06ebe0 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c070410 con 0x7f553c072320 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553bfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f553c06ebe0 0x7f553c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553bfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f553c06ebe0 0x7f553c071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40726/0 (socket says 172.21.15.99:40726) 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553bfff640 1 -- 172.21.15.99:0/3831025920 learned_addr learned my addr 172.21.15.99:0/3831025920 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f55412ad640 1 --2- 172.21.15.99:0/3831025920 >> v2:172.21.15.157:3300/0 conn(0x7f553c072320 0x7f553c14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553bfff640 1 -- 172.21.15.99:0/3831025920 >> v2:172.21.15.157:3300/0 conn(0x7f553c072320 msgr2=0x7f553c14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553bfff640 1 --2- 172.21.15.99:0/3831025920 >> v2:172.21.15.157:3300/0 conn(0x7f553c072320 0x7f553c14ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553bfff640 1 -- 172.21.15.99:0/3831025920 >> v1:172.21.15.157:6789/0 conn(0x7f553c0b19f0 legacy=0x7f553c144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:23.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553bfff640 1 -- 172.21.15.99:0/3831025920 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c144790 con 0x7f553c06ebe0 2024-01-19T05:18:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553bfff640 1 --2- 172.21.15.99:0/3831025920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c06ebe0 0x7f553c071de0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f553c0b9070 tx=0x7f552401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31528fd181767cf3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553b7fe640 1 -- 172.21.15.99:0/3831025920 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240ab620 con 0x7f553c06ebe0 2024-01-19T05:18:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553b7fe640 1 -- 172.21.15.99:0/3831025920 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55240ab780 con 0x7f553c06ebe0 2024-01-19T05:18:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f553b7fe640 1 -- 172.21.15.99:0/3831025920 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240abb10 con 0x7f553c06ebe0 2024-01-19T05:18:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 -- 172.21.15.99:0/3831025920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c06ebe0 msgr2=0x7f553c071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 --2- 172.21.15.99:0/3831025920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c06ebe0 0x7f553c071de0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f553c0b9070 tx=0x7f552401c400 comp rx=0 tx=0).stop 2024-01-19T05:18:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 -- 172.21.15.99:0/3831025920 shutdown_connections 2024-01-19T05:18:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 --2- 172.21.15.99:0/3831025920 >> v2:172.21.15.157:3300/0 conn(0x7f553c072320 0x7f553c14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.793+0000 7f5542d10640 1 --2- 172.21.15.99:0/3831025920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c06ebe0 0x7f553c071de0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- 172.21.15.99:0/3831025920 >> 172.21.15.99:0/3831025920 conn(0x7f553c0b8080 msgr2=0x7f553c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- 172.21.15.99:0/3831025920 shutdown_connections 2024-01-19T05:18:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- 172.21.15.99:0/3831025920 wait complete. 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 Processor -- start 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- start start 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f553c06ebe0 0x7f553c134db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c072320 0x7f553c0b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f553c0b19f0 0x7f553c1e0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0a8b20 con 0x7f553c072320 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c14ec70 con 0x7f553c0b19f0 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c13c7b0 con 0x7f553c06ebe0 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c072320 0x7f553c0b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c072320 0x7f553c0b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40738/0 (socket says 172.21.15.99:40738) 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 -- 172.21.15.99:0/1185109731 learned_addr learned my addr 172.21.15.99:0/1185109731 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f55412ad640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f553c0b19f0 0x7f553c1e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5540aac640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f553c06ebe0 0x7f553c134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 -- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f553c06ebe0 msgr2=0x7f553c134db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f553c06ebe0 0x7f553c134db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 -- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f553c0b19f0 msgr2=0x7f553c1e0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f553c0b19f0 0x7f553c1e0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 -- 172.21.15.99:0/1185109731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240094d0 con 0x7f553c072320 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f55412ad640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f553c0b19f0 0x7f553c1e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f553bfff640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c072320 0x7f553c0b7420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f552401a030 tx=0x7f552401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f55397fa640 1 -- 172.21.15.99:0/1185109731 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240be3f0 con 0x7f553c072320 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f55397fa640 1 -- 172.21.15.99:0/1185109731 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55240be570 con 0x7f553c072320 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c13ca90 con 0x7f553c072320 2024-01-19T05:18:23.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f55397fa640 1 -- 172.21.15.99:0/1185109731 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240be920 con 0x7f553c072320 2024-01-19T05:18:23.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c13d490 con 0x7f553c072320 2024-01-19T05:18:23.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.797+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c0696e0 con 0x7f553c072320 2024-01-19T05:18:23.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.801+0000 7f55397fa640 1 -- 172.21.15.99:0/1185109731 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f55240c7440 con 0x7f553c072320 2024-01-19T05:18:23.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.801+0000 7f55397fa640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f551c066500 0x7f551c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:23.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.801+0000 7f55397fa640 1 -- 172.21.15.99:0/1185109731 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f552411e4b0 con 0x7f553c072320 2024-01-19T05:18:23.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.801+0000 7f5540aac640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f551c066500 0x7f551c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:23.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.801+0000 7f5540aac640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f551c066500 0x7f551c0689c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f553c0b7d40 tx=0x7f5534009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:23.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.805+0000 7f55397fa640 1 -- 172.21.15.99:0/1185109731 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f55240eb7e0 con 0x7f553c072320 2024-01-19T05:18:23.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f553c06f070 con 0x7f553c072320 2024-01-19T05:18:23.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f55397fa640 1 -- 172.21.15.99:0/1185109731 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f553c06f070 con 0x7f553c072320 2024-01-19T05:18:23.959 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f551c066500 msgr2=0x7f551c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f551c066500 0x7f551c0689c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f553c0b7d40 tx=0x7f5534009040 comp rx=0 tx=0).stop 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c072320 msgr2=0x7f553c0b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c072320 0x7f553c0b7420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f552401a030 tx=0x7f552401ac40 comp rx=0 tx=0).stop 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 shutdown_connections 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f551c066500 0x7f551c0689c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f553c0b19f0 0x7f553c1e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f553c072320 0x7f553c0b7420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 --2- 172.21.15.99:0/1185109731 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f553c06ebe0 0x7f553c134db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 >> 172.21.15.99:0/1185109731 conn(0x7f553c0b8080 msgr2=0x7f553c0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 shutdown_connections 2024-01-19T05:18:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:23.961+0000 7f5542d10640 1 -- 172.21.15.99:0/1185109731 wait complete. 2024-01-19T05:18:23.977 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:24.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401cae1640 1 Processor -- start 2024-01-19T05:18:24.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401cae1640 1 -- start start 2024-01-19T05:18:24.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401cae1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f40180acad0 0x7f40180b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401cae1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40180725b0 0x7f4018146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401cae1640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40180ae1a0 con 0x7f40180b22b0 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401cae1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4018141020 con 0x7f40180acad0 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401cae1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40180aceb0 con 0x7f40180725b0 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4016d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f40180b22b0 0x7f4018149d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60878/0 (socket says 172.21.15.99:60878) 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4016d9d640 1 -- 172.21.15.99:0/1389589677 learned_addr learned my addr 172.21.15.99:0/1389589677 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401659c640 1 --2- 172.21.15.99:0/1389589677 >> v2:172.21.15.157:3300/0 conn(0x7f40180acad0 0x7f40180b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f400ffff640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40180725b0 0x7f4018146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666588066 0 0) 0x7f40180ae1a0 con 0x7f40180b22b0 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4004003530 con 0x7f40180b22b0 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481871334 0 0) 0x7f4004003530 con 0x7f40180b22b0 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40180725b0 msgr2=0x7f4018146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40180725b0 0x7f4018146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 >> v2:172.21.15.157:3300/0 conn(0x7f40180acad0 msgr2=0x7f40180b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 --2- 172.21.15.99:0/1389589677 >> v2:172.21.15.157:3300/0 conn(0x7f40180acad0 0x7f40180b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40180aefc0 con 0x7f40180b22b0 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f4010001a00 con 0x7f40180b22b0 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 >> v1:172.21.15.99:6789/0 conn(0x7f40180b22b0 legacy=0x7f4018149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4004003980 0x7f4004003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40040042e0 0x7f40040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4004004e20 0x7f40040052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4018141020 con 0x7f4004004e20 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40180aceb0 con 0x7f40040042e0 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400400bd10 con 0x7f4004003980 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4016d9d640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4004004e20 0x7f40040052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f400ffff640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40040042e0 0x7f40040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f401659c640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4004003980 0x7f4004003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4016d9d640 1 -- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4004003980 msgr2=0x7f4004003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:24.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4016d9d640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4004003980 0x7f4004003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4016d9d640 1 -- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40040042e0 msgr2=0x7f40040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:24.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4016d9d640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40040042e0 0x7f40040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.101+0000 7f4016d9d640 1 -- 172.21.15.99:0/1389589677 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4004003530 con 0x7f4004004e20 2024-01-19T05:18:24.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4004004e20 0x7f40040052a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f401000a8d0 tx=0x7f401001d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7383030eee714e11 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100ad630 con 0x7f4004004e20 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40100a8070 con 0x7f4004004e20 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4015d9b640 1 -- 172.21.15.99:0/1389589677 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100ad9d0 con 0x7f4004004e20 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- 172.21.15.99:0/1389589677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4004004e20 msgr2=0x7f40040052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 --2- 172.21.15.99:0/1389589677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4004004e20 0x7f40040052a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f401000a8d0 tx=0x7f401001d3e0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 -- 172.21.15.99:0/1389589677 reap_dead start 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- 172.21.15.99:0/1389589677 shutdown_connections 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- 172.21.15.99:0/1389589677 >> 172.21.15.99:0/1389589677 conn(0x7f40180b8080 msgr2=0x7f40180b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- 172.21.15.99:0/1389589677 shutdown_connections 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- 172.21.15.99:0/1389589677 wait complete. 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 Processor -- start 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- start start 2024-01-19T05:18:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40180afd90 0x7f40181387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f401813b8b0 0x7f401813bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4018137120 0x7f40181375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401813c250 con 0x7f4018137120 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40180b15e0 con 0x7f40180afd90 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401cae1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4018138cf0 con 0x7f401813b8b0 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4018137120 0x7f40181375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4018137120 0x7f40181375a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40756/0 (socket says 172.21.15.99:40756) 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 -- 172.21.15.99:0/2833046123 learned_addr learned my addr 172.21.15.99:0/2833046123 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401659c640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40180afd90 0x7f40181387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f400ffff640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f401813b8b0 0x7f401813bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 -- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f401813b8b0 msgr2=0x7f401813bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f401813b8b0 0x7f401813bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 -- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40180afd90 msgr2=0x7f40181387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40180afd90 0x7f40181387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f4016d9d640 1 -- 172.21.15.99:0/2833046123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40180b0fd0 con 0x7f4018137120 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.105+0000 7f401659c640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40180afd90 0x7f40181387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f4016d9d640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4018137120 0x7f40181375a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f401001ce50 tx=0x7f4004005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f400effd640 1 -- 172.21.15.99:0/2833046123 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100019d0 con 0x7f4018137120 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f400effd640 1 -- 172.21.15.99:0/2833046123 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40100ad430 con 0x7f4018137120 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40180b0170 con 0x7f4018137120 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f400effd640 1 -- 172.21.15.99:0/2833046123 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100ad7a0 con 0x7f4018137120 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4018139230 con 0x7f4018137120 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40180696e0 con 0x7f4018137120 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f400effd640 1 -- 172.21.15.99:0/2833046123 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f40100aa030 con 0x7f4018137120 2024-01-19T05:18:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f400effd640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ff8066530 0x7f3ff80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f400effd640 1 -- 172.21.15.99:0/2833046123 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f401011d730 con 0x7f4018137120 2024-01-19T05:18:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f401659c640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ff8066530 0x7f3ff80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.109+0000 7f401659c640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ff8066530 0x7f3ff80689f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4000009b70 tx=0x7f4000008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.113+0000 7f400effd640 1 -- 172.21.15.99:0/2833046123 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f40100eaa60 con 0x7f4018137120 2024-01-19T05:18:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.257+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40180b1720 con 0x7f4018137120 2024-01-19T05:18:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.257+0000 7f400effd640 1 -- 172.21.15.99:0/2833046123 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40100ee080 con 0x7f4018137120 2024-01-19T05:18:24.256 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.257+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ff8066530 msgr2=0x7f3ff80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.257+0000 7f401cae1640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ff8066530 0x7f3ff80689f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4000009b70 tx=0x7f4000008040 comp rx=0 tx=0).stop 2024-01-19T05:18:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.257+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4018137120 msgr2=0x7f40181375a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.257+0000 7f401cae1640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4018137120 0x7f40181375a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f401001ce50 tx=0x7f4004005800 comp rx=0 tx=0).stop 2024-01-19T05:18:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.261+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 shutdown_connections 2024-01-19T05:18:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.261+0000 7f401cae1640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ff8066530 0x7f3ff80689f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.261+0000 7f401cae1640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4018137120 0x7f40181375a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.261+0000 7f401cae1640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f401813b8b0 0x7f401813bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.261+0000 7f401cae1640 1 --2- 172.21.15.99:0/2833046123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40180afd90 0x7f40181387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.261+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 >> 172.21.15.99:0/2833046123 conn(0x7f40180b8080 msgr2=0x7f40180b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.261+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 shutdown_connections 2024-01-19T05:18:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.261+0000 7f401cae1640 1 -- 172.21.15.99:0/2833046123 wait complete. 2024-01-19T05:18:24.274 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:24.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c47755640 1 Processor -- start 2024-01-19T05:18:24.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c47755640 1 -- start start 2024-01-19T05:18:24.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c47755640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c4006ebe0 0x7f0c40071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c47755640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c40072320 0x7f0c4014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c47755640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4006f070 con 0x7f0c400b19f0 2024-01-19T05:18:24.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c47755640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c40070680 con 0x7f0c4006ebe0 2024-01-19T05:18:24.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c47755640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40070410 con 0x7f0c40072320 2024-01-19T05:18:24.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c44cf0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c4006ebe0 0x7f0c40071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c45cf2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c40072320 0x7f0c4014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c44cf0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c4006ebe0 0x7f0c40071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:40482/0 (socket says 172.21.15.99:40482) 2024-01-19T05:18:24.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c44cf0640 1 -- 172.21.15.99:0/61244226 learned_addr learned my addr 172.21.15.99:0/61244226 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:24.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c454f1640 1 --1- 172.21.15.99:0/61244226 >> v1:172.21.15.157:6789/0 conn(0x7f0c400b19f0 0x7f0c40144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:34456/0 (socket says 172.21.15.99:34456) 2024-01-19T05:18:24.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c44cf0640 1 -- 172.21.15.99:0/61244226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c40072320 msgr2=0x7f0c4014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:24.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c44cf0640 1 --2- 172.21.15.99:0/61244226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c40072320 0x7f0c4014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c44cf0640 1 -- 172.21.15.99:0/61244226 >> v1:172.21.15.157:6789/0 conn(0x7f0c400b19f0 legacy=0x7f0c40144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.393+0000 7f0c44cf0640 1 -- 172.21.15.99:0/61244226 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40144790 con 0x7f0c4006ebe0 2024-01-19T05:18:24.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 --2- 172.21.15.99:0/61244226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c4006ebe0 0x7f0c40071de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009870 tx=0x7f0c3001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd0a77be0050ac9d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c37fff640 1 -- 172.21.15.99:0/61244226 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300a6040 con 0x7f0c4006ebe0 2024-01-19T05:18:24.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c37fff640 1 -- 172.21.15.99:0/61244226 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c300aa600 con 0x7f0c4006ebe0 2024-01-19T05:18:24.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c37fff640 1 -- 172.21.15.99:0/61244226 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300aa990 con 0x7f0c4006ebe0 2024-01-19T05:18:24.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- 172.21.15.99:0/61244226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c4006ebe0 msgr2=0x7f0c40071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 --2- 172.21.15.99:0/61244226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c4006ebe0 0x7f0c40071de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009870 tx=0x7f0c3001c480 comp rx=0 tx=0).stop 2024-01-19T05:18:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- 172.21.15.99:0/61244226 shutdown_connections 2024-01-19T05:18:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 --2- 172.21.15.99:0/61244226 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c40072320 0x7f0c4014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 --2- 172.21.15.99:0/61244226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c4006ebe0 0x7f0c40071de0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- 172.21.15.99:0/61244226 >> 172.21.15.99:0/61244226 conn(0x7f0c400b8080 msgr2=0x7f0c400b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:24.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- 172.21.15.99:0/61244226 shutdown_connections 2024-01-19T05:18:24.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- 172.21.15.99:0/61244226 wait complete. 2024-01-19T05:18:24.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 Processor -- start 2024-01-19T05:18:24.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- start start 2024-01-19T05:18:24.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c4006ebe0 0x7f0c401dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c40072320 0x7f0c40134a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c400b19f0 0x7f0c401e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401e0250 con 0x7f0c40072320 2024-01-19T05:18:24.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401e04f0 con 0x7f0c400b19f0 2024-01-19T05:18:24.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c47755640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401e07d0 con 0x7f0c4006ebe0 2024-01-19T05:18:24.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c40072320 0x7f0c40134a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c40072320 0x7f0c40134a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40770/0 (socket says 172.21.15.99:40770) 2024-01-19T05:18:24.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 -- 172.21.15.99:0/1257745744 learned_addr learned my addr 172.21.15.99:0/1257745744 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:24.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c45cf2640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c400b19f0 0x7f0c401e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c454f1640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c4006ebe0 0x7f0c401dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 -- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c4006ebe0 msgr2=0x7f0c401dcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c4006ebe0 0x7f0c401dcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 -- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c400b19f0 msgr2=0x7f0c401e0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c400b19f0 0x7f0c401e0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c44cf0640 1 -- 172.21.15.99:0/1257745744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c300094d0 con 0x7f0c40072320 2024-01-19T05:18:24.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.397+0000 7f0c454f1640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c4006ebe0 0x7f0c401dcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:24.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c44cf0640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c40072320 0x7f0c40134a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c3001ab30 tx=0x7f0c3001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c35ffb640 1 -- 172.21.15.99:0/1257745744 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300b3600 con 0x7f0c40072320 2024-01-19T05:18:24.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c35ffb640 1 -- 172.21.15.99:0/1257745744 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c300b3780 con 0x7f0c40072320 2024-01-19T05:18:24.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4013b690 con 0x7f0c40072320 2024-01-19T05:18:24.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c35ffb640 1 -- 172.21.15.99:0/1257745744 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300b3b30 con 0x7f0c40072320 2024-01-19T05:18:24.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c400b7cb0 con 0x7f0c40072320 2024-01-19T05:18:24.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c400696e0 con 0x7f0c40072320 2024-01-19T05:18:24.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c35ffb640 1 -- 172.21.15.99:0/1257745744 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0c300b3c90 con 0x7f0c40072320 2024-01-19T05:18:24.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c35ffb640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0c24066500 0x7f0c240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c454f1640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0c24066500 0x7f0c240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c35ffb640 1 -- 172.21.15.99:0/1257745744 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c3011e6d0 con 0x7f0c40072320 2024-01-19T05:18:24.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.401+0000 7f0c454f1640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0c24066500 0x7f0c240689c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c007fd0 tx=0x7f0c3c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.405+0000 7f0c35ffb640 1 -- 172.21.15.99:0/1257745744 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0c300eb970 con 0x7f0c40072320 2024-01-19T05:18:24.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.561+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c401e0990 con 0x7f0c40072320 2024-01-19T05:18:24.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c35ffb640 1 -- 172.21.15.99:0/1257745744 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f0c300eef90 con 0x7f0c40072320 2024-01-19T05:18:24.563 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:24.563 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:24.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0c24066500 msgr2=0x7f0c240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0c24066500 0x7f0c240689c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c007fd0 tx=0x7f0c3c009040 comp rx=0 tx=0).stop 2024-01-19T05:18:24.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c40072320 msgr2=0x7f0c40134a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c40072320 0x7f0c40134a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c3001ab30 tx=0x7f0c3001acc0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 shutdown_connections 2024-01-19T05:18:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0c24066500 0x7f0c240689c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c400b19f0 0x7f0c401e0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c40072320 0x7f0c40134a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 --2- 172.21.15.99:0/1257745744 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0c4006ebe0 0x7f0c401dcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 >> 172.21.15.99:0/1257745744 conn(0x7f0c400b8080 msgr2=0x7f0c400735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 shutdown_connections 2024-01-19T05:18:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.565+0000 7f0c47755640 1 -- 172.21.15.99:0/1257745744 wait complete. 2024-01-19T05:18:24.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:24.581 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:24.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe989e3b640 1 Processor -- start 2024-01-19T05:18:24.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe989e3b640 1 -- start start 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe989e3b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe9840b2ce0 0x7fe984071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe989e3b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe9840b1870 0x7fe984072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe989e3b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98406f620 con 0x7fe984143ac0 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe989e3b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe984141000 con 0x7fe9840b1870 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe989e3b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe984143610 con 0x7fe9840b2ce0 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe983fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe984143ac0 0x7fe984143f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60880/0 (socket says 172.21.15.99:60880) 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe983fff640 1 -- 172.21.15.99:0/3192886811 learned_addr learned my addr 172.21.15.99:0/3192886811 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe982ffd640 1 --2- 172.21.15.99:0/3192886811 >> v2:172.21.15.99:3300/0 conn(0x7fe9840b1870 0x7fe984072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe9837fe640 1 --2- 172.21.15.99:0/3192886811 >> v2:172.21.15.157:3300/0 conn(0x7fe9840b2ce0 0x7fe984071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe9827fc640 1 -- 172.21.15.99:0/3192886811 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498865753 0 0) 0x7fe98406f620 con 0x7fe984143ac0 2024-01-19T05:18:24.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe9827fc640 1 -- 172.21.15.99:0/3192886811 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe96c003530 con 0x7fe984143ac0 2024-01-19T05:18:24.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe9827fc640 1 -- 172.21.15.99:0/3192886811 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838643764 0 0) 0x7fe96c003530 con 0x7fe984143ac0 2024-01-19T05:18:24.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe982ffd640 1 -- 172.21.15.99:0/3192886811 >> v2:172.21.15.157:3300/0 conn(0x7fe9840b2ce0 msgr2=0x7fe984071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:24.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe982ffd640 1 --2- 172.21.15.99:0/3192886811 >> v2:172.21.15.157:3300/0 conn(0x7fe9840b2ce0 0x7fe984071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe982ffd640 1 -- 172.21.15.99:0/3192886811 >> v1:172.21.15.99:6789/0 conn(0x7fe984143ac0 legacy=0x7fe984143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.701+0000 7fe982ffd640 1 -- 172.21.15.99:0/3192886811 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9840b30c0 con 0x7fe9840b1870 2024-01-19T05:18:24.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe982ffd640 1 --2- 172.21.15.99:0/3192886811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b1870 0x7fe984072440 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe9840b8f00 tx=0x7fe97801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fa33c7b8d3bdfd server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9827fc640 1 -- 172.21.15.99:0/3192886811 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974001680 con 0x7fe9840b1870 2024-01-19T05:18:24.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9827fc640 1 -- 172.21.15.99:0/3192886811 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9780a7050 con 0x7fe9840b1870 2024-01-19T05:18:24.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9827fc640 1 -- 172.21.15.99:0/3192886811 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780ab620 con 0x7fe9840b1870 2024-01-19T05:18:24.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- 172.21.15.99:0/3192886811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b1870 msgr2=0x7fe984072440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 --2- 172.21.15.99:0/3192886811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b1870 0x7fe984072440 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe9840b8f00 tx=0x7fe97801c350 comp rx=0 tx=0).stop 2024-01-19T05:18:24.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- 172.21.15.99:0/3192886811 shutdown_connections 2024-01-19T05:18:24.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 --2- 172.21.15.99:0/3192886811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b1870 0x7fe984072440 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 --2- 172.21.15.99:0/3192886811 >> v2:172.21.15.157:3300/0 conn(0x7fe9840b2ce0 0x7fe984071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- 172.21.15.99:0/3192886811 >> 172.21.15.99:0/3192886811 conn(0x7fe9840b8080 msgr2=0x7fe9840b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:24.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- 172.21.15.99:0/3192886811 shutdown_connections 2024-01-19T05:18:24.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- 172.21.15.99:0/3192886811 wait complete. 2024-01-19T05:18:24.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 Processor -- start 2024-01-19T05:18:24.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- start start 2024-01-19T05:18:24.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b2ce0 0x7fe9840b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe984143ac0 0x7fe9841dc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9841dcc00 0x7fe984135100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9841398a0 con 0x7fe9840b2ce0 2024-01-19T05:18:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840b7770 con 0x7fe9841dcc00 2024-01-19T05:18:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe989e3b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98413e6f0 con 0x7fe984143ac0 2024-01-19T05:18:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9837fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b2ce0 0x7fe9840b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9837fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b2ce0 0x7fe9840b6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40776/0 (socket says 172.21.15.99:40776) 2024-01-19T05:18:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9837fe640 1 -- 172.21.15.99:0/1101840766 learned_addr learned my addr 172.21.15.99:0/1101840766 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe983fff640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9841dcc00 0x7fe984135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9837fe640 1 -- 172.21.15.99:0/1101840766 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe984143ac0 msgr2=0x7fe9841dc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9837fe640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe984143ac0 0x7fe9841dc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9837fe640 1 -- 172.21.15.99:0/1101840766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9841dcc00 msgr2=0x7fe984135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9837fe640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9841dcc00 0x7fe984135100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe9837fe640 1 -- 172.21.15.99:0/1101840766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978009420 con 0x7fe9840b2ce0 2024-01-19T05:18:24.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.705+0000 7fe983fff640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9841dcc00 0x7fe984135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:24.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe9837fe640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b2ce0 0x7fe9840b6af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00efc0 tx=0x7fe97c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe96bfff640 1 -- 172.21.15.99:0/1101840766 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c014480 con 0x7fe9840b2ce0 2024-01-19T05:18:24.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe96bfff640 1 -- 172.21.15.99:0/1101840766 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c00f040 con 0x7fe9840b2ce0 2024-01-19T05:18:24.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98413be40 con 0x7fe9840b2ce0 2024-01-19T05:18:24.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe96bfff640 1 -- 172.21.15.99:0/1101840766 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c014800 con 0x7fe9840b2ce0 2024-01-19T05:18:24.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9840b7490 con 0x7fe9840b2ce0 2024-01-19T05:18:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9840696e0 con 0x7fe9840b2ce0 2024-01-19T05:18:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe96bfff640 1 -- 172.21.15.99:0/1101840766 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe97c014960 con 0x7fe9840b2ce0 2024-01-19T05:18:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe96bfff640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe970066530 0x7fe9700689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe982ffd640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe970066530 0x7fe9700689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe96bfff640 1 -- 172.21.15.99:0/1101840766 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe97c0849c0 con 0x7fe9840b2ce0 2024-01-19T05:18:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.709+0000 7fe982ffd640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe970066530 0x7fe9700689f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9780ad000 tx=0x7fe978004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.713+0000 7fe96bfff640 1 -- 172.21.15.99:0/1101840766 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe97c051cf0 con 0x7fe9840b2ce0 2024-01-19T05:18:24.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.869+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe984139670 con 0x7fe9840b2ce0 2024-01-19T05:18:24.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe96bfff640 1 -- 172.21.15.99:0/1101840766 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe97c055310 con 0x7fe9840b2ce0 2024-01-19T05:18:24.872 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:24.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe970066530 msgr2=0x7fe9700689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe970066530 0x7fe9700689f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9780ad000 tx=0x7fe978004740 comp rx=0 tx=0).stop 2024-01-19T05:18:24.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b2ce0 msgr2=0x7fe9840b6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:24.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b2ce0 0x7fe9840b6af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00efc0 tx=0x7fe97c00c490 comp rx=0 tx=0).stop 2024-01-19T05:18:24.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 shutdown_connections 2024-01-19T05:18:24.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe970066530 0x7fe9700689f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9841dcc00 0x7fe984135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe984143ac0 0x7fe9841dc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 --2- 172.21.15.99:0/1101840766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9840b2ce0 0x7fe9840b6af0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:24.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 >> 172.21.15.99:0/1101840766 conn(0x7fe9840b8080 msgr2=0x7fe984141590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:24.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 shutdown_connections 2024-01-19T05:18:24.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:24.873+0000 7fe989e3b640 1 -- 172.21.15.99:0/1101840766 wait complete. 2024-01-19T05:18:24.889 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:25.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b2d726640 1 Processor -- start 2024-01-19T05:18:25.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b2d726640 1 -- start start 2024-01-19T05:18:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b2d726640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2b280b96f0 0x7f2b280b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b2d726640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b28140e90 0x7f2b281511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b2d726640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b280b87f0 con 0x7f2b280b7c40 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b2d726640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b280b9ad0 con 0x7f2b280b96f0 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b2d726640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280b81e0 con 0x7f2b28140e90 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b26ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2b280b96f0 0x7f2b280b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b26ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2b280b96f0 0x7f2b280b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40786/0 (socket says 172.21.15.99:40786) 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b26ffd640 1 -- 172.21.15.99:0/2250280864 learned_addr learned my addr 172.21.15.99:0/2250280864 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b1e7fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2b280b7c40 0x7f2b28140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60892/0 (socket says 172.21.15.99:60892) 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b277fe640 1 --2- 172.21.15.99:0/2250280864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b28140e90 0x7f2b281511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b26ffd640 1 -- 172.21.15.99:0/2250280864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b28140e90 msgr2=0x7f2b281511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b26ffd640 1 --2- 172.21.15.99:0/2250280864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b28140e90 0x7f2b281511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b267fc640 1 -- 172.21.15.99:0/2250280864 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157629527 0 0) 0x7f2b280b87f0 con 0x7f2b280b7c40 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b26ffd640 1 -- 172.21.15.99:0/2250280864 >> v1:172.21.15.99:6789/0 conn(0x7f2b280b7c40 legacy=0x7f2b28140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.005+0000 7f2b26ffd640 1 -- 172.21.15.99:0/2250280864 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2806ba20 con 0x7f2b280b96f0 2024-01-19T05:18:25.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 --2- 172.21.15.99:0/2250280864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b96f0 0x7f2b280b7700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009870 tx=0x7f2b1001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526b9494e0228d36 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b267fc640 1 -- 172.21.15.99:0/2250280864 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100aa430 con 0x7f2b280b96f0 2024-01-19T05:18:25.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b267fc640 1 -- 172.21.15.99:0/2250280864 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b100aa590 con 0x7f2b280b96f0 2024-01-19T05:18:25.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b267fc640 1 -- 172.21.15.99:0/2250280864 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100aa920 con 0x7f2b280b96f0 2024-01-19T05:18:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- 172.21.15.99:0/2250280864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b96f0 msgr2=0x7f2b280b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2250280864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b96f0 0x7f2b280b7700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009870 tx=0x7f2b1001c510 comp rx=0 tx=0).stop 2024-01-19T05:18:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- 172.21.15.99:0/2250280864 shutdown_connections 2024-01-19T05:18:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2250280864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b28140e90 0x7f2b281511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2250280864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b96f0 0x7f2b280b7700 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- 172.21.15.99:0/2250280864 >> 172.21.15.99:0/2250280864 conn(0x7f2b2809e600 msgr2=0x7f2b280b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- 172.21.15.99:0/2250280864 shutdown_connections 2024-01-19T05:18:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- 172.21.15.99:0/2250280864 wait complete. 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 Processor -- start 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- start start 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b7c40 0x7f2b2814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b280b96f0 0x7f2b28141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b28140e90 0x7f2b28147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28146fc0 con 0x7f2b280b7c40 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28146820 con 0x7f2b28140e90 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28142320 con 0x7f2b280b96f0 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b7c40 0x7f2b2814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b7c40 0x7f2b2814a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40790/0 (socket says 172.21.15.99:40790) 2024-01-19T05:18:25.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 -- 172.21.15.99:0/2014249297 learned_addr learned my addr 172.21.15.99:0/2014249297 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 -- 172.21.15.99:0/2014249297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b280b96f0 msgr2=0x7f2b28141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b280b96f0 0x7f2b28141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 -- 172.21.15.99:0/2014249297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b28140e90 msgr2=0x7f2b28147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b28140e90 0x7f2b28147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 -- 172.21.15.99:0/2014249297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b100094d0 con 0x7f2b280b7c40 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b26ffd640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b7c40 0x7f2b2814a860 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2b1001abc0 tx=0x7f2b1001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b1ffff640 1 -- 172.21.15.99:0/2014249297 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100b38c0 con 0x7f2b280b7c40 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b1ffff640 1 -- 172.21.15.99:0/2014249297 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b100b3a40 con 0x7f2b280b7c40 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b1ffff640 1 -- 172.21.15.99:0/2014249297 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100b3df0 con 0x7f2b280b7c40 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b281425a0 con 0x7f2b280b7c40 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.009+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b28149830 con 0x7f2b280b7c40 2024-01-19T05:18:25.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.013+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b280696e0 con 0x7f2b280b7c40 2024-01-19T05:18:25.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.013+0000 7f2b1ffff640 1 -- 172.21.15.99:0/2014249297 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2b100c6440 con 0x7f2b280b7c40 2024-01-19T05:18:25.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.013+0000 7f2b1ffff640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2b08066500 0x7f2b080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.013+0000 7f2b1ffff640 1 -- 172.21.15.99:0/2014249297 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b1011ea20 con 0x7f2b280b7c40 2024-01-19T05:18:25.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.013+0000 7f2b1e7fc640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2b08066500 0x7f2b080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.013+0000 7f2b1e7fc640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2b08066500 0x7f2b080689c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b180011f0 tx=0x7f2b18007930 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.017+0000 7f2b1ffff640 1 -- 172.21.15.99:0/2014249297 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2b100ebd50 con 0x7f2b280b7c40 2024-01-19T05:18:25.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.161+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b280a15d0 con 0x7f2b280b7c40 2024-01-19T05:18:25.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.161+0000 7f2b1ffff640 1 -- 172.21.15.99:0/2014249297 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b100ef370 con 0x7f2b280b7c40 2024-01-19T05:18:25.161 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:25.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2b08066500 msgr2=0x7f2b080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2b08066500 0x7f2b080689c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b180011f0 tx=0x7f2b18007930 comp rx=0 tx=0).stop 2024-01-19T05:18:25.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b7c40 msgr2=0x7f2b2814a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b7c40 0x7f2b2814a860 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2b1001abc0 tx=0x7f2b1001ad50 comp rx=0 tx=0).stop 2024-01-19T05:18:25.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 shutdown_connections 2024-01-19T05:18:25.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2b08066500 0x7f2b080689c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b28140e90 0x7f2b28147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b280b96f0 0x7f2b28141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 --2- 172.21.15.99:0/2014249297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b280b7c40 0x7f2b2814a860 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 >> 172.21.15.99:0/2014249297 conn(0x7f2b2809e600 msgr2=0x7f2b28140550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:25.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 shutdown_connections 2024-01-19T05:18:25.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.165+0000 7f2b2d726640 1 -- 172.21.15.99:0/2014249297 wait complete. 2024-01-19T05:18:25.177 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:25.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.289+0000 7f60668fa640 1 Processor -- start 2024-01-19T05:18:25.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.289+0000 7f60668fa640 1 -- start start 2024-01-19T05:18:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.289+0000 7f60668fa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f60601441d0 0x7f606014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.289+0000 7f60668fa640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606006f620 con 0x7f60600b1870 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.289+0000 7f60668fa640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6060143610 con 0x7f60600b2ce0 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.289+0000 7f60668fa640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6060141000 con 0x7f60601441d0 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.289+0000 7f605f7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f60600b1870 0x7f6060143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60896/0 (socket says 172.21.15.99:60896) 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.289+0000 7f605f7fe640 1 -- 172.21.15.99:0/3192846424 learned_addr learned my addr 172.21.15.99:0/3192846424 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 --2- 172.21.15.99:0/3192846424 >> v2:172.21.15.157:3300/0 conn(0x7f60601441d0 0x7f606014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662941666 0 0) 0x7f606006f620 con 0x7f60600b1870 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f604c003530 con 0x7f60600b1870 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2239999414 0 0) 0x7f604c003530 con 0x7f60600b1870 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 >> v2:172.21.15.157:3300/0 conn(0x7f60601441d0 msgr2=0x7f606014edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 --2- 172.21.15.99:0/3192846424 >> v2:172.21.15.157:3300/0 conn(0x7f60601441d0 0x7f606014edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 >> v1:172.21.15.157:6789/0 conn(0x7f60600b2ce0 legacy=0x7f6060071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600b30c0 con 0x7f60600b1870 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f60480016a0 con 0x7f60600b1870 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 >> v1:172.21.15.99:6789/0 conn(0x7f60600b1870 legacy=0x7f6060143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f604c003980 0x7f604c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f604c0047d0 0x7f604c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f604c005190 0x7f604c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060141000 con 0x7f604c005190 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c00c0e0 con 0x7f604c003980 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c00c2a0 con 0x7f604c0047d0 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f604c005190 0x7f604c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605ffff640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f604c003980 0x7f604c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 -- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f604c0047d0 msgr2=0x7f604c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605f7fe640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f604c0047d0 0x7f604c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f604c0047d0 0x7f604c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 -- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f604c003980 msgr2=0x7f604c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f604c003980 0x7f604c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 -- 172.21.15.99:0/3192846424 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c003530 con 0x7f604c005190 2024-01-19T05:18:25.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605ffff640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f604c003980 0x7f604c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 -- 172.21.15.99:0/3192846424 reap_dead start 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f6064e97640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f604c005190 0x7f604c00b990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f605800ba30 tx=0x7f605801c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86330074e3fc145f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058004220 con 0x7f604c005190 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058004380 con 0x7f604c005190 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f605effd640 1 -- 172.21.15.99:0/3192846424 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058003860 con 0x7f604c005190 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f60668fa640 1 -- 172.21.15.99:0/3192846424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f604c005190 msgr2=0x7f604c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f60668fa640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f604c005190 0x7f604c00b990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f605800ba30 tx=0x7f605801c6c0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f60668fa640 1 -- 172.21.15.99:0/3192846424 shutdown_connections 2024-01-19T05:18:25.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f60668fa640 1 --2- 172.21.15.99:0/3192846424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f604c005190 0x7f604c00b990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f60668fa640 1 -- 172.21.15.99:0/3192846424 >> 172.21.15.99:0/3192846424 conn(0x7f60600b8080 msgr2=0x7f60600b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f60668fa640 1 -- 172.21.15.99:0/3192846424 shutdown_connections 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.293+0000 7f60668fa640 1 -- 172.21.15.99:0/3192846424 wait complete. 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 Processor -- start 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 -- start start 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f604c005190 0x7f60601ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60600b7810 0x7f60601cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60601cebf0 0x7f606013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60601cf9c0 con 0x7f60601cebf0 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60601cf120 con 0x7f60600b7810 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60601cf400 con 0x7f604c005190 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60601cebf0 0x7f606013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60601cebf0 0x7f606013e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40814/0 (socket says 172.21.15.99:40814) 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 -- 172.21.15.99:0/1366964428 learned_addr learned my addr 172.21.15.99:0/1366964428 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 -- 172.21.15.99:0/1366964428 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f604c005190 msgr2=0x7f60601ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f604c005190 0x7f60601ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 -- 172.21.15.99:0/1366964428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60600b7810 msgr2=0x7f60601cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60600b7810 0x7f60601cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 -- 172.21.15.99:0/1366964428 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606006f490 con 0x7f60601cebf0 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f6064e97640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60601cebf0 0x7f606013e320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f605801c4f0 tx=0x7f604c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f605cff9640 1 -- 172.21.15.99:0/1366964428 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580af070 con 0x7f60601cebf0 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f605cff9640 1 -- 172.21.15.99:0/1366964428 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60580044f0 con 0x7f60601cebf0 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60601cfc60 con 0x7f60601cebf0 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f605cff9640 1 -- 172.21.15.99:0/1366964428 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580b3410 con 0x7f60601cebf0 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60601cdd10 con 0x7f60601cebf0 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60600696e0 con 0x7f60601cebf0 2024-01-19T05:18:25.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f605cff9640 1 -- 172.21.15.99:0/1366964428 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f60580b3570 con 0x7f60601cebf0 2024-01-19T05:18:25.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.297+0000 7f605cff9640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6040066500 0x7f60400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.301+0000 7f605ffff640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6040066500 0x7f60400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.301+0000 7f605cff9640 1 -- 172.21.15.99:0/1366964428 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f605811d500 con 0x7f60601cebf0 2024-01-19T05:18:25.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.301+0000 7f605ffff640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6040066500 0x7f60400689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6050007fd0 tx=0x7f6050009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.305+0000 7f605cff9640 1 -- 172.21.15.99:0/1366964428 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f60580ee370 con 0x7f60601cebf0 2024-01-19T05:18:25.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.449+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60600b74c0 con 0x7f60601cebf0 2024-01-19T05:18:25.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.449+0000 7f605cff9640 1 -- 172.21.15.99:0/1366964428 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60580edf00 con 0x7f60601cebf0 2024-01-19T05:18:25.449 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6040066500 msgr2=0x7f60400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6040066500 0x7f60400689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6050007fd0 tx=0x7f6050009040 comp rx=0 tx=0).stop 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60601cebf0 msgr2=0x7f606013e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60601cebf0 0x7f606013e320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f605801c4f0 tx=0x7f604c005800 comp rx=0 tx=0).stop 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 shutdown_connections 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6040066500 0x7f60400689c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60601cebf0 0x7f606013e320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60600b7810 0x7f60601cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 --2- 172.21.15.99:0/1366964428 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f604c005190 0x7f60601ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 >> 172.21.15.99:0/1366964428 conn(0x7f60600b8080 msgr2=0x7f60600b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 shutdown_connections 2024-01-19T05:18:25.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.453+0000 7f60668fa640 1 -- 172.21.15.99:0/1366964428 wait complete. 2024-01-19T05:18:25.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:25.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.573+0000 7f2afebd8640 1 Processor -- start 2024-01-19T05:18:25.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.573+0000 7f2afebd8640 1 -- start start 2024-01-19T05:18:25.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afebd8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2af80b4df0 0x7f2af80714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afebd8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af8071a20 0x7f2af8146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afebd8640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af80b51d0 con 0x7f2af8146e70 2024-01-19T05:18:25.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afebd8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af8070dd0 con 0x7f2af80b4df0 2024-01-19T05:18:25.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afebd8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8147620 con 0x7f2af8071a20 2024-01-19T05:18:25.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afd175640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2af8146e70 0x7f2af8149dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60904/0 (socket says 172.21.15.99:60904) 2024-01-19T05:18:25.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afd175640 1 -- 172.21.15.99:0/19499434 learned_addr learned my addr 172.21.15.99:0/19499434 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:25.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afc974640 1 --2- 172.21.15.99:0/19499434 >> v2:172.21.15.157:3300/0 conn(0x7f2af80b4df0 0x7f2af80714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af7fff640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af8071a20 0x7f2af8146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172803969 0 0) 0x7f2af80b51d0 con 0x7f2af8146e70 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae0003530 con 0x7f2af8146e70 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 989234153 0 0) 0x7f2ae0003530 con 0x7f2af8146e70 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af8071a20 msgr2=0x7f2af8146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af8071a20 0x7f2af8146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 >> v2:172.21.15.157:3300/0 conn(0x7f2af80b4df0 msgr2=0x7f2af80714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 --2- 172.21.15.99:0/19499434 >> v2:172.21.15.157:3300/0 conn(0x7f2af80b4df0 0x7f2af80714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8070fe0 con 0x7f2af8146e70 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f2af0001a00 con 0x7f2af8146e70 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 >> v1:172.21.15.99:6789/0 conn(0x7f2af8146e70 legacy=0x7f2af8149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ae0003980 0x7f2ae0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af8071a20 0x7f2ae00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ae0004d10 0x7f2ae0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8070dd0 con 0x7f2ae0003980 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8147620 con 0x7f2ae0004d10 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae000b990 con 0x7f2af8071a20 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afc974640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ae0003980 0x7f2ae0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2af7fff640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af8071a20 0x7f2ae00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afd175640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ae0004d10 0x7f2ae0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afc974640 1 -- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af8071a20 msgr2=0x7f2ae00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afc974640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af8071a20 0x7f2ae00047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afc974640 1 -- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ae0004d10 msgr2=0x7f2ae0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afc974640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ae0004d10 0x7f2ae0005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.577+0000 7f2afc974640 1 -- 172.21.15.99:0/19499434 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0003530 con 0x7f2ae0003980 2024-01-19T05:18:25.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ae0003980 0x7f2ae0003da0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009b10 tx=0x7f2ae801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60801ec774ca65c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80a6470 con 0x7f2ae0003980 2024-01-19T05:18:25.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae80a65d0 con 0x7f2ae0003980 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2af77fe640 1 -- 172.21.15.99:0/19499434 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80a6980 con 0x7f2ae0003980 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- 172.21.15.99:0/19499434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ae0003980 msgr2=0x7f2ae0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 --2- 172.21.15.99:0/19499434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ae0003980 0x7f2ae0003da0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009b10 tx=0x7f2ae801ca90 comp rx=0 tx=0).stop 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afd175640 1 -- 172.21.15.99:0/19499434 reap_dead start 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- 172.21.15.99:0/19499434 shutdown_connections 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- 172.21.15.99:0/19499434 >> 172.21.15.99:0/19499434 conn(0x7f2af8066c40 msgr2=0x7f2af80ba190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- 172.21.15.99:0/19499434 shutdown_connections 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- 172.21.15.99:0/19499434 wait complete. 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 Processor -- start 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- start start 2024-01-19T05:18:25.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2af8142fb0 0x7f2af81e2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af80b0af0 0x7f2af81407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af8140d20 0x7f2af80b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80b0660 con 0x7f2af8142fb0 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8143390 con 0x7f2af8140d20 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80afe60 con 0x7f2af80b0af0 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2af8142fb0 0x7f2af81e2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2af8142fb0 0x7f2af81e2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40834/0 (socket says 172.21.15.99:40834) 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 -- 172.21.15.99:0/3337485006 learned_addr learned my addr 172.21.15.99:0/3337485006 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2af7fff640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af80b0af0 0x7f2af81407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afd175640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af8140d20 0x7f2af80b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 -- 172.21.15.99:0/3337485006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af80b0af0 msgr2=0x7f2af81407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af80b0af0 0x7f2af81407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 -- 172.21.15.99:0/3337485006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af8140d20 msgr2=0x7f2af80b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af8140d20 0x7f2af80b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 -- 172.21.15.99:0/3337485006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af80b1250 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afc974640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2af8142fb0 0x7f2af81e2550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ae801c8c0 tx=0x7f2ae8019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2af57fa640 1 -- 172.21.15.99:0/3337485006 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80bc450 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2af57fa640 1 -- 172.21.15.99:0/3337485006 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae80bc5b0 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af809ea50 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2af57fa640 1 -- 172.21.15.99:0/3337485006 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80bc940 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.581+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af80afb80 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.585+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af8067bf0 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.585+0000 7f2af57fa640 1 -- 172.21.15.99:0/3337485006 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2ae80bcaa0 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.585+0000 7f2af57fa640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ae4066530 0x7f2ae40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.585+0000 7f2af7fff640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ae4066530 0x7f2ae40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.585+0000 7f2af57fa640 1 -- 172.21.15.99:0/3337485006 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ae811e3c0 con 0x7f2af8142fb0 2024-01-19T05:18:25.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.585+0000 7f2af7fff640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ae4066530 0x7f2ae40689f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2af81dcc10 tx=0x7f2aec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.589+0000 7f2af57fa640 1 -- 172.21.15.99:0/3337485006 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2ae80eb650 con 0x7f2af8142fb0 2024-01-19T05:18:25.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.745+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2af80696e0 con 0x7f2af8142fb0 2024-01-19T05:18:25.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2af57fa640 1 -- 172.21.15.99:0/3337485006 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f2ae80eec70 con 0x7f2af8142fb0 2024-01-19T05:18:25.746 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:25.746 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:25.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ae4066530 msgr2=0x7f2ae40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ae4066530 0x7f2ae40689f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2af81dcc10 tx=0x7f2aec008040 comp rx=0 tx=0).stop 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2af8142fb0 msgr2=0x7f2af81e2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2af8142fb0 0x7f2af81e2550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ae801c8c0 tx=0x7f2ae8019830 comp rx=0 tx=0).stop 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 shutdown_connections 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2ae4066530 0x7f2ae40689f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af8140d20 0x7f2af80b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2af80b0af0 0x7f2af81407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 --2- 172.21.15.99:0/3337485006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2af8142fb0 0x7f2af81e2550 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 >> 172.21.15.99:0/3337485006 conn(0x7f2af8066c40 msgr2=0x7f2af8143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 shutdown_connections 2024-01-19T05:18:25.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.749+0000 7f2afebd8640 1 -- 172.21.15.99:0/3337485006 wait complete. 2024-01-19T05:18:25.764 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:25.765 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:25.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddf1ce8640 1 Processor -- start 2024-01-19T05:18:25.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddf1ce8640 1 -- start start 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddf1ce8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec0b19f0 0x7fddec06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddf1ce8640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec070680 con 0x7fddec144c70 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddf1ce8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec070410 con 0x7fddec0724f0 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddf1ce8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec144790 con 0x7fddec0b19f0 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeaffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fddec144c70 0x7fddec071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60912/0 (socket says 172.21.15.99:60912) 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeaffd640 1 -- 172.21.15.99:0/1671910765 learned_addr learned my addr 172.21.15.99:0/1671910765 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264761262 0 0) 0x7fddec070680 con 0x7fddec144c70 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeb7fe640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec0b19f0 0x7fddec06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd8003530 con 0x7fddec144c70 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3135770557 0 0) 0x7fddd8003530 con 0x7fddec144c70 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec0b19f0 msgr2=0x7fddec06ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec0b19f0 0x7fddec06ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 >> v1:172.21.15.157:6789/0 conn(0x7fddec0724f0 legacy=0x7fddec14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec06f2b0 con 0x7fddec144c70 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fddd4001680 con 0x7fddec144c70 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 >> v1:172.21.15.99:6789/0 conn(0x7fddec144c70 legacy=0x7fddec071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec0b19f0 0x7fddd80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd8003fe0 0x7fddd80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8004d10 0x7fddd8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec144790 con 0x7fddd8003fe0 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd800bbd0 con 0x7fddd8004d10 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd800bd90 con 0x7fddec0b19f0 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeaffd640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd8003fe0 0x7fddd80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeb7fe640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec0b19f0 0x7fddd80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddebfff640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8004d10 0x7fddd8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeaffd640 1 -- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec0b19f0 msgr2=0x7fddd80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeaffd640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec0b19f0 0x7fddd80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeaffd640 1 -- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8004d10 msgr2=0x7fddd8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:25.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeaffd640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8004d10 0x7fddd8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.885+0000 7fddeaffd640 1 -- 172.21.15.99:0/1671910765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8003530 con 0x7fddd8003fe0 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd8003fe0 0x7fddd80047d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c240 tx=0x7fddd401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509d575e5131f61b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40a5b50 con 0x7fddd8003fe0 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd40a5cb0 con 0x7fddd8003fe0 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddea7fc640 1 -- 172.21.15.99:0/1671910765 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40a5ea0 con 0x7fddd8003fe0 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- 172.21.15.99:0/1671910765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd8003fe0 msgr2=0x7fddd80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 --2- 172.21.15.99:0/1671910765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd8003fe0 0x7fddd80047d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c240 tx=0x7fddd401cbf0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddebfff640 1 -- 172.21.15.99:0/1671910765 reap_dead start 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- 172.21.15.99:0/1671910765 shutdown_connections 2024-01-19T05:18:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- 172.21.15.99:0/1671910765 >> 172.21.15.99:0/1671910765 conn(0x7fddec0b8080 msgr2=0x7fddec0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:25.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- 172.21.15.99:0/1671910765 shutdown_connections 2024-01-19T05:18:25.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- 172.21.15.99:0/1671910765 wait complete. 2024-01-19T05:18:25.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 Processor -- start 2024-01-19T05:18:25.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- start start 2024-01-19T05:18:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8003fe0 0x7fddec14dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddec14fb10 0x7fddec14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec14b600 0x7fddec1e0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec14e540 con 0x7fddec14fb10 2024-01-19T05:18:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec14ce60 con 0x7fddd8003fe0 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec14ea80 con 0x7fddec14b600 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddec14fb10 0x7fddec14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddec14fb10 0x7fddec14b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40848/0 (socket says 172.21.15.99:40848) 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 -- 172.21.15.99:0/4155573389 learned_addr learned my addr 172.21.15.99:0/4155573389 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddebfff640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec14b600 0x7fddec1e0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeb7fe640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8003fe0 0x7fddec14dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 -- 172.21.15.99:0/4155573389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec14b600 msgr2=0x7fddec1e0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec14b600 0x7fddec1e0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 -- 172.21.15.99:0/4155573389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8003fe0 msgr2=0x7fddec14dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8003fe0 0x7fddec14dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 -- 172.21.15.99:0/4155573389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0a88e0 con 0x7fddec14fb10 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddeaffd640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddec14fb10 0x7fddec14b0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fddd401b2f0 tx=0x7fddd8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fdde3fff640 1 -- 172.21.15.99:0/4155573389 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40b4070 con 0x7fddec14fb10 2024-01-19T05:18:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fdde3fff640 1 -- 172.21.15.99:0/4155573389 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4001440 con 0x7fddec14fb10 2024-01-19T05:18:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec0a8bc0 con 0x7fddec14fb10 2024-01-19T05:18:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fdde3fff640 1 -- 172.21.15.99:0/4155573389 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40047f0 con 0x7fddec14fb10 2024-01-19T05:18:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.889+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec14e6e0 con 0x7fddec14fb10 2024-01-19T05:18:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.893+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec0b4870 con 0x7fddec14fb10 2024-01-19T05:18:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.893+0000 7fdde3fff640 1 -- 172.21.15.99:0/4155573389 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fddd4004950 con 0x7fddec14fb10 2024-01-19T05:18:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.893+0000 7fdde3fff640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066500 0x7fddcc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.893+0000 7fdde3fff640 1 -- 172.21.15.99:0/4155573389 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddd411dcf0 con 0x7fddec14fb10 2024-01-19T05:18:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.893+0000 7fddeb7fe640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066500 0x7fddcc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:25.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.893+0000 7fddeb7fe640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066500 0x7fddcc0689c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00ba90 tx=0x7fdddc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:25.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:25.897+0000 7fdde3fff640 1 -- 172.21.15.99:0/4155573389 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fddd40eb030 con 0x7fddec14fb10 2024-01-19T05:18:26.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.053+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fddec0696e0 con 0x7fddec14fb10 2024-01-19T05:18:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.053+0000 7fdde3fff640 1 -- 172.21.15.99:0/4155573389 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddd40ee650 con 0x7fddec14fb10 2024-01-19T05:18:26.054 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066500 msgr2=0x7fddcc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066500 0x7fddcc0689c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00ba90 tx=0x7fdddc008040 comp rx=0 tx=0).stop 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddec14fb10 msgr2=0x7fddec14b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddec14fb10 0x7fddec14b0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fddd401b2f0 tx=0x7fddd8005800 comp rx=0 tx=0).stop 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 shutdown_connections 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066500 0x7fddcc0689c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddec14b600 0x7fddec1e0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddec14fb10 0x7fddec14b0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 --2- 172.21.15.99:0/4155573389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd8003fe0 0x7fddec14dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 >> 172.21.15.99:0/4155573389 conn(0x7fddec0b8080 msgr2=0x7fddec0b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 shutdown_connections 2024-01-19T05:18:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.057+0000 7fddf1ce8640 1 -- 172.21.15.99:0/4155573389 wait complete. 2024-01-19T05:18:26.072 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:26.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0cd26640 1 Processor -- start 2024-01-19T05:18:26.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0cd26640 1 -- start start 2024-01-19T05:18:26.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0cd26640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3f080b1870 0x7f3f08143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0cd26640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0806f620 con 0x7f3f080b2ce0 2024-01-19T05:18:26.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0cd26640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f08143610 con 0x7f3f08144000 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0cd26640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f08141000 con 0x7f3f080b1870 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0659c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3f080b2ce0 0x7f3f08071f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60922/0 (socket says 172.21.15.99:60922) 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0659c640 1 -- 172.21.15.99:0/3924296208 learned_addr learned my addr 172.21.15.99:0/3924296208 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f05d9b640 1 --2- 172.21.15.99:0/3924296208 >> v2:172.21.15.99:3300/0 conn(0x7f3f080b1870 0x7f3f08143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0559a640 1 -- 172.21.15.99:0/3924296208 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532906505 0 0) 0x7f3f0806f620 con 0x7f3f080b2ce0 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f0559a640 1 -- 172.21.15.99:0/3924296208 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef0003530 con 0x7f3f080b2ce0 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f05d9b640 1 -- 172.21.15.99:0/3924296208 >> v1:172.21.15.157:6789/0 conn(0x7f3f08144000 legacy=0x7f3f0814dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f05d9b640 1 -- 172.21.15.99:0/3924296208 >> v1:172.21.15.99:6789/0 conn(0x7f3f080b2ce0 legacy=0x7f3f08071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.185+0000 7f3f05d9b640 1 -- 172.21.15.99:0/3924296208 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f08144470 con 0x7f3f080b1870 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f05d9b640 1 --2- 172.21.15.99:0/3924296208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b1870 0x7f3f08143ac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30772b2afdbd7a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0559a640 1 -- 172.21.15.99:0/3924296208 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0ab680 con 0x7f3f080b1870 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0559a640 1 -- 172.21.15.99:0/3924296208 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0ab7e0 con 0x7f3f080b1870 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0559a640 1 -- 172.21.15.99:0/3924296208 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0abb70 con 0x7f3f080b1870 2024-01-19T05:18:26.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 -- 172.21.15.99:0/3924296208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b1870 msgr2=0x7f3f08143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 --2- 172.21.15.99:0/3924296208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b1870 0x7f3f08143ac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01c480 comp rx=0 tx=0).stop 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 -- 172.21.15.99:0/3924296208 shutdown_connections 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 --2- 172.21.15.99:0/3924296208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b1870 0x7f3f08143ac0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 -- 172.21.15.99:0/3924296208 >> 172.21.15.99:0/3924296208 conn(0x7f3f080b8080 msgr2=0x7f3f080b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 -- 172.21.15.99:0/3924296208 shutdown_connections 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 -- 172.21.15.99:0/3924296208 wait complete. 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 Processor -- start 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.189+0000 7f3f0cd26640 1 -- start start 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b2ce0 0x7f3f080b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f08144000 0x7f3f0813e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f080a9ab0 0x7f3f0813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080a9fc0 con 0x7f3f080b2ce0 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080aa2a0 con 0x7f3f080a9ab0 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0813d410 con 0x7f3f08144000 2024-01-19T05:18:26.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b2ce0 0x7f3f080b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b2ce0 0x7f3f080b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40874/0 (socket says 172.21.15.99:40874) 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 -- 172.21.15.99:0/2889116861 learned_addr learned my addr 172.21.15.99:0/2889116861 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 -- 172.21.15.99:0/2889116861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f08144000 msgr2=0x7f3f0813e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f08144000 0x7f3f0813e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 -- 172.21.15.99:0/2889116861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f080a9ab0 msgr2=0x7f3f0813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f06d9d640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f080a9ab0 0x7f3f0813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f080a9ab0 0x7f3f0813e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 -- 172.21.15.99:0/2889116861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc009420 con 0x7f3f080b2ce0 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0659c640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b2ce0 0x7f3f080b7610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800c4d0 tx=0x7f3ef800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3ef6ffd640 1 -- 172.21.15.99:0/2889116861 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8005cf0 con 0x7f3f080b2ce0 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3ef6ffd640 1 -- 172.21.15.99:0/2889116861 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef8005e50 con 0x7f3f080b2ce0 2024-01-19T05:18:26.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f080a8890 con 0x7f3f080b2ce0 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3ef6ffd640 1 -- 172.21.15.99:0/2889116861 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8007270 con 0x7f3f080b2ce0 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f080a8e50 con 0x7f3f080b2ce0 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0813dfd0 con 0x7f3f080b2ce0 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3ef6ffd640 1 -- 172.21.15.99:0/2889116861 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3ef80073d0 con 0x7f3f080b2ce0 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3ef6ffd640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ee8066500 0x7f3ee80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3ef6ffd640 1 -- 172.21.15.99:0/2889116861 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ef80832e0 con 0x7f3f080b2ce0 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f05d9b640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ee8066500 0x7f3ee80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.193+0000 7f3f05d9b640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ee8066500 0x7f3ee80689c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0af000 tx=0x7f3efc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.197+0000 7f3ef6ffd640 1 -- 172.21.15.99:0/2889116861 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3f0813dfd0 con 0x7f3f080b2ce0 2024-01-19T05:18:26.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.345+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f0813dfd0 con 0x7f3f080b2ce0 2024-01-19T05:18:26.344 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:26.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.345+0000 7f3ef6ffd640 1 -- 172.21.15.99:0/2889116861 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f0813dfd0 con 0x7f3f080b2ce0 2024-01-19T05:18:26.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ee8066500 msgr2=0x7f3ee80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ee8066500 0x7f3ee80689c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0af000 tx=0x7f3efc008040 comp rx=0 tx=0).stop 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b2ce0 msgr2=0x7f3f080b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b2ce0 0x7f3f080b7610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800c4d0 tx=0x7f3ef800c990 comp rx=0 tx=0).stop 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 shutdown_connections 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f3ee8066500 0x7f3ee80689c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f080a9ab0 0x7f3f0813e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f08144000 0x7f3f0813e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 --2- 172.21.15.99:0/2889116861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f080b2ce0 0x7f3f080b7610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 >> 172.21.15.99:0/2889116861 conn(0x7f3f080b8080 msgr2=0x7f3f081415c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 shutdown_connections 2024-01-19T05:18:26.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.349+0000 7f3f0cd26640 1 -- 172.21.15.99:0/2889116861 wait complete. 2024-01-19T05:18:26.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:26.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.473+0000 7f7e0325f640 1 Processor -- start 2024-01-19T05:18:26.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.473+0000 7f7e0325f640 1 -- start start 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e0325f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0b19f0 0x7f7dfc06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e0325f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7dfc0724f0 0x7f7dfc1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e0325f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dfc070680 con 0x7f7dfc144c70 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e0325f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dfc070410 con 0x7f7dfc0724f0 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e0325f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc144790 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e00ffb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0b19f0 0x7f7dfc06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e017fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7dfc0724f0 0x7f7dfc1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7dfbfff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7dfc144c70 0x7f7dfc071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:34478/0 (socket says 172.21.15.99:34478) 2024-01-19T05:18:26.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7dfbfff640 1 -- 172.21.15.99:0/911159107 learned_addr learned my addr 172.21.15.99:0/911159107 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:26.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e017fc640 1 -- 172.21.15.99:0/911159107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0b19f0 msgr2=0x7f7dfc06ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:26.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e017fc640 1 --2- 172.21.15.99:0/911159107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0b19f0 0x7f7dfc06ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e017fc640 1 -- 172.21.15.99:0/911159107 >> v1:172.21.15.157:6789/0 conn(0x7f7dfc144c70 legacy=0x7f7dfc071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e017fc640 1 -- 172.21.15.99:0/911159107 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc06f2b0 con 0x7f7dfc0724f0 2024-01-19T05:18:26.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7e017fc640 1 --2- 172.21.15.99:0/911159107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc0724f0 0x7f7dfc1450d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0097c0 tx=0x7f7dec01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c6d7bb33e2be93 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7dfb7fe640 1 -- 172.21.15.99:0/911159107 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec004230 con 0x7f7dfc0724f0 2024-01-19T05:18:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7dfb7fe640 1 -- 172.21.15.99:0/911159107 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec0a7050 con 0x7f7dfc0724f0 2024-01-19T05:18:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.477+0000 7f7dfb7fe640 1 -- 172.21.15.99:0/911159107 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec003620 con 0x7f7dfc0724f0 2024-01-19T05:18:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- 172.21.15.99:0/911159107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc0724f0 msgr2=0x7f7dfc1450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 --2- 172.21.15.99:0/911159107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc0724f0 0x7f7dfc1450d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0097c0 tx=0x7f7dec01c3f0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- 172.21.15.99:0/911159107 shutdown_connections 2024-01-19T05:18:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 --2- 172.21.15.99:0/911159107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc0724f0 0x7f7dfc1450d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 --2- 172.21.15.99:0/911159107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0b19f0 0x7f7dfc06ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- 172.21.15.99:0/911159107 >> 172.21.15.99:0/911159107 conn(0x7f7dfc0b8080 msgr2=0x7f7dfc0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- 172.21.15.99:0/911159107 shutdown_connections 2024-01-19T05:18:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- 172.21.15.99:0/911159107 wait complete. 2024-01-19T05:18:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 Processor -- start 2024-01-19T05:18:26.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- start start 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0724f0 0x7f7dfc143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc0b19f0 0x7f7dfc1e0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc144c70 0x7f7dfc13f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc140b50 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc1dfd30 con 0x7f7dfc144c70 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc1dffd0 con 0x7f7dfc0724f0 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc0b19f0 0x7f7dfc1e0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc0b19f0 0x7f7dfc1e0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40876/0 (socket says 172.21.15.99:40876) 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 -- 172.21.15.99:0/2752201993 learned_addr learned my addr 172.21.15.99:0/2752201993 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:26.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e00ffb640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0724f0 0x7f7dfc143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e017fc640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc144c70 0x7f7dfc13f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 -- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0724f0 msgr2=0x7f7dfc143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0724f0 0x7f7dfc143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 -- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc144c70 msgr2=0x7f7dfc13f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc144c70 0x7f7dfc13f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 -- 172.21.15.99:0/2752201993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec009420 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e017fc640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc144c70 0x7f7dfc13f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7dfbfff640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc0b19f0 0x7f7dfc1e0460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c420 tx=0x7f7df400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7df97fa640 1 -- 172.21.15.99:0/2752201993 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4005cf0 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7df97fa640 1 -- 172.21.15.99:0/2752201993 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df4005e50 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dfc13ec90 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7df97fa640 1 -- 172.21.15.99:0/2752201993 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df40072f0 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.481+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dfc140920 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.485+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dfc0696e0 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.485+0000 7f7df97fa640 1 -- 172.21.15.99:0/2752201993 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7df4007450 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.485+0000 7f7df97fa640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ddc066500 0x7f7ddc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.485+0000 7f7e00ffb640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ddc066500 0x7f7ddc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.485+0000 7f7df97fa640 1 -- 172.21.15.99:0/2752201993 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7df4083380 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.485+0000 7f7e00ffb640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ddc066500 0x7f7ddc0689c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7de40074a0 tx=0x7f7de400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.489+0000 7f7df97fa640 1 -- 172.21.15.99:0/2752201993 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7df40506b0 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.633+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7dfc13d640 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.633+0000 7f7df97fa640 1 -- 172.21.15.99:0/2752201993 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7df40170a0 con 0x7f7dfc0b19f0 2024-01-19T05:18:26.632 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:26.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ddc066500 msgr2=0x7f7ddc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ddc066500 0x7f7ddc0689c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7de40074a0 tx=0x7f7de400b040 comp rx=0 tx=0).stop 2024-01-19T05:18:26.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc0b19f0 msgr2=0x7f7dfc1e0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc0b19f0 0x7f7dfc1e0460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c420 tx=0x7f7df400c8e0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 shutdown_connections 2024-01-19T05:18:26.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7ddc066500 0x7f7ddc0689c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7dfc144c70 0x7f7dfc13f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc0b19f0 0x7f7dfc1e0460 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 --2- 172.21.15.99:0/2752201993 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7dfc0724f0 0x7f7dfc143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 >> 172.21.15.99:0/2752201993 conn(0x7f7dfc0b8080 msgr2=0x7f7dfc0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:26.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 shutdown_connections 2024-01-19T05:18:26.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.637+0000 7f7e0325f640 1 -- 172.21.15.99:0/2752201993 wait complete. 2024-01-19T05:18:26.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.765+0000 7f940ba51640 1 Processor -- start 2024-01-19T05:18:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.765+0000 7f940ba51640 1 -- start start 2024-01-19T05:18:26.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f940ba51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94040b19f0 0x7f940406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f940ba51640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9404144c70 0x7f94041450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f940ba51640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9404071de0 0x7f9404072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f940ba51640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9404070680 con 0x7f9404144c70 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f940ba51640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9404070410 con 0x7f9404071de0 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f940ba51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9404144790 con 0x7f94040b19f0 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9404144c70 0x7f94041450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9404144c70 0x7f94041450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40886/0 (socket says 172.21.15.99:40886) 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 -- 172.21.15.99:0/1105672569 learned_addr learned my addr 172.21.15.99:0/1105672569 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f94097ed640 1 --2- 172.21.15.99:0/1105672569 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94040b19f0 0x7f940406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9409fee640 1 --2- 172.21.15.99:0/1105672569 >> v2:172.21.15.157:3300/0 conn(0x7f9404071de0 0x7f9404072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 -- 172.21.15.99:0/1105672569 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94040b19f0 msgr2=0x7f940406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 --2- 172.21.15.99:0/1105672569 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94040b19f0 0x7f940406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 -- 172.21.15.99:0/1105672569 >> v2:172.21.15.157:3300/0 conn(0x7f9404071de0 msgr2=0x7f9404072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:26.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 --2- 172.21.15.99:0/1105672569 >> v2:172.21.15.157:3300/0 conn(0x7f9404071de0 0x7f9404072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 -- 172.21.15.99:0/1105672569 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940406f2b0 con 0x7f9404144c70 2024-01-19T05:18:26.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9409fee640 1 --2- 172.21.15.99:0/1105672569 >> v2:172.21.15.157:3300/0 conn(0x7f9404071de0 0x7f9404072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:26.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f9408fec640 1 --2- 172.21.15.99:0/1105672569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041450d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f94040b8ce0 tx=0x7f940001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6b583c4530f364 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f93fbfff640 1 -- 172.21.15.99:0/1105672569 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000ad640 con 0x7f9404144c70 2024-01-19T05:18:26.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f93fbfff640 1 -- 172.21.15.99:0/1105672569 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000ad7a0 con 0x7f9404144c70 2024-01-19T05:18:26.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.769+0000 7f93fbfff640 1 -- 172.21.15.99:0/1105672569 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000adb30 con 0x7f9404144c70 2024-01-19T05:18:26.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- 172.21.15.99:0/1105672569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 msgr2=0x7f94041450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 --2- 172.21.15.99:0/1105672569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041450d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f94040b8ce0 tx=0x7f940001c470 comp rx=0 tx=0).stop 2024-01-19T05:18:26.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- 172.21.15.99:0/1105672569 shutdown_connections 2024-01-19T05:18:26.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 --2- 172.21.15.99:0/1105672569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041450d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 --2- 172.21.15.99:0/1105672569 >> v2:172.21.15.157:3300/0 conn(0x7f9404071de0 0x7f9404072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 --2- 172.21.15.99:0/1105672569 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94040b19f0 0x7f940406ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- 172.21.15.99:0/1105672569 >> 172.21.15.99:0/1105672569 conn(0x7f94040b8080 msgr2=0x7f94040b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:26.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- 172.21.15.99:0/1105672569 shutdown_connections 2024-01-19T05:18:26.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- 172.21.15.99:0/1105672569 wait complete. 2024-01-19T05:18:26.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 Processor -- start 2024-01-19T05:18:26.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- start start 2024-01-19T05:18:26.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9404071de0 0x7f9404146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94040b19f0 0x7f940413e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9404149510 con 0x7f9404144c70 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940413deb0 con 0x7f94040b19f0 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940414aa30 con 0x7f9404071de0 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041e09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40890/0 (socket says 172.21.15.99:40890) 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 -- 172.21.15.99:0/2593780530 learned_addr learned my addr 172.21.15.99:0/2593780530 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9408fec640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94040b19f0 0x7f940413e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f94097ed640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9404071de0 0x7f9404146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 -- 172.21.15.99:0/2593780530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9404071de0 msgr2=0x7f9404146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9404071de0 0x7f9404146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 -- 172.21.15.99:0/2593780530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94040b19f0 msgr2=0x7f940413e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94040b19f0 0x7f940413e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 -- 172.21.15.99:0/2593780530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94000094d0 con 0x7f9404144c70 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f9409fee640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041e09d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00cef0 tx=0x7f93fc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f93f9ffb640 1 -- 172.21.15.99:0/2593780530 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00d840 con 0x7f9404144c70 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f93f9ffb640 1 -- 172.21.15.99:0/2593780530 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc00d9c0 con 0x7f9404144c70 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9404149700 con 0x7f9404144c70 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f93f9ffb640 1 -- 172.21.15.99:0/2593780530 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00dd70 con 0x7f9404144c70 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940413d2f0 con 0x7f9404144c70 2024-01-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.773+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940413e020 con 0x7f9404144c70 2024-01-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.777+0000 7f93f9ffb640 1 -- 172.21.15.99:0/2593780530 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f93fc01e3b0 con 0x7f9404144c70 2024-01-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.777+0000 7f93f9ffb640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93e8066500 0x7f93e80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.777+0000 7f93f9ffb640 1 -- 172.21.15.99:0/2593780530 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93fc084c30 con 0x7f9404144c70 2024-01-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.777+0000 7f94097ed640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93e8066500 0x7f93e80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.777+0000 7f94097ed640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93e8066500 0x7f93e80689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93f400b7e0 tx=0x7f93f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.781+0000 7f93f9ffb640 1 -- 172.21.15.99:0/2593780530 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f93fc052100 con 0x7f9404144c70 2024-01-19T05:18:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.937+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94040696e0 con 0x7f9404144c70 2024-01-19T05:18:26.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f93f9ffb640 1 -- 172.21.15.99:0/2593780530 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f93fc01a090 con 0x7f9404144c70 2024-01-19T05:18:26.938 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:26.939 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93e8066500 msgr2=0x7f93e80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93e8066500 0x7f93e80689c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93f400b7e0 tx=0x7f93f4008040 comp rx=0 tx=0).stop 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 msgr2=0x7f94041e09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041e09d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00cef0 tx=0x7f93fc00a710 comp rx=0 tx=0).stop 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 shutdown_connections 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93e8066500 0x7f93e80689c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404144c70 0x7f94041e09d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94040b19f0 0x7f940413e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 --2- 172.21.15.99:0/2593780530 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9404071de0 0x7f9404146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 >> 172.21.15.99:0/2593780530 conn(0x7f94040b8080 msgr2=0x7f9404071430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 shutdown_connections 2024-01-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:26.941+0000 7f940ba51640 1 -- 172.21.15.99:0/2593780530 wait complete. 2024-01-19T05:18:26.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:26.958 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca852f7640 1 Processor -- start 2024-01-19T05:18:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca852f7640 1 -- start start 2024-01-19T05:18:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca852f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca800b4530 0x7fca800b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca852f7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca800b3f40 0x7fca8014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca852f7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca800afe50 con 0x7fca800b9970 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca852f7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800af900 con 0x7fca800b3f40 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca852f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800b0830 con 0x7fca800b4530 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7effd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fca800b9970 0x7fca8013e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60930/0 (socket says 172.21.15.99:60930) 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7effd640 1 -- 172.21.15.99:0/497795600 learned_addr learned my addr 172.21.15.99:0/497795600 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7e7fc640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca800b4530 0x7fca800b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7f7fe640 1 --2- 172.21.15.99:0/497795600 >> v2:172.21.15.157:3300/0 conn(0x7fca800b3f40 0x7fca8014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328796079 0 0) 0x7fca800afe50 con 0x7fca800b9970 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca68003530 con 0x7fca800b9970 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1385837030 0 0) 0x7fca68003530 con 0x7fca800b9970 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca800b4530 msgr2=0x7fca800b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca800b4530 0x7fca800b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 >> v2:172.21.15.157:3300/0 conn(0x7fca800b3f40 msgr2=0x7fca8014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 --2- 172.21.15.99:0/497795600 >> v2:172.21.15.157:3300/0 conn(0x7fca800b3f40 0x7fca8014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800b1490 con 0x7fca800b9970 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fca70001680 con 0x7fca800b9970 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 >> v1:172.21.15.99:6789/0 conn(0x7fca800b9970 legacy=0x7fca8013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca68003980 0x7fca68003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca800b4530 0x7fca680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca68004d10 0x7fca68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca800af900 con 0x7fca68004d10 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6800b990 con 0x7fca68003980 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6800bad0 con 0x7fca800b4530 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7f7fe640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca68004d10 0x7fca68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7effd640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca68003980 0x7fca68003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7e7fc640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca800b4530 0x7fca680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7f7fe640 1 -- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca800b4530 msgr2=0x7fca680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7f7fe640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca800b4530 0x7fca680047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7f7fe640 1 -- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca68003980 msgr2=0x7fca68003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:27.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7f7fe640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca68003980 0x7fca68003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.081+0000 7fca7f7fe640 1 -- 172.21.15.99:0/497795600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68003530 con 0x7fca68004d10 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7f7fe640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca68004d10 0x7fca68005190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca78009fc0 tx=0x7fca7801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a564c342df0e2f90 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780a5ba0 con 0x7fca68004d10 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800f040 con 0x7fca68004d10 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7dffb640 1 -- 172.21.15.99:0/497795600 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780ad440 con 0x7fca68004d10 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- 172.21.15.99:0/497795600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca68004d10 msgr2=0x7fca68005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 --2- 172.21.15.99:0/497795600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca68004d10 0x7fca68005190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca78009fc0 tx=0x7fca7801cca0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7f7fe640 1 -- 172.21.15.99:0/497795600 reap_dead start 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- 172.21.15.99:0/497795600 shutdown_connections 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- 172.21.15.99:0/497795600 >> 172.21.15.99:0/497795600 conn(0x7fca800669f0 msgr2=0x7fca800b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:27.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- 172.21.15.99:0/497795600 shutdown_connections 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- 172.21.15.99:0/497795600 wait complete. 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 Processor -- start 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- start start 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca80147ee0 0x7fca80146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80145ad0 0x7fca80070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80146c70 0x7fca80071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8012eb20 con 0x7fca80146c70 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca80147800 con 0x7fca80145ad0 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca852f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8013f5b0 con 0x7fca80147ee0 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80146c70 0x7fca80071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80146c70 0x7fca80071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40906/0 (socket says 172.21.15.99:40906) 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7f7fe640 1 -- 172.21.15.99:0/2987557888 learned_addr learned my addr 172.21.15.99:0/2987557888 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7effd640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca80147ee0 0x7fca80146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7e7fc640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80145ad0 0x7fca80070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.085+0000 7fca7f7fe640 1 -- 172.21.15.99:0/2987557888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca80147ee0 msgr2=0x7fca80146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca7f7fe640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca80147ee0 0x7fca80146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca7f7fe640 1 -- 172.21.15.99:0/2987557888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80145ad0 msgr2=0x7fca80070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca7f7fe640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80145ad0 0x7fca80070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca7f7fe640 1 -- 172.21.15.99:0/2987557888 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8012ed00 con 0x7fca80146c70 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca7f7fe640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80146c70 0x7fca80071210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca7801c710 tx=0x7fca78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca677fe640 1 -- 172.21.15.99:0/2987557888 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780039a0 con 0x7fca80146c70 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca677fe640 1 -- 172.21.15.99:0/2987557888 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78003b20 con 0x7fca80146c70 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca801471b0 con 0x7fca80146c70 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca677fe640 1 -- 172.21.15.99:0/2987557888 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780ad880 con 0x7fca80146c70 2024-01-19T05:18:27.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca801482c0 con 0x7fca80146c70 2024-01-19T05:18:27.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca80067bf0 con 0x7fca80146c70 2024-01-19T05:18:27.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca677fe640 1 -- 172.21.15.99:0/2987557888 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fca780b4040 con 0x7fca80146c70 2024-01-19T05:18:27.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca677fe640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fca6c066500 0x7fca6c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca677fe640 1 -- 172.21.15.99:0/2987557888 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca7811dc30 con 0x7fca80146c70 2024-01-19T05:18:27.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca7effd640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fca6c066500 0x7fca6c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.089+0000 7fca7effd640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fca6c066500 0x7fca6c0689c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca70004850 tx=0x7fca70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.093+0000 7fca677fe640 1 -- 172.21.15.99:0/2987557888 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fca780eaed0 con 0x7fca80146c70 2024-01-19T05:18:27.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.249+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca800b11c0 con 0x7fca80146c70 2024-01-19T05:18:27.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.249+0000 7fca677fe640 1 -- 172.21.15.99:0/2987557888 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca780ee4f0 con 0x7fca80146c70 2024-01-19T05:18:27.248 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:27.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.249+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fca6c066500 msgr2=0x7fca6c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.249+0000 7fca852f7640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fca6c066500 0x7fca6c0689c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca70004850 tx=0x7fca70009040 comp rx=0 tx=0).stop 2024-01-19T05:18:27.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.249+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80146c70 msgr2=0x7fca80071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.249+0000 7fca852f7640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80146c70 0x7fca80071210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca7801c710 tx=0x7fca78009750 comp rx=0 tx=0).stop 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.253+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 shutdown_connections 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.253+0000 7fca852f7640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fca6c066500 0x7fca6c0689c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.253+0000 7fca852f7640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca80146c70 0x7fca80071210 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.253+0000 7fca852f7640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80145ad0 0x7fca80070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.253+0000 7fca852f7640 1 --2- 172.21.15.99:0/2987557888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca80147ee0 0x7fca80146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.253+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 >> 172.21.15.99:0/2987557888 conn(0x7fca800669f0 msgr2=0x7fca800b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.253+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 shutdown_connections 2024-01-19T05:18:27.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.253+0000 7fca852f7640 1 -- 172.21.15.99:0/2987557888 wait complete. 2024-01-19T05:18:27.267 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:27.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.389+0000 7f4b032d7640 1 Processor -- start 2024-01-19T05:18:27.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.389+0000 7f4b032d7640 1 -- start start 2024-01-19T05:18:27.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b032d7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4afc0afbc0 0x7f4afc071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b032d7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc072410 0x7f4afc155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b032d7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4afc0b03d0 con 0x7f4afc0af7e0 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b032d7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4afc0b12e0 con 0x7f4afc0afbc0 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b032d7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0b0eb0 con 0x7f4afc072410 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b00872640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4afc0afbc0 0x7f4afc071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b01874640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc072410 0x7f4afc155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b01073640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4afc0af7e0 0x7f4afc14ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:34492/0 (socket says 172.21.15.99:34492) 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b01073640 1 -- 172.21.15.99:0/3048925788 learned_addr learned my addr 172.21.15.99:0/3048925788 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b00872640 1 -- 172.21.15.99:0/3048925788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc072410 msgr2=0x7f4afc155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b00872640 1 --2- 172.21.15.99:0/3048925788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc072410 0x7f4afc155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b00872640 1 -- 172.21.15.99:0/3048925788 >> v1:172.21.15.157:6789/0 conn(0x7f4afc0af7e0 legacy=0x7f4afc14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.393+0000 7f4b00872640 1 -- 172.21.15.99:0/3048925788 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0b06b0 con 0x7f4afc0afbc0 2024-01-19T05:18:27.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b00872640 1 --2- 172.21.15.99:0/3048925788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 0x7f4afc071ed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0097c0 tx=0x7f4aec01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfd11d2fb46575f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4af3fff640 1 -- 172.21.15.99:0/3048925788 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0ad640 con 0x7f4afc0afbc0 2024-01-19T05:18:27.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4af3fff640 1 -- 172.21.15.99:0/3048925788 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec0ad7a0 con 0x7f4afc0afbc0 2024-01-19T05:18:27.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4af3fff640 1 -- 172.21.15.99:0/3048925788 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0adb30 con 0x7f4afc0afbc0 2024-01-19T05:18:27.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- 172.21.15.99:0/3048925788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 msgr2=0x7f4afc071ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 --2- 172.21.15.99:0/3048925788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 0x7f4afc071ed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0097c0 tx=0x7f4aec01c480 comp rx=0 tx=0).stop 2024-01-19T05:18:27.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- 172.21.15.99:0/3048925788 shutdown_connections 2024-01-19T05:18:27.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 --2- 172.21.15.99:0/3048925788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc072410 0x7f4afc155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 --2- 172.21.15.99:0/3048925788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 0x7f4afc071ed0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- 172.21.15.99:0/3048925788 >> 172.21.15.99:0/3048925788 conn(0x7f4afc0b8080 msgr2=0x7f4afc0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:27.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- 172.21.15.99:0/3048925788 shutdown_connections 2024-01-19T05:18:27.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- 172.21.15.99:0/3048925788 wait complete. 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 Processor -- start 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- start start 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4afc072410 0x7f4afc141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc0af7e0 0x7f4afc14c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 0x7f4afc14cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc14da60 con 0x7f4afc072410 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc14df00 con 0x7f4afc0afbc0 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc14ed20 con 0x7f4afc0af7e0 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4afc072410 0x7f4afc141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4afc072410 0x7f4afc141010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40922/0 (socket says 172.21.15.99:40922) 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 -- 172.21.15.99:0/121130416 learned_addr learned my addr 172.21.15.99:0/121130416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:27.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01874640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 0x7f4afc14cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b00872640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc0af7e0 0x7f4afc14c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 -- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc0af7e0 msgr2=0x7f4afc14c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc0af7e0 0x7f4afc14c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 -- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 msgr2=0x7f4afc14cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 0x7f4afc14cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 -- 172.21.15.99:0/121130416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec009420 con 0x7f4afc072410 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01874640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 0x7f4afc14cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b01073640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4afc072410 0x7f4afc141010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c530 tx=0x7f4af800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4af1ffb640 1 -- 172.21.15.99:0/121130416 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8005cf0 con 0x7f4afc072410 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4afc14c0e0 con 0x7f4afc072410 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4af1ffb640 1 -- 172.21.15.99:0/121130416 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af8005e50 con 0x7f4afc072410 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4af1ffb640 1 -- 172.21.15.99:0/121130416 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8007270 con 0x7f4afc072410 2024-01-19T05:18:27.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.397+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc141800 con 0x7f4afc072410 2024-01-19T05:18:27.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.401+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc14ef40 con 0x7f4afc072410 2024-01-19T05:18:27.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.401+0000 7f4af1ffb640 1 -- 172.21.15.99:0/121130416 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4af80073d0 con 0x7f4afc072410 2024-01-19T05:18:27.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.401+0000 7f4af1ffb640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4ae0066530 0x7f4ae00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.401+0000 7f4af1ffb640 1 -- 172.21.15.99:0/121130416 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4af80832f0 con 0x7f4afc072410 2024-01-19T05:18:27.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.401+0000 7f4b00872640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4ae0066530 0x7f4ae00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.401+0000 7f4b00872640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4ae0066530 0x7f4ae00689f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0af000 tx=0x7f4aec0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.405+0000 7f4af1ffb640 1 -- 172.21.15.99:0/121130416 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4afc14ef40 con 0x7f4afc072410 2024-01-19T05:18:27.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.565+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4afc14eb70 con 0x7f4afc072410 2024-01-19T05:18:27.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.565+0000 7f4af1ffb640 1 -- 172.21.15.99:0/121130416 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4af8050650 con 0x7f4afc072410 2024-01-19T05:18:27.565 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4ae0066530 msgr2=0x7f4ae00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4ae0066530 0x7f4ae00689f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0af000 tx=0x7f4aec0a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4afc072410 msgr2=0x7f4afc141010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4afc072410 0x7f4afc141010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c530 tx=0x7f4af800c9f0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 shutdown_connections 2024-01-19T05:18:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4ae0066530 0x7f4ae00689f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4afc0afbc0 0x7f4afc14cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4afc0af7e0 0x7f4afc14c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 --2- 172.21.15.99:0/121130416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4afc072410 0x7f4afc141010 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 >> 172.21.15.99:0/121130416 conn(0x7f4afc0b8080 msgr2=0x7f4afc0b7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 shutdown_connections 2024-01-19T05:18:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.569+0000 7f4b032d7640 1 -- 172.21.15.99:0/121130416 wait complete. 2024-01-19T05:18:27.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:27.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff354ac6640 1 Processor -- start 2024-01-19T05:18:27.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff354ac6640 1 -- start start 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff354ac6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3500b19f0 0x7ff35006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff354ac6640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff350144c70 0x7ff3501450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff354ac6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff350071de0 0x7ff350072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff354ac6640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff350070680 con 0x7ff350144c70 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff354ac6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff350070410 con 0x7ff350071de0 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff354ac6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff350144790 con 0x7ff3500b19f0 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff34dd9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff350144c70 0x7ff3501450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff34dd9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff350144c70 0x7ff3501450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40928/0 (socket says 172.21.15.99:40928) 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff34dd9b640 1 -- 172.21.15.99:0/803631262 learned_addr learned my addr 172.21.15.99:0/803631262 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:27.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff34e59c640 1 --2- 172.21.15.99:0/803631262 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3500b19f0 0x7ff35006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff34ed9d640 1 --2- 172.21.15.99:0/803631262 >> v2:172.21.15.157:3300/0 conn(0x7ff350071de0 0x7ff350072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff34dd9b640 1 -- 172.21.15.99:0/803631262 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3500b19f0 msgr2=0x7ff35006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:27.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.701+0000 7ff34dd9b640 1 --2- 172.21.15.99:0/803631262 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3500b19f0 0x7ff35006ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff34dd9b640 1 -- 172.21.15.99:0/803631262 >> v2:172.21.15.157:3300/0 conn(0x7ff350071de0 msgr2=0x7ff350072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:27.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff34dd9b640 1 --2- 172.21.15.99:0/803631262 >> v2:172.21.15.157:3300/0 conn(0x7ff350071de0 0x7ff350072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff34dd9b640 1 -- 172.21.15.99:0/803631262 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35006f2b0 con 0x7ff350144c70 2024-01-19T05:18:27.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff34e59c640 1 --2- 172.21.15.99:0/803631262 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3500b19f0 0x7ff35006ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff34dd9b640 1 --2- 172.21.15.99:0/803631262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350144c70 0x7ff3501450d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3500b8ce0 tx=0x7ff34001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3fe4c37a88ef30 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff34d59a640 1 -- 172.21.15.99:0/803631262 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3400ad640 con 0x7ff350144c70 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff34d59a640 1 -- 172.21.15.99:0/803631262 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3400ad7a0 con 0x7ff350144c70 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff34d59a640 1 -- 172.21.15.99:0/803631262 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3400adb30 con 0x7ff350144c70 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 -- 172.21.15.99:0/803631262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350144c70 msgr2=0x7ff3501450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 --2- 172.21.15.99:0/803631262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350144c70 0x7ff3501450d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3500b8ce0 tx=0x7ff34001c470 comp rx=0 tx=0).stop 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 -- 172.21.15.99:0/803631262 shutdown_connections 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 --2- 172.21.15.99:0/803631262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350144c70 0x7ff3501450d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 --2- 172.21.15.99:0/803631262 >> v2:172.21.15.157:3300/0 conn(0x7ff350071de0 0x7ff350072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 --2- 172.21.15.99:0/803631262 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3500b19f0 0x7ff35006ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 -- 172.21.15.99:0/803631262 >> 172.21.15.99:0/803631262 conn(0x7ff3500b8080 msgr2=0x7ff3500b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:27.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 -- 172.21.15.99:0/803631262 shutdown_connections 2024-01-19T05:18:27.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.705+0000 7ff354ac6640 1 -- 172.21.15.99:0/803631262 wait complete. 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 Processor -- start 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 -- start start 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350071de0 0x7ff350146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3500b19f0 0x7ff35013c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff350144c70 0x7ff350139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350142250 con 0x7ff350071de0 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35013ea10 con 0x7ff3500b19f0 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35013e420 con 0x7ff350144c70 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350071de0 0x7ff350146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350071de0 0x7ff350146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40942/0 (socket says 172.21.15.99:40942) 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 -- 172.21.15.99:0/1823349477 learned_addr learned my addr 172.21.15.99:0/1823349477 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 -- 172.21.15.99:0/1823349477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff350144c70 msgr2=0x7ff350139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff350144c70 0x7ff350139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 -- 172.21.15.99:0/1823349477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3500b19f0 msgr2=0x7ff35013c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3500b19f0 0x7ff35013c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 -- 172.21.15.99:0/1823349477 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400094d0 con 0x7ff350071de0 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34e59c640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350071de0 0x7ff350146a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c7f0 tx=0x7ff34400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff33effd640 1 -- 172.21.15.99:0/1823349477 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34400cea0 con 0x7ff350071de0 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff33effd640 1 -- 172.21.15.99:0/1823349477 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344007a30 con 0x7ff350071de0 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff350141ca0 con 0x7ff350071de0 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff33effd640 1 -- 172.21.15.99:0/1823349477 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344007dc0 con 0x7ff350071de0 2024-01-19T05:18:27.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3500a8ea0 con 0x7ff350071de0 2024-01-19T05:18:27.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3500696e0 con 0x7ff350071de0 2024-01-19T05:18:27.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff33effd640 1 -- 172.21.15.99:0/1823349477 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff3440113f0 con 0x7ff350071de0 2024-01-19T05:18:27.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff33effd640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff330066500 0x7ff3300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:27.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff33effd640 1 -- 172.21.15.99:0/1823349477 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff344083ea0 con 0x7ff350071de0 2024-01-19T05:18:27.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.709+0000 7ff34dd9b640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff330066500 0x7ff3300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:27.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.713+0000 7ff34dd9b640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff330066500 0x7ff3300689c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3400af000 tx=0x7ff340004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:27.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.713+0000 7ff33effd640 1 -- 172.21.15.99:0/1823349477 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff3440511d0 con 0x7ff350071de0 2024-01-19T05:18:27.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.869+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff350142030 con 0x7ff350071de0 2024-01-19T05:18:27.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.869+0000 7ff33effd640 1 -- 172.21.15.99:0/1823349477 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3440547f0 con 0x7ff350071de0 2024-01-19T05:18:27.870 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff330066500 msgr2=0x7ff3300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff330066500 0x7ff3300689c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3400af000 tx=0x7ff340004740 comp rx=0 tx=0).stop 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350071de0 msgr2=0x7ff350146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350071de0 0x7ff350146a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c7f0 tx=0x7ff34400ccb0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 shutdown_connections 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff330066500 0x7ff3300689c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff350144c70 0x7ff350139470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3500b19f0 0x7ff35013c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 --2- 172.21.15.99:0/1823349477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff350071de0 0x7ff350146a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 >> 172.21.15.99:0/1823349477 conn(0x7ff3500b8080 msgr2=0x7ff350070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 shutdown_connections 2024-01-19T05:18:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:27.873+0000 7ff354ac6640 1 -- 172.21.15.99:0/1823349477 wait complete. 2024-01-19T05:18:27.925 INFO:tasks.cephfs_test_runner:Starting test: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) Test that when cd is issued with an argument, CWD is changed 2024-01-19T05:18:27.926 INFO:tasks.cephfs_test_runner:test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-01-19T05:18:27.926 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:28.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62ba0e4640 1 Processor -- start 2024-01-19T05:18:28.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62ba0e4640 1 -- start start 2024-01-19T05:18:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62ba0e4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f62b40b2ce0 0x7f62b4071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62ba0e4640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b406f620 con 0x7f62b41441d0 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62ba0e4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b4143610 con 0x7f62b40b1870 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62ba0e4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b4141000 con 0x7f62b40b2ce0 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b3fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f62b41441d0 0x7f62b414dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60940/0 (socket says 172.21.15.99:60940) 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b3fff640 1 -- 172.21.15.99:0/4114538904 learned_addr learned my addr 172.21.15.99:0/4114538904 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b37fe640 1 --2- 172.21.15.99:0/4114538904 >> v2:172.21.15.157:3300/0 conn(0x7f62b40b2ce0 0x7f62b4071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934291748 0 0) 0x7f62b406f620 con 0x7f62b41441d0 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f629c005740 con 0x7f62b41441d0 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2571250742 0 0) 0x7f629c005740 con 0x7f62b41441d0 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 >> v2:172.21.15.157:3300/0 conn(0x7f62b40b2ce0 msgr2=0x7f62b4071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 --2- 172.21.15.99:0/4114538904 >> v2:172.21.15.157:3300/0 conn(0x7f62b40b2ce0 0x7f62b4071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 >> v1:172.21.15.157:6789/0 conn(0x7f62b40b1870 legacy=0x7f62b4143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40b30c0 con 0x7f62b41441d0 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f62ac0016a0 con 0x7f62b41441d0 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 >> v1:172.21.15.99:6789/0 conn(0x7f62b41441d0 legacy=0x7f62b414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f629c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f629c0069e0 0x7f629c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f629c0073a0 0x7f629c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4141000 con 0x7f629c005b90 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c00e240 con 0x7f629c0073a0 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c00e400 con 0x7f629c0069e0 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b37fe640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f629c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b3fff640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f629c0073a0 0x7f629c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b2ffd640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f629c0069e0 0x7f629c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b37fe640 1 -- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f629c0069e0 msgr2=0x7f629c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b37fe640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f629c0069e0 0x7f629c006e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.041+0000 7f62b37fe640 1 -- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f629c0073a0 msgr2=0x7f629c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62b37fe640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f629c0073a0 0x7f629c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62b37fe640 1 -- 172.21.15.99:0/4114538904 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c005740 con 0x7f629c005b90 2024-01-19T05:18:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62b3fff640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f629c0073a0 0x7f629c00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62b3fff640 1 -- 172.21.15.99:0/4114538904 reap_dead start 2024-01-19T05:18:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62b37fe640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f629c005fb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009fc0 tx=0x7f62a401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6513bc03d0ebd36f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40a5c20 con 0x7f629c005b90 2024-01-19T05:18:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a400f040 con 0x7f629c005b90 2024-01-19T05:18:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62b27fc640 1 -- 172.21.15.99:0/4114538904 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40ad440 con 0x7f629c005b90 2024-01-19T05:18:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62ba0e4640 1 -- 172.21.15.99:0/4114538904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 msgr2=0x7f629c005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62ba0e4640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f629c005fb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009fc0 tx=0x7f62a401cc30 comp rx=0 tx=0).stop 2024-01-19T05:18:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62ba0e4640 1 -- 172.21.15.99:0/4114538904 shutdown_connections 2024-01-19T05:18:28.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62ba0e4640 1 --2- 172.21.15.99:0/4114538904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f629c005fb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62ba0e4640 1 -- 172.21.15.99:0/4114538904 >> 172.21.15.99:0/4114538904 conn(0x7f62b40b8080 msgr2=0x7f62b40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:28.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62ba0e4640 1 -- 172.21.15.99:0/4114538904 shutdown_connections 2024-01-19T05:18:28.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.045+0000 7f62ba0e4640 1 -- 172.21.15.99:0/4114538904 wait complete. 2024-01-19T05:18:28.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 Processor -- start 2024-01-19T05:18:28.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 -- start start 2024-01-19T05:18:28.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f62b40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62b4144660 0x7f62b406fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62b406ff80 0x7f62b41de260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41465d0 con 0x7f629c005b90 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4145b60 con 0x7f62b406ff80 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41456d0 con 0x7f62b4144660 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f62b40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f62b40711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40968/0 (socket says 172.21.15.99:40968) 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 -- 172.21.15.99:0/2091870102 learned_addr learned my addr 172.21.15.99:0/2091870102 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b2ffd640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62b4144660 0x7f62b406fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b3fff640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62b406ff80 0x7f62b41de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 -- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62b4144660 msgr2=0x7f62b406fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62b4144660 0x7f62b406fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 -- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62b406ff80 msgr2=0x7f62b41de260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62b406ff80 0x7f62b41de260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 -- 172.21.15.99:0/2091870102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4145dd0 con 0x7f629c005b90 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b3fff640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62b406ff80 0x7f62b41de260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62b37fe640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f62b40711e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b0040 tx=0x7f62a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f629bfff640 1 -- 172.21.15.99:0/2091870102 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4003ba0 con 0x7f629c005b90 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f629bfff640 1 -- 172.21.15.99:0/2091870102 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4003d00 con 0x7f629c005b90 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f629bfff640 1 -- 172.21.15.99:0/2091870102 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4004240 con 0x7f629c005b90 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b41460b0 con 0x7f629c005b90 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b4146800 con 0x7f629c005b90 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b406a870 con 0x7f629c005b90 2024-01-19T05:18:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f629bfff640 1 -- 172.21.15.99:0/2091870102 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f62a40b4040 con 0x7f629c005b90 2024-01-19T05:18:28.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.049+0000 7f629bfff640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f62a0066500 0x7f62a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.053+0000 7f629bfff640 1 -- 172.21.15.99:0/2091870102 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62a411e540 con 0x7f629c005b90 2024-01-19T05:18:28.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.053+0000 7f62b2ffd640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f62a0066500 0x7f62a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.053+0000 7f62b2ffd640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f62a0066500 0x7f62a00689c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f62b4136e60 tx=0x7f62a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.057+0000 7f629bfff640 1 -- 172.21.15.99:0/2091870102 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f62a40eba40 con 0x7f629c005b90 2024-01-19T05:18:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.205+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62b4146240 con 0x7f629c005b90 2024-01-19T05:18:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.209+0000 7f629bfff640 1 -- 172.21.15.99:0/2091870102 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f62a40ef060 con 0x7f629c005b90 2024-01-19T05:18:28.208 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:28.208 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.209+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f62a0066500 msgr2=0x7f62a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.209+0000 7f62ba0e4640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f62a0066500 0x7f62a00689c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f62b4136e60 tx=0x7f62a8009040 comp rx=0 tx=0).stop 2024-01-19T05:18:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.209+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 msgr2=0x7f62b40711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.209+0000 7f62ba0e4640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f62b40711e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b0040 tx=0x7f62a4009750 comp rx=0 tx=0).stop 2024-01-19T05:18:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.213+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 shutdown_connections 2024-01-19T05:18:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.213+0000 7f62ba0e4640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f62a0066500 0x7f62a00689c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.213+0000 7f62ba0e4640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62b406ff80 0x7f62b41de260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.213+0000 7f62ba0e4640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62b4144660 0x7f62b406fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.213+0000 7f62ba0e4640 1 --2- 172.21.15.99:0/2091870102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f629c005b90 0x7f62b40711e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.213+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 >> 172.21.15.99:0/2091870102 conn(0x7f62b40b8080 msgr2=0x7f62b40af460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:28.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.213+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 shutdown_connections 2024-01-19T05:18:28.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.213+0000 7f62ba0e4640 1 -- 172.21.15.99:0/2091870102 wait complete. 2024-01-19T05:18:28.225 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:28.225 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:28.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.337+0000 7fcecb95c640 1 Processor -- start 2024-01-19T05:18:28.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.337+0000 7fcecb95c640 1 -- start start 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.337+0000 7fcecb95c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b96f0 0x7fcec40b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcecb95c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcec40b7c40 0x7fcec4140780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcecb95c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec40b87f0 con 0x7fcec4140cc0 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcecb95c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec4141150 con 0x7fcec40b7c40 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcecb95c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec40b9ad0 con 0x7fcec40b96f0 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec8ef7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcec40b7c40 0x7fcec4140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec9ef9640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcec4140cc0 0x7fcec4149e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60950/0 (socket says 172.21.15.99:60950) 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec9ef9640 1 -- 172.21.15.99:0/1585698896 learned_addr learned my addr 172.21.15.99:0/1585698896 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec96f8640 1 --2- 172.21.15.99:0/1585698896 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b96f0 0x7fcec40b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec8ef7640 1 -- 172.21.15.99:0/1585698896 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b96f0 msgr2=0x7fcec40b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec8ef7640 1 --2- 172.21.15.99:0/1585698896 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b96f0 0x7fcec40b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec8ef7640 1 -- 172.21.15.99:0/1585698896 >> v1:172.21.15.99:6789/0 conn(0x7fcec4140cc0 legacy=0x7fcec4149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcebbfff640 1 -- 172.21.15.99:0/1585698896 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848030308 0 0) 0x7fcec40b87f0 con 0x7fcec4140cc0 2024-01-19T05:18:28.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec8ef7640 1 -- 172.21.15.99:0/1585698896 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec40b81e0 con 0x7fcec40b7c40 2024-01-19T05:18:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcec8ef7640 1 --2- 172.21.15.99:0/1585698896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b7c40 0x7fcec4140780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097c0 tx=0x7fceb401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9047318f22f2dfdf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcebbfff640 1 -- 172.21.15.99:0/1585698896 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40ac600 con 0x7fcec40b7c40 2024-01-19T05:18:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcebbfff640 1 -- 172.21.15.99:0/1585698896 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb40a8050 con 0x7fcec40b7c40 2024-01-19T05:18:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.341+0000 7fcebbfff640 1 -- 172.21.15.99:0/1585698896 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40ac980 con 0x7fcec40b7c40 2024-01-19T05:18:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- 172.21.15.99:0/1585698896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b7c40 msgr2=0x7fcec4140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 --2- 172.21.15.99:0/1585698896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b7c40 0x7fcec4140780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097c0 tx=0x7fceb401c480 comp rx=0 tx=0).stop 2024-01-19T05:18:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- 172.21.15.99:0/1585698896 shutdown_connections 2024-01-19T05:18:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 --2- 172.21.15.99:0/1585698896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b7c40 0x7fcec4140780 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 --2- 172.21.15.99:0/1585698896 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b96f0 0x7fcec40b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- 172.21.15.99:0/1585698896 >> 172.21.15.99:0/1585698896 conn(0x7fcec409e600 msgr2=0x7fcec40b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- 172.21.15.99:0/1585698896 shutdown_connections 2024-01-19T05:18:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- 172.21.15.99:0/1585698896 wait complete. 2024-01-19T05:18:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 Processor -- start 2024-01-19T05:18:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- start start 2024-01-19T05:18:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b7c40 0x7fcec413fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b96f0 0x7fcec413e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec4140cc0 0x7fcec41e2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec413f200 con 0x7fcec40b96f0 2024-01-19T05:18:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec413deb0 con 0x7fcec4140cc0 2024-01-19T05:18:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec413e190 con 0x7fcec40b7c40 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b96f0 0x7fcec413e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b96f0 0x7fcec413e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40990/0 (socket says 172.21.15.99:40990) 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 -- 172.21.15.99:0/4181171577 learned_addr learned my addr 172.21.15.99:0/4181171577 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 -- 172.21.15.99:0/4181171577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b7c40 msgr2=0x7fcec413fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b7c40 0x7fcec413fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 -- 172.21.15.99:0/4181171577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec4140cc0 msgr2=0x7fcec41e2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec4140cc0 0x7fcec41e2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 -- 172.21.15.99:0/4181171577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4009420 con 0x7fcec40b96f0 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcec8ef7640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b96f0 0x7fcec413e6f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fceb401ab30 tx=0x7fceb401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fceb9ffb640 1 -- 172.21.15.99:0/4181171577 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40b7860 con 0x7fcec40b96f0 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fceb9ffb640 1 -- 172.21.15.99:0/4181171577 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb40b79c0 con 0x7fcec40b96f0 2024-01-19T05:18:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fceb9ffb640 1 -- 172.21.15.99:0/4181171577 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40b7d70 con 0x7fcec40b96f0 2024-01-19T05:18:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec413f4e0 con 0x7fcec40b96f0 2024-01-19T05:18:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec413ee00 con 0x7fcec40b96f0 2024-01-19T05:18:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.345+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec413ef90 con 0x7fcec40b96f0 2024-01-19T05:18:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.349+0000 7fceb9ffb640 1 -- 172.21.15.99:0/4181171577 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fceb40b3070 con 0x7fcec40b96f0 2024-01-19T05:18:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.349+0000 7fceb9ffb640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcea8066500 0x7fcea80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.349+0000 7fceb9ffb640 1 -- 172.21.15.99:0/4181171577 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceb411e590 con 0x7fcec40b96f0 2024-01-19T05:18:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.349+0000 7fcec96f8640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcea8066500 0x7fcea80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.349+0000 7fcec96f8640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcea8066500 0x7fcea80689c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcec000a8b0 tx=0x7fcec0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.353+0000 7fceb9ffb640 1 -- 172.21.15.99:0/4181171577 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fceb40eb8c0 con 0x7fcec40b96f0 2024-01-19T05:18:28.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.493+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcec40a15d0 con 0x7fcec40b96f0 2024-01-19T05:18:28.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fceb9ffb640 1 -- 172.21.15.99:0/4181171577 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fceb40eeee0 con 0x7fcec40b96f0 2024-01-19T05:18:28.494 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:28.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcea8066500 msgr2=0x7fcea80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcea8066500 0x7fcea80689c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcec000a8b0 tx=0x7fcec0008040 comp rx=0 tx=0).stop 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b96f0 msgr2=0x7fcec413e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b96f0 0x7fcec413e6f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fceb401ab30 tx=0x7fceb401acc0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 shutdown_connections 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcea8066500 0x7fcea80689c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcec4140cc0 0x7fcec41e2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcec40b96f0 0x7fcec413e6f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 --2- 172.21.15.99:0/4181171577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcec40b7c40 0x7fcec413fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 >> 172.21.15.99:0/4181171577 conn(0x7fcec409e600 msgr2=0x7fcec40ba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 shutdown_connections 2024-01-19T05:18:28.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.497+0000 7fcecb95c640 1 -- 172.21.15.99:0/4181171577 wait complete. 2024-01-19T05:18:28.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40e5d4640 1 Processor -- start 2024-01-19T05:18:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40e5d4640 1 -- start start 2024-01-19T05:18:28.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40e5d4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff408140780 0x7ff408140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40e5d4640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080b87f0 con 0x7ff40814f1b0 2024-01-19T05:18:28.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40e5d4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080b9ad0 con 0x7ff4080b96f0 2024-01-19T05:18:28.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40e5d4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff408141120 con 0x7ff408140780 2024-01-19T05:18:28.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40cb71640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff40814f1b0 0x7ff4081515a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60966/0 (socket says 172.21.15.99:60966) 2024-01-19T05:18:28.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40cb71640 1 -- 172.21.15.99:0/2086362148 learned_addr learned my addr 172.21.15.99:0/2086362148 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:28.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff4077fe640 1 --2- 172.21.15.99:0/2086362148 >> v2:172.21.15.157:3300/0 conn(0x7ff408140780 0x7ff408140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250629178 0 0) 0x7ff4080b87f0 con 0x7ff40814f1b0 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f0003530 con 0x7ff40814f1b0 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2447779177 0 0) 0x7ff3f0003530 con 0x7ff40814f1b0 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 >> v2:172.21.15.157:3300/0 conn(0x7ff408140780 msgr2=0x7ff408140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 --2- 172.21.15.99:0/2086362148 >> v2:172.21.15.157:3300/0 conn(0x7ff408140780 0x7ff408140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 >> v1:172.21.15.157:6789/0 conn(0x7ff4080b96f0 legacy=0x7ff4080b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080b81e0 con 0x7ff40814f1b0 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7ff400001680 con 0x7ff40814f1b0 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 >> v1:172.21.15.99:6789/0 conn(0x7ff40814f1b0 legacy=0x7ff4081515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f0003980 0x7ff3f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f00047d0 0x7ff3f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3f0005190 0x7ff3f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408141120 con 0x7ff3f0003980 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f000c060 con 0x7ff3f00047d0 2024-01-19T05:18:28.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f000c220 con 0x7ff3f0005190 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff407fff640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f0003980 0x7ff3f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff4077fe640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f00047d0 0x7ff3f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff407fff640 1 -- 172.21.15.99:0/2086362148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3f0005190 msgr2=0x7ff3f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40cb71640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3f0005190 0x7ff3f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff407fff640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3f0005190 0x7ff3f000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff407fff640 1 -- 172.21.15.99:0/2086362148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f00047d0 msgr2=0x7ff3f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff407fff640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f00047d0 0x7ff3f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff407fff640 1 -- 172.21.15.99:0/2086362148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0003530 con 0x7ff3f0003980 2024-01-19T05:18:28.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.629+0000 7ff40cb71640 1 -- 172.21.15.99:0/2086362148 reap_dead start 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff407fff640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f0003980 0x7ff3f0003dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8001e70 tx=0x7ff3f801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80752377130474b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8003b80 con 0x7ff3f0003980 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f8003ce0 con 0x7ff3f0003980 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff406ffd640 1 -- 172.21.15.99:0/2086362148 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f80052c0 con 0x7ff3f0003980 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- 172.21.15.99:0/2086362148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f0003980 msgr2=0x7ff3f0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f0003980 0x7ff3f0003dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8001e70 tx=0x7ff3f801c740 comp rx=0 tx=0).stop 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- 172.21.15.99:0/2086362148 shutdown_connections 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 --2- 172.21.15.99:0/2086362148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f0003980 0x7ff3f0003dc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- 172.21.15.99:0/2086362148 >> 172.21.15.99:0/2086362148 conn(0x7ff40809e600 msgr2=0x7ff4080b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:28.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- 172.21.15.99:0/2086362148 shutdown_connections 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- 172.21.15.99:0/2086362148 wait complete. 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 Processor -- start 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- start start 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f0003980 0x7ff408148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff40809b190 0x7ff4081e30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4081e3630 0x7ff4081df8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40809b9e0 con 0x7ff40809b190 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40813a130 con 0x7ff3f0003980 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081df4c0 con 0x7ff4081e3630 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff40809b190 0x7ff4081e30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff40809b190 0x7ff4081e30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41016/0 (socket says 172.21.15.99:41016) 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 -- 172.21.15.99:0/850311301 learned_addr learned my addr 172.21.15.99:0/850311301 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:28.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff407fff640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f0003980 0x7ff408148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40cb71640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4081e3630 0x7ff4081df8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 -- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4081e3630 msgr2=0x7ff4081df8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4081e3630 0x7ff4081df8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 -- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f0003980 msgr2=0x7ff408148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f0003980 0x7ff408148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 -- 172.21.15.99:0/850311301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40809f340 con 0x7ff40809b190 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff407fff640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f0003980 0x7ff408148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff4077fe640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff40809b190 0x7ff4081e30f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc011500 tx=0x7ff3fc0119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff404ff9640 1 -- 172.21.15.99:0/850311301 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc015870 con 0x7ff40809b190 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff404ff9640 1 -- 172.21.15.99:0/850311301 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0159d0 con 0x7ff40809b190 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff404ff9640 1 -- 172.21.15.99:0/850311301 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc015d40 con 0x7ff40809b190 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40809b700 con 0x7ff40809b190 2024-01-19T05:18:28.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.633+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff408149770 con 0x7ff40809b190 2024-01-19T05:18:28.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.637+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4081e2a30 con 0x7ff40809b190 2024-01-19T05:18:28.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.637+0000 7ff404ff9640 1 -- 172.21.15.99:0/850311301 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff3fc013400 con 0x7ff40809b190 2024-01-19T05:18:28.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.637+0000 7ff404ff9640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff3f4066530 0x7ff3f40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.637+0000 7ff404ff9640 1 -- 172.21.15.99:0/850311301 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3fc084580 con 0x7ff40809b190 2024-01-19T05:18:28.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.637+0000 7ff407fff640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff3f4066530 0x7ff3f40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.637+0000 7ff407fff640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff3f4066530 0x7ff3f40689f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8001e70 tx=0x7ff3f8001520 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.641+0000 7ff404ff9640 1 -- 172.21.15.99:0/850311301 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff4081e2a30 con 0x7ff40809b190 2024-01-19T05:18:28.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.797+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4080b30a0 con 0x7ff40809b190 2024-01-19T05:18:28.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.797+0000 7ff404ff9640 1 -- 172.21.15.99:0/850311301 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3fc0518e0 con 0x7ff40809b190 2024-01-19T05:18:28.796 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff3f4066530 msgr2=0x7ff3f40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff3f4066530 0x7ff3f40689f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8001e70 tx=0x7ff3f8001520 comp rx=0 tx=0).stop 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff40809b190 msgr2=0x7ff4081e30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff40809b190 0x7ff4081e30f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc011500 tx=0x7ff3fc0119c0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 shutdown_connections 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff3f4066530 0x7ff3f40689f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4081e3630 0x7ff4081df8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff40809b190 0x7ff4081e30f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 --2- 172.21.15.99:0/850311301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f0003980 0x7ff408148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 >> 172.21.15.99:0/850311301 conn(0x7ff40809e600 msgr2=0x7ff40814e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 shutdown_connections 2024-01-19T05:18:28.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.801+0000 7ff40e5d4640 1 -- 172.21.15.99:0/850311301 wait complete. 2024-01-19T05:18:28.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:28.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e2e40640 1 Processor -- start 2024-01-19T05:18:28.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e2e40640 1 -- start start 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e2e40640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80dc06a940 0x7f80dc0af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e2e40640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80dc09bc20 0x7f80dc14a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e2e40640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc0b0270 con 0x7f80dc14abd0 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e2e40640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc09e5b0 con 0x7f80dc09bc20 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e2e40640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc146a60 con 0x7f80dc06a940 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80dbfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80dc09bc20 0x7f80dc14a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80dbfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80dc09bc20 0x7f80dc14a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41028/0 (socket says 172.21.15.99:41028) 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80dbfff640 1 -- 172.21.15.99:0/1353226392 learned_addr learned my addr 172.21.15.99:0/1353226392 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e13dd640 1 --1- 172.21.15.99:0/1353226392 >> v1:172.21.15.99:6789/0 conn(0x7f80dc14abd0 0x7f80dc146ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60968/0 (socket says 172.21.15.99:60968) 2024-01-19T05:18:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e0bdc640 1 --2- 172.21.15.99:0/1353226392 >> v2:172.21.15.157:3300/0 conn(0x7f80dc06a940 0x7f80dc0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80dbfff640 1 -- 172.21.15.99:0/1353226392 >> v2:172.21.15.157:3300/0 conn(0x7f80dc06a940 msgr2=0x7f80dc0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80dbfff640 1 --2- 172.21.15.99:0/1353226392 >> v2:172.21.15.157:3300/0 conn(0x7f80dc06a940 0x7f80dc0af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80dbfff640 1 -- 172.21.15.99:0/1353226392 >> v1:172.21.15.99:6789/0 conn(0x7f80dc14abd0 legacy=0x7f80dc146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80dbfff640 1 -- 172.21.15.99:0/1353226392 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc06ad20 con 0x7f80dc09bc20 2024-01-19T05:18:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80e0bdc640 1 --2- 172.21.15.99:0/1353226392 >> v2:172.21.15.157:3300/0 conn(0x7f80dc06a940 0x7f80dc0af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80dbfff640 1 --2- 172.21.15.99:0/1353226392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc09bc20 0x7f80dc14a690 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0b9c00 tx=0x7f80cc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d23ea3d2d61571 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80db7fe640 1 -- 172.21.15.99:0/1353226392 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0ab600 con 0x7f80dc09bc20 2024-01-19T05:18:28.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80db7fe640 1 -- 172.21.15.99:0/1353226392 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc0a7050 con 0x7f80dc09bc20 2024-01-19T05:18:28.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.929+0000 7f80db7fe640 1 -- 172.21.15.99:0/1353226392 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0ab980 con 0x7f80dc09bc20 2024-01-19T05:18:28.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- 172.21.15.99:0/1353226392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc09bc20 msgr2=0x7f80dc14a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 --2- 172.21.15.99:0/1353226392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc09bc20 0x7f80dc14a690 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0b9c00 tx=0x7f80cc01c3e0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- 172.21.15.99:0/1353226392 shutdown_connections 2024-01-19T05:18:28.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 --2- 172.21.15.99:0/1353226392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc09bc20 0x7f80dc14a690 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 --2- 172.21.15.99:0/1353226392 >> v2:172.21.15.157:3300/0 conn(0x7f80dc06a940 0x7f80dc0af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- 172.21.15.99:0/1353226392 >> 172.21.15.99:0/1353226392 conn(0x7f80dc066ef0 msgr2=0x7f80dc0b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:28.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- 172.21.15.99:0/1353226392 shutdown_connections 2024-01-19T05:18:28.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- 172.21.15.99:0/1353226392 wait complete. 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 Processor -- start 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- start start 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc06a940 0x7f80dc09b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80dc09bc20 0x7f80dc1e2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80dc14abd0 0x7f80dc1365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0b8310 con 0x7f80dc06a940 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc149ee0 con 0x7f80dc14abd0 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0b8820 con 0x7f80dc09bc20 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc06a940 0x7f80dc09b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc06a940 0x7f80dc09b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41030/0 (socket says 172.21.15.99:41030) 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 -- 172.21.15.99:0/754857308 learned_addr learned my addr 172.21.15.99:0/754857308 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:28.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 -- 172.21.15.99:0/754857308 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80dc09bc20 msgr2=0x7f80dc1e2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80dc09bc20 0x7f80dc1e2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 -- 172.21.15.99:0/754857308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80dc14abd0 msgr2=0x7f80dc1365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e13dd640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80dc14abd0 0x7f80dc1365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80dc14abd0 0x7f80dc1365d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 -- 172.21.15.99:0/754857308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc0094d0 con 0x7f80dc06a940 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e0bdc640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc06a940 0x7f80dc09b2c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c7c0 tx=0x7f80d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80d97fa640 1 -- 172.21.15.99:0/754857308 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d0007a30 con 0x7f80dc06a940 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80d97fa640 1 -- 172.21.15.99:0/754857308 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d0007b90 con 0x7f80dc06a940 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80d97fa640 1 -- 172.21.15.99:0/754857308 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d000ce70 con 0x7f80dc06a940 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc0b8e50 con 0x7f80dc06a940 2024-01-19T05:18:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc0b8540 con 0x7f80dc06a940 2024-01-19T05:18:28.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.933+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc0b8cb0 con 0x7f80dc06a940 2024-01-19T05:18:28.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.937+0000 7f80d97fa640 1 -- 172.21.15.99:0/754857308 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f80d00113f0 con 0x7f80dc06a940 2024-01-19T05:18:28.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.937+0000 7f80d97fa640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f80c8066500 0x7f80c80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:28.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.937+0000 7f80d97fa640 1 -- 172.21.15.99:0/754857308 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80d0084350 con 0x7f80dc06a940 2024-01-19T05:18:28.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.937+0000 7f80dbfff640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f80c8066500 0x7f80c80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:28.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.937+0000 7f80dbfff640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f80c8066500 0x7f80c80689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0ad000 tx=0x7f80cc004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:28.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:28.941+0000 7f80d97fa640 1 -- 172.21.15.99:0/754857308 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f80dc0b8cb0 con 0x7f80dc06a940 2024-01-19T05:18:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.097+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80dc0b8cb0 con 0x7f80dc06a940 2024-01-19T05:18:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.097+0000 7f80d97fa640 1 -- 172.21.15.99:0/754857308 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80dc0b8cb0 con 0x7f80dc06a940 2024-01-19T05:18:29.096 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f80c8066500 msgr2=0x7f80c80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f80c8066500 0x7f80c80689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0ad000 tx=0x7f80cc004740 comp rx=0 tx=0).stop 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc06a940 msgr2=0x7f80dc09b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc06a940 0x7f80dc09b2c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c7c0 tx=0x7f80d000cc80 comp rx=0 tx=0).stop 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 shutdown_connections 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f80c8066500 0x7f80c80689c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80dc14abd0 0x7f80dc1365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80dc09bc20 0x7f80dc1e2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 --2- 172.21.15.99:0/754857308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80dc06a940 0x7f80dc09b2c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 >> 172.21.15.99:0/754857308 conn(0x7f80dc066ef0 msgr2=0x7f80dc0b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 shutdown_connections 2024-01-19T05:18:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.101+0000 7f80e2e40640 1 -- 172.21.15.99:0/754857308 wait complete. 2024-01-19T05:18:29.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-01-19T05:18:29.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f427a38b640 1 Processor -- start 2024-01-19T05:18:29.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f427a38b640 1 -- start start 2024-01-19T05:18:29.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f427a38b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f42740b19f0 0x7f427406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f427a38b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740724f0 0x7f4274145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f427a38b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4274070680 con 0x7f4274144c70 2024-01-19T05:18:29.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f427a38b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4274070410 con 0x7f42740b19f0 2024-01-19T05:18:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f427a38b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4274144790 con 0x7f42740724f0 2024-01-19T05:18:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f4273fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f42740b19f0 0x7f427406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f42737fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4274144c70 0x7f4274071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60976/0 (socket says 172.21.15.99:60976) 2024-01-19T05:18:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f42737fe640 1 -- 172.21.15.99:0/3326083487 learned_addr learned my addr 172.21.15.99:0/3326083487 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f4278928640 1 --2- 172.21.15.99:0/3326083487 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740724f0 0x7f4274145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f4272ffd640 1 -- 172.21.15.99:0/3326083487 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628141167 0 0) 0x7f4274070680 con 0x7f4274144c70 2024-01-19T05:18:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f4272ffd640 1 -- 172.21.15.99:0/3326083487 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4260003530 con 0x7f4274144c70 2024-01-19T05:18:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f4273fff640 1 -- 172.21.15.99:0/3326083487 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740724f0 msgr2=0x7f4274145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:29.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f4273fff640 1 --2- 172.21.15.99:0/3326083487 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740724f0 0x7f4274145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f4273fff640 1 -- 172.21.15.99:0/3326083487 >> v1:172.21.15.99:6789/0 conn(0x7f4274144c70 legacy=0x7f4274071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.237+0000 7f4273fff640 1 -- 172.21.15.99:0/3326083487 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427406f2b0 con 0x7f42740b19f0 2024-01-19T05:18:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f4273fff640 1 --2- 172.21.15.99:0/3326083487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740b19f0 0x7f427406ebe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f426c009d90 tx=0x7f426c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb6561178c34b85 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f4272ffd640 1 -- 172.21.15.99:0/3326083487 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0a5960 con 0x7f42740b19f0 2024-01-19T05:18:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f4272ffd640 1 -- 172.21.15.99:0/3326083487 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c0a5ac0 con 0x7f42740b19f0 2024-01-19T05:18:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f4272ffd640 1 -- 172.21.15.99:0/3326083487 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0a5e30 con 0x7f42740b19f0 2024-01-19T05:18:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- 172.21.15.99:0/3326083487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740b19f0 msgr2=0x7f427406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 --2- 172.21.15.99:0/3326083487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740b19f0 0x7f427406ebe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f426c009d90 tx=0x7f426c01c8c0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- 172.21.15.99:0/3326083487 shutdown_connections 2024-01-19T05:18:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 --2- 172.21.15.99:0/3326083487 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740724f0 0x7f4274145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 --2- 172.21.15.99:0/3326083487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740b19f0 0x7f427406ebe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- 172.21.15.99:0/3326083487 >> 172.21.15.99:0/3326083487 conn(0x7f42740b8080 msgr2=0x7f42740b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- 172.21.15.99:0/3326083487 shutdown_connections 2024-01-19T05:18:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- 172.21.15.99:0/3326083487 wait complete. 2024-01-19T05:18:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 Processor -- start 2024-01-19T05:18:29.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- start start 2024-01-19T05:18:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42740724f0 0x7f4274140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740b19f0 0x7f42741dd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4274144c70 0x7f42741dd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42741dccb0 con 0x7f4274144c70 2024-01-19T05:18:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42741417d0 con 0x7f42740724f0 2024-01-19T05:18:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.241+0000 7f427a38b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427413f310 con 0x7f42740b19f0 2024-01-19T05:18:29.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4274144c70 0x7f42741dd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4274144c70 0x7f42741dd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41048/0 (socket says 172.21.15.99:41048) 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 -- 172.21.15.99:0/3907976405 learned_addr learned my addr 172.21.15.99:0/3907976405 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f42737fe640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740b19f0 0x7f42741dd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4273fff640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42740724f0 0x7f4274140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 -- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740b19f0 msgr2=0x7f42741dd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740b19f0 0x7f42741dd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 -- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42740724f0 msgr2=0x7f4274140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42740724f0 0x7f4274140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 -- 172.21.15.99:0/3907976405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c009a70 con 0x7f4274144c70 2024-01-19T05:18:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f42737fe640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740b19f0 0x7f42741dd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4278928640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4274144c70 0x7f42741dd680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f426400d560 tx=0x7f426400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4270ff9640 1 -- 172.21.15.99:0/3907976405 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640125f0 con 0x7f4274144c70 2024-01-19T05:18:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4270ff9640 1 -- 172.21.15.99:0/3907976405 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264012770 con 0x7f4274144c70 2024-01-19T05:18:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4270ff9640 1 -- 172.21.15.99:0/3907976405 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264012b20 con 0x7f4274144c70 2024-01-19T05:18:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4274140f80 con 0x7f4274144c70 2024-01-19T05:18:29.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42741444c0 con 0x7f4274144c70 2024-01-19T05:18:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427413f170 con 0x7f4274144c70 2024-01-19T05:18:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4270ff9640 1 -- 172.21.15.99:0/3907976405 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4264012c80 con 0x7f4274144c70 2024-01-19T05:18:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4270ff9640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4254066500 0x7f42540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4270ff9640 1 -- 172.21.15.99:0/3907976405 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42640842d0 con 0x7f4274144c70 2024-01-19T05:18:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4273fff640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4254066500 0x7f42540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.245+0000 7f4273fff640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4254066500 0x7f42540689c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f426c0af000 tx=0x7f426c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:29.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.249+0000 7f4270ff9640 1 -- 172.21.15.99:0/3907976405 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f427413f170 con 0x7f4274144c70 2024-01-19T05:18:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.461+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) v1 -- 0x7f427413f170 con 0x7f4274144c70 2024-01-19T05:18:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.769+0000 7f4270ff9640 1 -- 172.21.15.99:0/3907976405 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v49) v1 ==== 137+0+0 (secure 0 0 0) 0x7f427413f170 con 0x7f4274144c70 2024-01-19T05:18:29.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4254066500 msgr2=0x7f42540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4254066500 0x7f42540689c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f426c0af000 tx=0x7f426c0a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4274144c70 msgr2=0x7f42741dd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4274144c70 0x7f42741dd680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f426400d560 tx=0x7f426400da20 comp rx=0 tx=0).stop 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 shutdown_connections 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4254066500 0x7f42540689c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4274144c70 0x7f42741dd680 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42740b19f0 0x7f42741dd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 --2- 172.21.15.99:0/3907976405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42740724f0 0x7f4274140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 >> 172.21.15.99:0/3907976405 conn(0x7f42740b8080 msgr2=0x7f42740b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 shutdown_connections 2024-01-19T05:18:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.773+0000 7f427a38b640 1 -- 172.21.15.99:0/3907976405 wait complete. 2024-01-19T05:18:29.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-19T05:18:29.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.909+0000 7f4de9f96640 1 Processor -- start 2024-01-19T05:18:29.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.909+0000 7f4de9f96640 1 -- start start 2024-01-19T05:18:29.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de9f96640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 0x7f4de414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de9f96640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de406f070 con 0x7f4de406ebe0 2024-01-19T05:18:29.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de9f96640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de4070680 con 0x7f4de40b19f0 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de9f96640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4070410 con 0x7f4de40724f0 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4de406ebe0 0x7f4de4071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60988/0 (socket says 172.21.15.99:60988) 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 -- 172.21.15.99:0/2653497623 learned_addr learned my addr 172.21.15.99:0/2653497623 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200969377 0 0) 0x7f4dcc0014a0 con 0x7f4de406ebe0 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc4003530 con 0x7f4de406ebe0 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de3fff640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 0x7f4de414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018084653 0 0) 0x7f4dc4003530 con 0x7f4de406ebe0 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 msgr2=0x7f4de414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 0x7f4de414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 >> v1:172.21.15.157:6789/0 conn(0x7f4de40b19f0 legacy=0x7f4de4144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4144790 con 0x7f4de406ebe0 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f4dcc001b90 con 0x7f4de406ebe0 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 >> v1:172.21.15.99:6789/0 conn(0x7f4de406ebe0 legacy=0x7f4de4071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 0x7f4dc40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4dc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc4004d10 0x7f4dc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4070410 con 0x7f4dc4003fe0 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc400bbd0 con 0x7f4dc4004d10 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc400bd90 con 0x7f4de40724f0 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4dc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de37fe640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 0x7f4dc40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de3fff640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc4004d10 0x7f4dc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 -- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 msgr2=0x7f4dc40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 0x7f4dc40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 -- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc4004d10 msgr2=0x7f4dc4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc4004d10 0x7f4dc4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 -- 172.21.15.99:0/2653497623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4003530 con 0x7f4dc4003fe0 2024-01-19T05:18:29.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de3fff640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4dc4004d10 0x7f4dc4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:29.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de37fe640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de40724f0 0x7f4dc40039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.913+0000 7f4de2ffd640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4dc40047d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00a810 tx=0x7f4dcc01d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3eef59eaac6d741 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0ad430 con 0x7f4dc4003fe0 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0a8070 con 0x7f4dc4003fe0 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de27fc640 1 -- 172.21.15.99:0/2653497623 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0ad830 con 0x7f4dc4003fe0 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- 172.21.15.99:0/2653497623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 msgr2=0x7f4dc40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 --2- 172.21.15.99:0/2653497623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4dc40047d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00a810 tx=0x7f4dcc01d2f0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de3fff640 1 -- 172.21.15.99:0/2653497623 reap_dead start 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- 172.21.15.99:0/2653497623 shutdown_connections 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- 172.21.15.99:0/2653497623 >> 172.21.15.99:0/2653497623 conn(0x7f4de40b8080 msgr2=0x7f4de40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- 172.21.15.99:0/2653497623 shutdown_connections 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- 172.21.15.99:0/2653497623 wait complete. 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 Processor -- start 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- start start 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4de40b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4de413f360 0x7f4de41ddd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de41de2c0 0x7f4de4140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de413e870 con 0x7f4dc4003fe0 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de413d330 con 0x7f4de413f360 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de413ed00 con 0x7f4de41de2c0 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4de40b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4de40b74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41070/0 (socket says 172.21.15.99:41070) 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 -- 172.21.15.99:0/42806281 learned_addr learned my addr 172.21.15.99:0/42806281 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de2ffd640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4de413f360 0x7f4de41ddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de3fff640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de41de2c0 0x7f4de4140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 -- 172.21.15.99:0/42806281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de41de2c0 msgr2=0x7f4de4140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de41de2c0 0x7f4de4140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 -- 172.21.15.99:0/42806281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4de413f360 msgr2=0x7f4de41ddd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4de413f360 0x7f4de41ddd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 -- 172.21.15.99:0/42806281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40a8670 con 0x7f4dc4003fe0 2024-01-19T05:18:29.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de37fe640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4de40b74f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00d770 tx=0x7f4ddc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4ddbfff640 1 -- 172.21.15.99:0/42806281 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc005270 con 0x7f4dc4003fe0 2024-01-19T05:18:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4ddbfff640 1 -- 172.21.15.99:0/42806281 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0053d0 con 0x7f4dc4003fe0 2024-01-19T05:18:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4ddbfff640 1 -- 172.21.15.99:0/42806281 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00b8f0 con 0x7f4dc4003fe0 2024-01-19T05:18:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de413e500 con 0x7f4dc4003fe0 2024-01-19T05:18:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.917+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de413ddb0 con 0x7f4dc4003fe0 2024-01-19T05:18:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.921+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de413d190 con 0x7f4dc4003fe0 2024-01-19T05:18:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.921+0000 7f4ddbfff640 1 -- 172.21.15.99:0/42806281 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4ddc00ba50 con 0x7f4dc4003fe0 2024-01-19T05:18:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.921+0000 7f4ddbfff640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4dc8066500 0x7f4dc80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.921+0000 7f4ddbfff640 1 -- 172.21.15.99:0/42806281 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ddc083d10 con 0x7f4dc4003fe0 2024-01-19T05:18:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.921+0000 7f4de2ffd640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4dc8066500 0x7f4dc80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.921+0000 7f4de2ffd640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4dc8066500 0x7f4dc80689c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0ad000 tx=0x7f4dcc0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:29.925+0000 7f4ddbfff640 1 -- 172.21.15.99:0/42806281 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4de413d190 con 0x7f4dc4003fe0 2024-01-19T05:18:30.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.069+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4de413d190 con 0x7f4dc4003fe0 2024-01-19T05:18:30.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.073+0000 7f4ddbfff640 1 -- 172.21.15.99:0/42806281 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4de413d190 con 0x7f4dc4003fe0 2024-01-19T05:18:30.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4dc8066500 msgr2=0x7f4dc80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4dc8066500 0x7f4dc80689c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0ad000 tx=0x7f4dcc0a7000 comp rx=0 tx=0).stop 2024-01-19T05:18:30.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 msgr2=0x7f4de40b74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4de40b74f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00d770 tx=0x7f4ddc00dc30 comp rx=0 tx=0).stop 2024-01-19T05:18:30.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 shutdown_connections 2024-01-19T05:18:30.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4dc8066500 0x7f4dc80689c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4de41de2c0 0x7f4de4140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4de413f360 0x7f4de41ddd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 --2- 172.21.15.99:0/42806281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dc4003fe0 0x7f4de40b74f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 >> 172.21.15.99:0/42806281 conn(0x7f4de40b8080 msgr2=0x7f4de413b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:30.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 shutdown_connections 2024-01-19T05:18:30.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.077+0000 7f4de9f96640 1 -- 172.21.15.99:0/42806281 wait complete. 2024-01-19T05:18:30.092 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-19T05:18:30.092 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T05:18:30.151 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T05:18:30.213 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-19T05:18:30.214 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:18:30.214 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T05:18:30.219 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:18:30.219 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T05:18:30.267 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:30.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bbd261640 1 Processor -- start 2024-01-19T05:18:30.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bbd261640 1 -- start start 2024-01-19T05:18:30.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bbd261640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 0x7f8bb8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bbd261640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8bb8072320 0x7f8bb814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bbd261640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb8070680 con 0x7f8bb80b19f0 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bbd261640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb8070410 con 0x7f8bb8072320 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bbd261640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb806f040 con 0x7f8bb806ebe0 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb77fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8bb8072320 0x7f8bb814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb77fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8bb8072320 0x7f8bb814ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41076/0 (socket says 172.21.15.99:41076) 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb77fe640 1 -- 172.21.15.99:0/1589981617 learned_addr learned my addr 172.21.15.99:0/1589981617 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb67fc640 1 --2- 172.21.15.99:0/1589981617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 0x7f8bb8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb77fe640 1 -- 172.21.15.99:0/1589981617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 msgr2=0x7f8bb8071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb77fe640 1 --2- 172.21.15.99:0/1589981617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 0x7f8bb8071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb77fe640 1 -- 172.21.15.99:0/1589981617 >> v1:172.21.15.157:6789/0 conn(0x7f8bb80b19f0 legacy=0x7f8bb8144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:30.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb77fe640 1 -- 172.21.15.99:0/1589981617 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8144790 con 0x7f8bb8072320 2024-01-19T05:18:30.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb77fe640 1 --2- 172.21.15.99:0/1589981617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb8072320 0x7f8bb814ee90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8070810 tx=0x7f8bb001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfc0e3bbc27f273 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:30.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.433+0000 7f8bb5ffb640 1 -- 172.21.15.99:0/1589981617 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00a5790 con 0x7f8bb8072320 2024-01-19T05:18:30.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb5ffb640 1 -- 172.21.15.99:0/1589981617 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00a58f0 con 0x7f8bb8072320 2024-01-19T05:18:30.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb5ffb640 1 -- 172.21.15.99:0/1589981617 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00a5c80 con 0x7f8bb8072320 2024-01-19T05:18:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- 172.21.15.99:0/1589981617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb8072320 msgr2=0x7f8bb814ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 --2- 172.21.15.99:0/1589981617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb8072320 0x7f8bb814ee90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8070810 tx=0x7f8bb001c8f0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- 172.21.15.99:0/1589981617 shutdown_connections 2024-01-19T05:18:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 --2- 172.21.15.99:0/1589981617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb8072320 0x7f8bb814ee90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 --2- 172.21.15.99:0/1589981617 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 0x7f8bb8071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- 172.21.15.99:0/1589981617 >> 172.21.15.99:0/1589981617 conn(0x7f8bb80b8080 msgr2=0x7f8bb80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- 172.21.15.99:0/1589981617 shutdown_connections 2024-01-19T05:18:30.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- 172.21.15.99:0/1589981617 wait complete. 2024-01-19T05:18:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 Processor -- start 2024-01-19T05:18:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- start start 2024-01-19T05:18:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 0x7f8bb80afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8072320 0x7f8bb81e2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80b19f0 0x7f8bb813dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb81e2d00 con 0x7f8bb80b19f0 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80b0200 con 0x7f8bb8072320 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8139750 con 0x7f8bb806ebe0 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80b19f0 0x7f8bb813dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80b19f0 0x7f8bb813dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41084/0 (socket says 172.21.15.99:41084) 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 -- 172.21.15.99:0/2618723842 learned_addr learned my addr 172.21.15.99:0/2618723842 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb67fc640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8072320 0x7f8bb81e2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 -- 172.21.15.99:0/2618723842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 msgr2=0x7f8bb80afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 0x7f8bb80afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 -- 172.21.15.99:0/2618723842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8072320 msgr2=0x7f8bb81e2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8072320 0x7f8bb81e2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 -- 172.21.15.99:0/2618723842 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009b30 con 0x7f8bb80b19f0 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bb77fe640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80b19f0 0x7f8bb813dc50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8bb001afa0 tx=0x7f8bb0019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:30.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8baf7fe640 1 -- 172.21.15.99:0/2618723842 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b8670 con 0x7f8bb80b19f0 2024-01-19T05:18:30.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8baf7fe640 1 -- 172.21.15.99:0/2618723842 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00b87d0 con 0x7f8bb80b19f0 2024-01-19T05:18:30.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb81e3120 con 0x7f8bb80b19f0 2024-01-19T05:18:30.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8baf7fe640 1 -- 172.21.15.99:0/2618723842 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b8b60 con 0x7f8bb80b19f0 2024-01-19T05:18:30.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.437+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb8139470 con 0x7f8bb80b19f0 2024-01-19T05:18:30.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.441+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb80696e0 con 0x7f8bb80b19f0 2024-01-19T05:18:30.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.441+0000 7f8baf7fe640 1 -- 172.21.15.99:0/2618723842 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8bb00b8cc0 con 0x7f8bb80b19f0 2024-01-19T05:18:30.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.441+0000 7f8baf7fe640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8b98066500 0x7f8b980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.441+0000 7f8baf7fe640 1 -- 172.21.15.99:0/2618723842 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bb011f3c0 con 0x7f8bb80b19f0 2024-01-19T05:18:30.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.441+0000 7f8bb6ffd640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8b98066500 0x7f8b980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.441+0000 7f8bb6ffd640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8b98066500 0x7f8b980689c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80ae210 tx=0x7f8ba00079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:30.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.445+0000 7f8baf7fe640 1 -- 172.21.15.99:0/2618723842 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8bb00ec810 con 0x7f8bb80b19f0 2024-01-19T05:18:30.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.601+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bb81e2e40 con 0x7f8bb80b19f0 2024-01-19T05:18:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8baf7fe640 1 -- 172.21.15.99:0/2618723842 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f8bb81e2e40 con 0x7f8bb80b19f0 2024-01-19T05:18:30.604 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8b98066500 msgr2=0x7f8b980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8b98066500 0x7f8b980689c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80ae210 tx=0x7f8ba00079c0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80b19f0 msgr2=0x7f8bb813dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80b19f0 0x7f8bb813dc50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8bb001afa0 tx=0x7f8bb0019690 comp rx=0 tx=0).stop 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 shutdown_connections 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8b98066500 0x7f8b980689c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80b19f0 0x7f8bb813dc50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8072320 0x7f8bb81e2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 --2- 172.21.15.99:0/2618723842 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8bb806ebe0 0x7f8bb80afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 >> 172.21.15.99:0/2618723842 conn(0x7f8bb80b8080 msgr2=0x7f8bb8071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 shutdown_connections 2024-01-19T05:18:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.605+0000 7f8bbd261640 1 -- 172.21.15.99:0/2618723842 wait complete. 2024-01-19T05:18:30.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:30.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:30.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.745+0000 7f53d2612640 1 Processor -- start 2024-01-19T05:18:30.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.745+0000 7f53d2612640 1 -- start start 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f53cc0724f0 0x7f53cc14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc06f070 con 0x7f53cc0b19f0 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc070680 con 0x7f53cc06ebe0 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc070410 con 0x7f53cc0724f0 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53cbfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f53cc0b19f0 0x7f53cc144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60996/0 (socket says 172.21.15.99:60996) 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53cbfff640 1 -- 172.21.15.99:0/1816136996 learned_addr learned my addr 172.21.15.99:0/1816136996 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d0baf640 1 --2- 172.21.15.99:0/1816136996 >> v2:172.21.15.99:3300/0 conn(0x7f53cc0724f0 0x7f53cc14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53caffd640 1 -- 172.21.15.99:0/1816136996 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203048410 0 0) 0x7f53c4001120 con 0x7f53cc0b19f0 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53caffd640 1 -- 172.21.15.99:0/1816136996 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b8003530 con 0x7f53cc0b19f0 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d0baf640 1 -- 172.21.15.99:0/1816136996 >> v1:172.21.15.157:6789/0 conn(0x7f53cc06ebe0 legacy=0x7f53cc071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d0baf640 1 -- 172.21.15.99:0/1816136996 >> v1:172.21.15.99:6789/0 conn(0x7f53cc0b19f0 legacy=0x7f53cc144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d0baf640 1 -- 172.21.15.99:0/1816136996 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc144790 con 0x7f53cc0724f0 2024-01-19T05:18:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d0baf640 1 --2- 172.21.15.99:0/1816136996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc14fea0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009d90 tx=0x7f53bc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4853a70db6ab8330 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53caffd640 1 -- 172.21.15.99:0/1816136996 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0a59a0 con 0x7f53cc0724f0 2024-01-19T05:18:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53caffd640 1 -- 172.21.15.99:0/1816136996 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc0a5b00 con 0x7f53cc0724f0 2024-01-19T05:18:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53caffd640 1 -- 172.21.15.99:0/1816136996 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0a5e90 con 0x7f53cc0724f0 2024-01-19T05:18:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 -- 172.21.15.99:0/1816136996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 msgr2=0x7f53cc14fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 --2- 172.21.15.99:0/1816136996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc14fea0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f53bc009d90 tx=0x7f53bc01c8c0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 -- 172.21.15.99:0/1816136996 shutdown_connections 2024-01-19T05:18:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 --2- 172.21.15.99:0/1816136996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc14fea0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.749+0000 7f53d2612640 1 -- 172.21.15.99:0/1816136996 >> 172.21.15.99:0/1816136996 conn(0x7f53cc0b8080 msgr2=0x7f53cc0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:30.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- 172.21.15.99:0/1816136996 shutdown_connections 2024-01-19T05:18:30.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- 172.21.15.99:0/1816136996 wait complete. 2024-01-19T05:18:30.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 Processor -- start 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- start start 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53cc06ebe0 0x7f53cc137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc1dcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53cc0b19f0 0x7f53cc1dd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc137100 con 0x7f53cc0724f0 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc1dca80 con 0x7f53cc0b19f0 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc1427f0 con 0x7f53cc06ebe0 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc1dcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc1dcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41100/0 (socket says 172.21.15.99:41100) 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 -- 172.21.15.99:0/1077369210 learned_addr learned my addr 172.21.15.99:0/1077369210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cbfff640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53cc06ebe0 0x7f53cc137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d0baf640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53cc0b19f0 0x7f53cc1dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 -- 172.21.15.99:0/1077369210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53cc06ebe0 msgr2=0x7f53cc137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53cc06ebe0 0x7f53cc137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 -- 172.21.15.99:0/1077369210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53cc0b19f0 msgr2=0x7f53cc1dd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53cc0b19f0 0x7f53cc1dd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 -- 172.21.15.99:0/1077369210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc009a70 con 0x7f53cc0724f0 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53cb7fe640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc1dcf00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c420 tx=0x7f53b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1077369210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40052d0 con 0x7f53cc0724f0 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1077369210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4005430 con 0x7f53cc0724f0 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc137340 con 0x7f53cc0724f0 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1077369210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4007260 con 0x7f53cc0724f0 2024-01-19T05:18:30.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc142460 con 0x7f53cc0724f0 2024-01-19T05:18:30.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.753+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc06a870 con 0x7f53cc0724f0 2024-01-19T05:18:30.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.757+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1077369210 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f53b40073c0 con 0x7f53cc0724f0 2024-01-19T05:18:30.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.757+0000 7f53c8ff9640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f53ac066500 0x7f53ac0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:30.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.757+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1077369210 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53b40832a0 con 0x7f53cc0724f0 2024-01-19T05:18:30.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.757+0000 7f53cbfff640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f53ac066500 0x7f53ac0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:30.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.757+0000 7f53cbfff640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f53ac066500 0x7f53ac0689c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f53c4001280 tx=0x7f53c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.761+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1077369210 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f53b40504c0 con 0x7f53cc0724f0 2024-01-19T05:18:30.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.917+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53cc1dcbc0 con 0x7f53cc0724f0 2024-01-19T05:18:30.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.917+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1077369210 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53b4053ae0 con 0x7f53cc0724f0 2024-01-19T05:18:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:30.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f53ac066500 msgr2=0x7f53ac0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f53ac066500 0x7f53ac0689c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f53c4001280 tx=0x7f53c4009040 comp rx=0 tx=0).stop 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 msgr2=0x7f53cc1dcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc1dcf00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c420 tx=0x7f53b400c8e0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 shutdown_connections 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f53ac066500 0x7f53ac0689c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53cc0b19f0 0x7f53cc1dd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53cc0724f0 0x7f53cc1dcf00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 --2- 172.21.15.99:0/1077369210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53cc06ebe0 0x7f53cc137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 >> 172.21.15.99:0/1077369210 conn(0x7f53cc0b8080 msgr2=0x7f53cc070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 shutdown_connections 2024-01-19T05:18:30.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:30.921+0000 7f53d2612640 1 -- 172.21.15.99:0/1077369210 wait complete. 2024-01-19T05:18:30.934 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ff59640 1 Processor -- start 2024-01-19T05:18:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ff59640 1 -- start start 2024-01-19T05:18:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ff59640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30806e150 0x7fb308144650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ff59640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb308144b90 0x7fb3081415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ff59640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3081485b0 con 0x7fb308072510 2024-01-19T05:18:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ff59640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30806e530 con 0x7fb308144b90 2024-01-19T05:18:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ff59640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb308147f60 con 0x7fb30806e150 2024-01-19T05:18:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30d4f4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb308144b90 0x7fb3081415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30e4f6640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb308072510 0x7fb308141b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32780/0 (socket says 172.21.15.99:32780) 2024-01-19T05:18:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30e4f6640 1 -- 172.21.15.99:0/1026751441 learned_addr learned my addr 172.21.15.99:0/1026751441 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30dcf5640 1 --2- 172.21.15.99:0/1026751441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30806e150 0x7fb308144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30d4f4640 1 -- 172.21.15.99:0/1026751441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30806e150 msgr2=0x7fb308144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30d4f4640 1 --2- 172.21.15.99:0/1026751441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30806e150 0x7fb308144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30d4f4640 1 -- 172.21.15.99:0/1026751441 >> v1:172.21.15.99:6789/0 conn(0x7fb308072510 legacy=0x7fb308141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30d4f4640 1 -- 172.21.15.99:0/1026751441 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308148240 con 0x7fb308144b90 2024-01-19T05:18:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ccf3640 1 -- 172.21.15.99:0/1026751441 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351099069 0 0) 0x7fb3081485b0 con 0x7fb308072510 2024-01-19T05:18:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30dcf5640 1 --2- 172.21.15.99:0/1026751441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30806e150 0x7fb308144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30d4f4640 1 --2- 172.21.15.99:0/1026751441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081415c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80097c0 tx=0x7fb2f801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99f4b49ab956cfc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.057+0000 7fb30ccf3640 1 -- 172.21.15.99:0/1026751441 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80ab600 con 0x7fb308144b90 2024-01-19T05:18:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ccf3640 1 -- 172.21.15.99:0/1026751441 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f80a7050 con 0x7fb308144b90 2024-01-19T05:18:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ccf3640 1 -- 172.21.15.99:0/1026751441 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80ab980 con 0x7fb308144b90 2024-01-19T05:18:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- 172.21.15.99:0/1026751441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 msgr2=0x7fb3081415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1026751441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081415c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80097c0 tx=0x7fb2f801c390 comp rx=0 tx=0).stop 2024-01-19T05:18:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- 172.21.15.99:0/1026751441 shutdown_connections 2024-01-19T05:18:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1026751441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081415c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1026751441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30806e150 0x7fb308144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- 172.21.15.99:0/1026751441 >> 172.21.15.99:0/1026751441 conn(0x7fb3080ba500 msgr2=0x7fb3080ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- 172.21.15.99:0/1026751441 shutdown_connections 2024-01-19T05:18:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- 172.21.15.99:0/1026751441 wait complete. 2024-01-19T05:18:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 Processor -- start 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- start start 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30806e150 0x7fb30813dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb308072510 0x7fb30813e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb308099f50 con 0x7fb308144b90 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30809b040 con 0x7fb30806e150 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30809b8a0 con 0x7fb308072510 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081dfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41116/0 (socket says 172.21.15.99:41116) 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 -- 172.21.15.99:0/1744927411 learned_addr learned my addr 172.21.15.99:0/1744927411 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30d4f4640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb308072510 0x7fb30813e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30dcf5640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30806e150 0x7fb30813dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 -- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb308072510 msgr2=0x7fb30813e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb308072510 0x7fb30813e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 -- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30806e150 msgr2=0x7fb30813dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30806e150 0x7fb30813dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 -- 172.21.15.99:0/1744927411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009420 con 0x7fb308144b90 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30dcf5640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30806e150 0x7fb30813dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30e4f6640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081dfa30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb300001570 tx=0x7fb30000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb2fe7fc640 1 -- 172.21.15.99:0/1744927411 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000a640 con 0x7fb308144b90 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb2fe7fc640 1 -- 172.21.15.99:0/1744927411 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30000a7a0 con 0x7fb308144b90 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30809b250 con 0x7fb308144b90 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb2fe7fc640 1 -- 172.21.15.99:0/1744927411 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000ab90 con 0x7fb308144b90 2024-01-19T05:18:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30809b5e0 con 0x7fb308144b90 2024-01-19T05:18:31.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.061+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3081478f0 con 0x7fb308144b90 2024-01-19T05:18:31.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.065+0000 7fb2fe7fc640 1 -- 172.21.15.99:0/1744927411 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb30000acf0 con 0x7fb308144b90 2024-01-19T05:18:31.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.065+0000 7fb2fe7fc640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb2ec066500 0x7fb2ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.065+0000 7fb2fe7fc640 1 -- 172.21.15.99:0/1744927411 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb300083730 con 0x7fb308144b90 2024-01-19T05:18:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.065+0000 7fb30dcf5640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb2ec066500 0x7fb2ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.065+0000 7fb30dcf5640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb2ec066500 0x7fb2ec0689c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb304008930 tx=0x7fb304008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.069+0000 7fb2fe7fc640 1 -- 172.21.15.99:0/1744927411 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb300050a60 con 0x7fb308144b90 2024-01-19T05:18:31.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3080696e0 con 0x7fb308144b90 2024-01-19T05:18:31.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb2fe7fc640 1 -- 172.21.15.99:0/1744927411 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb300018020 con 0x7fb308144b90 2024-01-19T05:18:31.211 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb2ec066500 msgr2=0x7fb2ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb2ec066500 0x7fb2ec0689c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb304008930 tx=0x7fb304008040 comp rx=0 tx=0).stop 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 msgr2=0x7fb3081dfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081dfa30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb300001570 tx=0x7fb30000cc70 comp rx=0 tx=0).stop 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 shutdown_connections 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb2ec066500 0x7fb2ec0689c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb308144b90 0x7fb3081dfa30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb308072510 0x7fb30813e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 --2- 172.21.15.99:0/1744927411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30806e150 0x7fb30813dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 >> 172.21.15.99:0/1744927411 conn(0x7fb3080ba500 msgr2=0x7fb308140980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 shutdown_connections 2024-01-19T05:18:31.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.213+0000 7fb30ff59640 1 -- 172.21.15.99:0/1744927411 wait complete. 2024-01-19T05:18:31.229 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.349+0000 7fc689968640 1 Processor -- start 2024-01-19T05:18:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.349+0000 7fc689968640 1 -- start start 2024-01-19T05:18:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc689968640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc6840b2870 0x7fc684143af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc689968640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6840b2cf0 con 0x7fc684144030 2024-01-19T05:18:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc689968640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6840b9550 con 0x7fc6840b9170 2024-01-19T05:18:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc689968640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6840afd00 con 0x7fc6840b2870 2024-01-19T05:18:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6837fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc684144030 0x7fc684151260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32796/0 (socket says 172.21.15.99:32796) 2024-01-19T05:18:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6837fe640 1 -- 172.21.15.99:0/3790082850 learned_addr learned my addr 172.21.15.99:0/3790082850 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229108680 0 0) 0x7fc6840b2cf0 con 0x7fc684144030 2024-01-19T05:18:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc66c003530 con 0x7fc684144030 2024-01-19T05:18:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6827fc640 1 --2- 172.21.15.99:0/3790082850 >> v2:172.21.15.157:3300/0 conn(0x7fc6840b2870 0x7fc684143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 29062910 0 0) 0x7fc66c003530 con 0x7fc684144030 2024-01-19T05:18:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 >> v2:172.21.15.157:3300/0 conn(0x7fc6840b2870 msgr2=0x7fc684143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 --2- 172.21.15.99:0/3790082850 >> v2:172.21.15.157:3300/0 conn(0x7fc6840b2870 0x7fc684143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 >> v1:172.21.15.157:6789/0 conn(0x7fc6840b9170 legacy=0x7fc6840b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840b01f0 con 0x7fc684144030 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fc67c001a00 con 0x7fc684144030 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 >> v1:172.21.15.99:6789/0 conn(0x7fc684144030 legacy=0x7fc684151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c003980 0x7fc66c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0047d0 0x7fc66c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc66c0051e0 0x7fc66c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840afd00 con 0x7fc66c0047d0 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c00c110 con 0x7fc66c003980 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c00c2d0 con 0x7fc66c0051e0 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6827fc640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0047d0 0x7fc66c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc682ffd640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c003980 0x7fc66c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6827fc640 1 -- 172.21.15.99:0/3790082850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc66c0051e0 msgr2=0x7fc66c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6827fc640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc66c0051e0 0x7fc66c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6827fc640 1 -- 172.21.15.99:0/3790082850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c003980 msgr2=0x7fc66c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6827fc640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c003980 0x7fc66c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6827fc640 1 -- 172.21.15.99:0/3790082850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c003530 con 0x7fc66c0047d0 2024-01-19T05:18:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc6837fe640 1 -- 172.21.15.99:0/3790082850 reap_dead start 2024-01-19T05:18:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.353+0000 7fc682ffd640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c003980 0x7fc66c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0047d0 0x7fc66c004c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc674009ae0 tx=0x7fc67401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffe80ffbb9822b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6740a6430 con 0x7fc66c0047d0 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6740a6590 con 0x7fc66c0047d0 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc681ffb640 1 -- 172.21.15.99:0/3790082850 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6740a6940 con 0x7fc66c0047d0 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- 172.21.15.99:0/3790082850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0047d0 msgr2=0x7fc66c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0047d0 0x7fc66c004c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc674009ae0 tx=0x7fc67401ca50 comp rx=0 tx=0).stop 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- 172.21.15.99:0/3790082850 shutdown_connections 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 --2- 172.21.15.99:0/3790082850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0047d0 0x7fc66c004c50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- 172.21.15.99:0/3790082850 >> 172.21.15.99:0/3790082850 conn(0x7fc68406adf0 msgr2=0x7fc6840b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- 172.21.15.99:0/3790082850 shutdown_connections 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- 172.21.15.99:0/3790082850 wait complete. 2024-01-19T05:18:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 Processor -- start 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- start start 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c0047d0 0x7fc6840b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6841df860 0x7fc6841dfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6841e27a0 0x7fc6841e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6841e0220 con 0x7fc6841df860 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6841df3d0 con 0x7fc66c0047d0 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68414ad20 con 0x7fc6841e27a0 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6841df860 0x7fc6841dfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6841df860 0x7fc6841dfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41134/0 (socket says 172.21.15.99:41134) 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 -- 172.21.15.99:0/4241875522 learned_addr learned my addr 172.21.15.99:0/4241875522 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc682ffd640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c0047d0 0x7fc6840b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6837fe640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6841e27a0 0x7fc6841e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 -- 172.21.15.99:0/4241875522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6841e27a0 msgr2=0x7fc6841e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6841e27a0 0x7fc6841e2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 -- 172.21.15.99:0/4241875522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c0047d0 msgr2=0x7fc6840b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c0047d0 0x7fc6840b7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 -- 172.21.15.99:0/4241875522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840701d0 con 0x7fc6841df860 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc6827fc640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6841df860 0x7fc6841dfce0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc674009ae0 tx=0x7fc6740197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc66bfff640 1 -- 172.21.15.99:0/4241875522 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400f000 con 0x7fc6841df860 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc66bfff640 1 -- 172.21.15.99:0/4241875522 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6740b9440 con 0x7fc6841df860 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc66bfff640 1 -- 172.21.15.99:0/4241875522 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6740b97d0 con 0x7fc6841df860 2024-01-19T05:18:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6841df3d0 con 0x7fc6841df860 2024-01-19T05:18:31.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.357+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6840704b0 con 0x7fc6841df860 2024-01-19T05:18:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.361+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6841df560 con 0x7fc6841df860 2024-01-19T05:18:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.361+0000 7fc66bfff640 1 -- 172.21.15.99:0/4241875522 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc6740c2440 con 0x7fc6841df860 2024-01-19T05:18:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.361+0000 7fc66bfff640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc670066530 0x7fc6700689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.361+0000 7fc66bfff640 1 -- 172.21.15.99:0/4241875522 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc67411e030 con 0x7fc6841df860 2024-01-19T05:18:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.361+0000 7fc682ffd640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc670066530 0x7fc6700689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.361+0000 7fc682ffd640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc670066530 0x7fc6700689f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc678007fd0 tx=0x7fc678009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.365+0000 7fc66bfff640 1 -- 172.21.15.99:0/4241875522 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc6740eb360 con 0x7fc6841df860 2024-01-19T05:18:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6840696e0 con 0x7fc6841df860 2024-01-19T05:18:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc66bfff640 1 -- 172.21.15.99:0/4241875522 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6740ee980 con 0x7fc6841df860 2024-01-19T05:18:31.519 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc670066530 msgr2=0x7fc6700689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc670066530 0x7fc6700689f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc678007fd0 tx=0x7fc678009040 comp rx=0 tx=0).stop 2024-01-19T05:18:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6841df860 msgr2=0x7fc6841dfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6841df860 0x7fc6841dfce0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc674009ae0 tx=0x7fc6740197f0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 shutdown_connections 2024-01-19T05:18:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc670066530 0x7fc6700689f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6841e27a0 0x7fc6841e2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6841df860 0x7fc6841dfce0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 --2- 172.21.15.99:0/4241875522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc66c0047d0 0x7fc6840b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 >> 172.21.15.99:0/4241875522 conn(0x7fc68406adf0 msgr2=0x7fc6841429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:31.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 shutdown_connections 2024-01-19T05:18:31.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.521+0000 7fc689968640 1 -- 172.21.15.99:0/4241875522 wait complete. 2024-01-19T05:18:31.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T05:18:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa741d12640 1 Processor -- start 2024-01-19T05:18:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa741d12640 1 -- start start 2024-01-19T05:18:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa741d12640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa73c140780 0x7fa73c140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa741d12640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c14f1b0 0x7fa73c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa741d12640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0b87f0 con 0x7fa73c0b96f0 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa741d12640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c141120 con 0x7fa73c140780 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa741d12640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0b9ad0 con 0x7fa73c14f1b0 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73affd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa73c140780 0x7fa73c140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c14f1b0 0x7fa73c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73affd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa73c140780 0x7fa73c140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:40876/0 (socket says 172.21.15.99:40876) 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73affd640 1 -- 172.21.15.99:0/2151258075 learned_addr learned my addr 172.21.15.99:0/2151258075 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73b7fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa73c0b96f0 0x7fa73c0b7700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:34538/0 (socket says 172.21.15.99:34538) 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73affd640 1 -- 172.21.15.99:0/2151258075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c14f1b0 msgr2=0x7fa73c1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73affd640 1 --2- 172.21.15.99:0/2151258075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c14f1b0 0x7fa73c1515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73affd640 1 -- 172.21.15.99:0/2151258075 >> v1:172.21.15.157:6789/0 conn(0x7fa73c0b96f0 legacy=0x7fa73c0b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.661+0000 7fa73affd640 1 -- 172.21.15.99:0/2151258075 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0b81e0 con 0x7fa73c140780 2024-01-19T05:18:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73affd640 1 --2- 172.21.15.99:0/2151258075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c140780 0x7fa73c140be0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa730009870 tx=0x7fa73001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a95764682ba6f8f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73a7fc640 1 -- 172.21.15.99:0/2151258075 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300a9400 con 0x7fa73c140780 2024-01-19T05:18:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73a7fc640 1 -- 172.21.15.99:0/2151258075 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300a9560 con 0x7fa73c140780 2024-01-19T05:18:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73a7fc640 1 -- 172.21.15.99:0/2151258075 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300a98f0 con 0x7fa73c140780 2024-01-19T05:18:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- 172.21.15.99:0/2151258075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c140780 msgr2=0x7fa73c140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 --2- 172.21.15.99:0/2151258075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c140780 0x7fa73c140be0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa730009870 tx=0x7fa73001c540 comp rx=0 tx=0).stop 2024-01-19T05:18:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- 172.21.15.99:0/2151258075 shutdown_connections 2024-01-19T05:18:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 --2- 172.21.15.99:0/2151258075 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c14f1b0 0x7fa73c1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 --2- 172.21.15.99:0/2151258075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c140780 0x7fa73c140be0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- 172.21.15.99:0/2151258075 >> 172.21.15.99:0/2151258075 conn(0x7fa73c09e600 msgr2=0x7fa73c0b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- 172.21.15.99:0/2151258075 shutdown_connections 2024-01-19T05:18:31.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- 172.21.15.99:0/2151258075 wait complete. 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 Processor -- start 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- start start 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c0b96f0 0x7fa73c146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c140780 0x7fa73c1dee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c14f1b0 0x7fa73c148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c14adb0 con 0x7fa73c14f1b0 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c149720 con 0x7fa73c0b96f0 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa741d12640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c147db0 con 0x7fa73c140780 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c14f1b0 0x7fa73c148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c14f1b0 0x7fa73c148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41140/0 (socket says 172.21.15.99:41140) 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73bfff640 1 -- 172.21.15.99:0/2805832222 learned_addr learned my addr 172.21.15.99:0/2805832222 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73b7fe640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c0b96f0 0x7fa73c146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.665+0000 7fa73affd640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c140780 0x7fa73c1dee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73bfff640 1 -- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c140780 msgr2=0x7fa73c1dee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73bfff640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c140780 0x7fa73c1dee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73bfff640 1 -- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c0b96f0 msgr2=0x7fa73c146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73bfff640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c0b96f0 0x7fa73c146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73bfff640 1 -- 172.21.15.99:0/2805832222 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300094d0 con 0x7fa73c14f1b0 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73b7fe640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c0b96f0 0x7fa73c146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73bfff640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c14f1b0 0x7fa73c148360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa73400ef90 tx=0x7fa73400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa723fff640 1 -- 172.21.15.99:0/2805832222 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734009b20 con 0x7fa73c14f1b0 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa723fff640 1 -- 172.21.15.99:0/2805832222 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400f040 con 0x7fa73c14f1b0 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c14aad0 con 0x7fa73c14f1b0 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa723fff640 1 -- 172.21.15.99:0/2805832222 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340146c0 con 0x7fa73c14f1b0 2024-01-19T05:18:31.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c147a80 con 0x7fa73c14f1b0 2024-01-19T05:18:31.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c0696e0 con 0x7fa73c14f1b0 2024-01-19T05:18:31.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa723fff640 1 -- 172.21.15.99:0/2805832222 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa734014820 con 0x7fa73c14f1b0 2024-01-19T05:18:31.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa723fff640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa728066500 0x7fa7280689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:31.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa723fff640 1 -- 172.21.15.99:0/2805832222 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa734084bd0 con 0x7fa73c14f1b0 2024-01-19T05:18:31.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73b7fe640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa728066500 0x7fa7280689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:31.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.669+0000 7fa73b7fe640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa728066500 0x7fa7280689c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa72c007fd0 tx=0x7fa72c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:31.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.673+0000 7fa723fff640 1 -- 172.21.15.99:0/2805832222 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa734051f00 con 0x7fa73c14f1b0 2024-01-19T05:18:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.841+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa73c0a15d0 con 0x7fa73c14f1b0 2024-01-19T05:18:31.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.841+0000 7fa723fff640 1 -- 172.21.15.99:0/2805832222 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa734018020 con 0x7fa73c14f1b0 2024-01-19T05:18:31.841 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-01-19T05:18:31.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa728066500 msgr2=0x7fa7280689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa728066500 0x7fa7280689c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa72c007fd0 tx=0x7fa72c009040 comp rx=0 tx=0).stop 2024-01-19T05:18:31.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c14f1b0 msgr2=0x7fa73c148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c14f1b0 0x7fa73c148360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa73400ef90 tx=0x7fa73400c490 comp rx=0 tx=0).stop 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 shutdown_connections 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa728066500 0x7fa7280689c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa73c14f1b0 0x7fa73c148360 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa73c140780 0x7fa73c1dee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 --2- 172.21.15.99:0/2805832222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa73c0b96f0 0x7fa73c146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 >> 172.21.15.99:0/2805832222 conn(0x7fa73c09e600 msgr2=0x7fa73c0b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 shutdown_connections 2024-01-19T05:18:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:31.845+0000 7fa741d12640 1 -- 172.21.15.99:0/2805832222 wait complete. 2024-01-19T05:18:31.859 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:18:31.859 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T05:18:31.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97ae92640 1 Processor -- start 2024-01-19T05:18:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97ae92640 1 -- start start 2024-01-19T05:18:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97ae92640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9740af7e0 0x7fd9740afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97ae92640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd97414ac60 0x7fd97414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97ae92640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd974071ed0 0x7fd974072380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97ae92640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740b12e0 con 0x7fd974071ed0 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97ae92640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740b0eb0 con 0x7fd97414ac60 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97ae92640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740b03d0 con 0x7fd9740af7e0 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd974071ed0 0x7fd974072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd974071ed0 0x7fd974072380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32876/0 (socket says 172.21.15.99:32876) 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 -- 172.21.15.99:0/2653593566 learned_addr learned my addr 172.21.15.99:0/2653593566 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd978c2e640 1 --2- 172.21.15.99:0/2653593566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9740af7e0 0x7fd9740afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd973fff640 1 --2- 172.21.15.99:0/2653593566 >> v2:172.21.15.157:3300/0 conn(0x7fd97414ac60 0x7fd97414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 -- 172.21.15.99:0/2653593566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9740af7e0 msgr2=0x7fd9740afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 --2- 172.21.15.99:0/2653593566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9740af7e0 0x7fd9740afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 -- 172.21.15.99:0/2653593566 >> v2:172.21.15.157:3300/0 conn(0x7fd97414ac60 msgr2=0x7fd97414b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 --2- 172.21.15.99:0/2653593566 >> v2:172.21.15.157:3300/0 conn(0x7fd97414ac60 0x7fd97414b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 -- 172.21.15.99:0/2653593566 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740b06b0 con 0x7fd974071ed0 2024-01-19T05:18:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd97942f640 1 --2- 172.21.15.99:0/2653593566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd974071ed0 0x7fd974072380 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd97406ad30 tx=0x7fd96c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baec867f1148ab4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd9737fe640 1 -- 172.21.15.99:0/2653593566 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0a5870 con 0x7fd974071ed0 2024-01-19T05:18:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd9737fe640 1 -- 172.21.15.99:0/2653593566 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c0a59d0 con 0x7fd974071ed0 2024-01-19T05:18:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.025+0000 7fd9737fe640 1 -- 172.21.15.99:0/2653593566 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0a5d60 con 0x7fd974071ed0 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- 172.21.15.99:0/2653593566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd974071ed0 msgr2=0x7fd974072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 --2- 172.21.15.99:0/2653593566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd974071ed0 0x7fd974072380 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd97406ad30 tx=0x7fd96c01c9d0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- 172.21.15.99:0/2653593566 shutdown_connections 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 --2- 172.21.15.99:0/2653593566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd974071ed0 0x7fd974072380 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 --2- 172.21.15.99:0/2653593566 >> v2:172.21.15.157:3300/0 conn(0x7fd97414ac60 0x7fd97414b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 --2- 172.21.15.99:0/2653593566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9740af7e0 0x7fd9740afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- 172.21.15.99:0/2653593566 >> 172.21.15.99:0/2653593566 conn(0x7fd9740b8080 msgr2=0x7fd9740b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- 172.21.15.99:0/2653593566 shutdown_connections 2024-01-19T05:18:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- 172.21.15.99:0/2653593566 wait complete. 2024-01-19T05:18:32.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 Processor -- start 2024-01-19T05:18:32.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- start start 2024-01-19T05:18:32.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd974071ed0 0x7fd97413aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9740af7e0 0x7fd974140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd97414ac60 0x7fd974140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974138930 con 0x7fd97414ac60 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974139ef0 con 0x7fd9740af7e0 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97413c5c0 con 0x7fd974071ed0 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd97414ac60 0x7fd974140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd97414ac60 0x7fd974140660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32884/0 (socket says 172.21.15.99:32884) 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 -- 172.21.15.99:0/3748460257 learned_addr learned my addr 172.21.15.99:0/3748460257 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd978c2e640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd974071ed0 0x7fd97413aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd973fff640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9740af7e0 0x7fd974140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 -- 172.21.15.99:0/3748460257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd974071ed0 msgr2=0x7fd97413aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd974071ed0 0x7fd97413aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 -- 172.21.15.99:0/3748460257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9740af7e0 msgr2=0x7fd974140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9740af7e0 0x7fd974140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 -- 172.21.15.99:0/3748460257 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c009b30 con 0x7fd97414ac60 2024-01-19T05:18:32.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97942f640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd97414ac60 0x7fd974140660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0af040 tx=0x7fd96c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd9717fa640 1 -- 172.21.15.99:0/3748460257 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0b8670 con 0x7fd97414ac60 2024-01-19T05:18:32.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd9717fa640 1 -- 172.21.15.99:0/3748460257 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c0b87f0 con 0x7fd97414ac60 2024-01-19T05:18:32.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97413a1c0 con 0x7fd97414ac60 2024-01-19T05:18:32.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd9717fa640 1 -- 172.21.15.99:0/3748460257 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0b8ba0 con 0x7fd97414ac60 2024-01-19T05:18:32.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.029+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd974141e80 con 0x7fd97414ac60 2024-01-19T05:18:32.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.033+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9740696e0 con 0x7fd97414ac60 2024-01-19T05:18:32.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.033+0000 7fd9717fa640 1 -- 172.21.15.99:0/3748460257 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd96c0b8d00 con 0x7fd97414ac60 2024-01-19T05:18:32.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.033+0000 7fd9717fa640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd958066530 0x7fd9580689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.033+0000 7fd9717fa640 1 -- 172.21.15.99:0/3748460257 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd96c11f0d0 con 0x7fd97414ac60 2024-01-19T05:18:32.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.033+0000 7fd978c2e640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd958066530 0x7fd9580689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.033+0000 7fd978c2e640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd958066530 0x7fd9580689f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9741427e0 tx=0x7fd968008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.037+0000 7fd9717fa640 1 -- 172.21.15.99:0/3748460257 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd96c0ec2e0 con 0x7fd97414ac60 2024-01-19T05:18:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.197+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd97413a670 con 0x7fd97414ac60 2024-01-19T05:18:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd9717fa640 1 -- 172.21.15.99:0/3748460257 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fd96c0ef900 con 0x7fd97414ac60 2024-01-19T05:18:32.199 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:32.199 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd958066530 msgr2=0x7fd9580689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd958066530 0x7fd9580689f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9741427e0 tx=0x7fd968008040 comp rx=0 tx=0).stop 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd97414ac60 msgr2=0x7fd974140660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd97414ac60 0x7fd974140660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0af040 tx=0x7fd96c019770 comp rx=0 tx=0).stop 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 shutdown_connections 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd958066530 0x7fd9580689f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd97414ac60 0x7fd974140660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9740af7e0 0x7fd974140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 --2- 172.21.15.99:0/3748460257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd974071ed0 0x7fd97413aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 >> 172.21.15.99:0/3748460257 conn(0x7fd9740b8080 msgr2=0x7fd97414a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 shutdown_connections 2024-01-19T05:18:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.201+0000 7fd97ae92640 1 -- 172.21.15.99:0/3748460257 wait complete. 2024-01-19T05:18:32.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:32.219 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:32.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e99e8640 1 Processor -- start 2024-01-19T05:18:32.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e99e8640 1 -- start start 2024-01-19T05:18:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e99e8640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f82e406a940 0x7f82e409e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e99e8640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e40b49e0 con 0x7f82e409db20 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e99e8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e409cc50 con 0x7f82e409d6c0 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e99e8640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e40b4180 con 0x7f82e406a940 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e37fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f82e409db20 0x7f82e414ef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33406/0 (socket says 172.21.15.99:33406) 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e37fe640 1 -- 172.21.15.99:0/3457776107 learned_addr learned my addr 172.21.15.99:0/3457776107 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e2ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f82e406a940 0x7f82e409e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e1ffb640 1 -- 172.21.15.99:0/3457776107 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821025087 0 0) 0x7f82e40b49e0 con 0x7f82e409db20 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e1ffb640 1 -- 172.21.15.99:0/3457776107 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82cc003530 con 0x7f82e409db20 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e2ffd640 1 -- 172.21.15.99:0/3457776107 >> v1:172.21.15.157:6789/0 conn(0x7f82e409d6c0 legacy=0x7f82e413e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e2ffd640 1 -- 172.21.15.99:0/3457776107 >> v1:172.21.15.99:6789/0 conn(0x7f82e409db20 legacy=0x7f82e414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.345+0000 7f82e2ffd640 1 -- 172.21.15.99:0/3457776107 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e406ad20 con 0x7f82e406a940 2024-01-19T05:18:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e2ffd640 1 --2- 172.21.15.99:0/3457776107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e406a940 0x7f82e409e190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82d40097c0 tx=0x7f82d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e8754a9f39bd61 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e1ffb640 1 -- 172.21.15.99:0/3457776107 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d40ac620 con 0x7f82e406a940 2024-01-19T05:18:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e1ffb640 1 -- 172.21.15.99:0/3457776107 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d40ac780 con 0x7f82e406a940 2024-01-19T05:18:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e1ffb640 1 -- 172.21.15.99:0/3457776107 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d40acb10 con 0x7f82e406a940 2024-01-19T05:18:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- 172.21.15.99:0/3457776107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e406a940 msgr2=0x7f82e409e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 --2- 172.21.15.99:0/3457776107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e406a940 0x7f82e409e190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82d40097c0 tx=0x7f82d401c3c0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- 172.21.15.99:0/3457776107 shutdown_connections 2024-01-19T05:18:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 --2- 172.21.15.99:0/3457776107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e406a940 0x7f82e409e190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- 172.21.15.99:0/3457776107 >> 172.21.15.99:0/3457776107 conn(0x7f82e4066ef0 msgr2=0x7f82e40b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- 172.21.15.99:0/3457776107 shutdown_connections 2024-01-19T05:18:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- 172.21.15.99:0/3457776107 wait complete. 2024-01-19T05:18:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 Processor -- start 2024-01-19T05:18:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- start start 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82e406a940 0x7f82e4072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82e409d6c0 0x7f82e414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e409db20 0x7f82e414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e414d0c0 con 0x7f82e409db20 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e414fde0 con 0x7f82e406a940 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e99e8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e414f600 con 0x7f82e409d6c0 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e409db20 0x7f82e414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e409db20 0x7f82e414dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32906/0 (socket says 172.21.15.99:32906) 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 -- 172.21.15.99:0/683624647 learned_addr learned my addr 172.21.15.99:0/683624647 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e27fc640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82e409d6c0 0x7f82e414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e2ffd640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82e406a940 0x7f82e4072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 -- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82e409d6c0 msgr2=0x7f82e414eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82e409d6c0 0x7f82e414eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 -- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82e406a940 msgr2=0x7f82e4072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82e406a940 0x7f82e4072130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 -- 172.21.15.99:0/683624647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d4009420 con 0x7f82e409db20 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e2ffd640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82e406a940 0x7f82e4072130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.349+0000 7f82e37fe640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e409db20 0x7f82e414dac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00caa0 tx=0x7f82dc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82cbfff640 1 -- 172.21.15.99:0/683624647 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00aba0 con 0x7f82e409db20 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82cbfff640 1 -- 172.21.15.99:0/683624647 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc00ad00 con 0x7f82e409db20 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e414d2a0 con 0x7f82e409db20 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82cbfff640 1 -- 172.21.15.99:0/683624647 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc012640 con 0x7f82e409db20 2024-01-19T05:18:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e414f070 con 0x7f82e409db20 2024-01-19T05:18:32.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e40696e0 con 0x7f82e409db20 2024-01-19T05:18:32.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82cbfff640 1 -- 172.21.15.99:0/683624647 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f82dc007070 con 0x7f82e409db20 2024-01-19T05:18:32.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82cbfff640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f82d0066530 0x7f82d00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82e2ffd640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f82d0066530 0x7f82d00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82cbfff640 1 -- 172.21.15.99:0/683624647 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82dc083d10 con 0x7f82e409db20 2024-01-19T05:18:32.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.353+0000 7f82e2ffd640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f82d0066530 0x7f82d00689f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82d40ae000 tx=0x7f82d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.357+0000 7f82cbfff640 1 -- 172.21.15.99:0/683624647 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f82dc051040 con 0x7f82e409db20 2024-01-19T05:18:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82e414ffa0 con 0x7f82e409db20 2024-01-19T05:18:32.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82cbfff640 1 -- 172.21.15.99:0/683624647 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82dc0170a0 con 0x7f82e409db20 2024-01-19T05:18:32.515 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:32.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f82d0066530 msgr2=0x7f82d00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f82d0066530 0x7f82d00689f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82d40ae000 tx=0x7f82d4008040 comp rx=0 tx=0).stop 2024-01-19T05:18:32.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e409db20 msgr2=0x7f82e414dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e409db20 0x7f82e414dac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00caa0 tx=0x7f82dc00cf60 comp rx=0 tx=0).stop 2024-01-19T05:18:32.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 shutdown_connections 2024-01-19T05:18:32.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f82d0066530 0x7f82d00689f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e409db20 0x7f82e414dac0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f82e409d6c0 0x7f82e414eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 --2- 172.21.15.99:0/683624647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82e406a940 0x7f82e4072130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.517+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 >> 172.21.15.99:0/683624647 conn(0x7f82e4066ef0 msgr2=0x7f82e409b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.521+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 shutdown_connections 2024-01-19T05:18:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.521+0000 7f82e99e8640 1 -- 172.21.15.99:0/683624647 wait complete. 2024-01-19T05:18:32.535 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:32.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd0758f3640 1 Processor -- start 2024-01-19T05:18:32.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd0758f3640 1 -- start start 2024-01-19T05:18:32.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd0758f3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd0700b2ce0 0x7fd070071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd0758f3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0701441d0 0x7fd070072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd0758f3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07006f620 con 0x7fd0700b1870 2024-01-19T05:18:32.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd0758f3640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd070141000 con 0x7fd0700b2ce0 2024-01-19T05:18:32.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd0758f3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd070143610 con 0x7fd0701441d0 2024-01-19T05:18:32.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd06f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0701441d0 0x7fd070072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd06effd640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd0700b2ce0 0x7fd070071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd06f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0701441d0 0x7fd070072440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:36222/0 (socket says 172.21.15.99:36222) 2024-01-19T05:18:32.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd06f7fe640 1 -- 172.21.15.99:0/1321802233 learned_addr learned my addr 172.21.15.99:0/1321802233 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:32.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd06f7fe640 1 -- 172.21.15.99:0/1321802233 >> v2:172.21.15.157:3300/0 conn(0x7fd0700b2ce0 msgr2=0x7fd070071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:32.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd06f7fe640 1 --2- 172.21.15.99:0/1321802233 >> v2:172.21.15.157:3300/0 conn(0x7fd0700b2ce0 0x7fd070071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd06f7fe640 1 -- 172.21.15.99:0/1321802233 >> v1:172.21.15.157:6789/0 conn(0x7fd0700b1870 legacy=0x7fd070143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.657+0000 7fd06f7fe640 1 -- 172.21.15.99:0/1321802233 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0700b30c0 con 0x7fd0701441d0 2024-01-19T05:18:32.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06f7fe640 1 --2- 172.21.15.99:0/1321802233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0701441d0 0x7fd070072440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd06800bb10 tx=0x7fd06801ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c569142dd5b678a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06dffb640 1 -- 172.21.15.99:0/1321802233 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680a7cb0 con 0x7fd0701441d0 2024-01-19T05:18:32.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06dffb640 1 -- 172.21.15.99:0/1321802233 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0680a7e10 con 0x7fd0701441d0 2024-01-19T05:18:32.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06dffb640 1 -- 172.21.15.99:0/1321802233 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680af660 con 0x7fd0701441d0 2024-01-19T05:18:32.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- 172.21.15.99:0/1321802233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0701441d0 msgr2=0x7fd070072440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 --2- 172.21.15.99:0/1321802233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0701441d0 0x7fd070072440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd06800bb10 tx=0x7fd06801ebe0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- 172.21.15.99:0/1321802233 shutdown_connections 2024-01-19T05:18:32.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 --2- 172.21.15.99:0/1321802233 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0701441d0 0x7fd070072440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 --2- 172.21.15.99:0/1321802233 >> v2:172.21.15.157:3300/0 conn(0x7fd0700b2ce0 0x7fd070071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- 172.21.15.99:0/1321802233 >> 172.21.15.99:0/1321802233 conn(0x7fd0700b8080 msgr2=0x7fd0700b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:32.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- 172.21.15.99:0/1321802233 shutdown_connections 2024-01-19T05:18:32.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- 172.21.15.99:0/1321802233 wait complete. 2024-01-19T05:18:32.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 Processor -- start 2024-01-19T05:18:32.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- start start 2024-01-19T05:18:32.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700b2ce0 0x7fd0701dec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0701441d0 0x7fd0701dab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd07013fe70 0x7fd070140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0701db060 con 0x7fd0701441d0 2024-01-19T05:18:32.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700aa670 con 0x7fd07013fe70 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd0758f3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0701de130 con 0x7fd0700b2ce0 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0701441d0 0x7fd0701dab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0701441d0 0x7fd0701dab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32920/0 (socket says 172.21.15.99:32920) 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 -- 172.21.15.99:0/3410260223 learned_addr learned my addr 172.21.15.99:0/3410260223 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06effd640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700b2ce0 0x7fd0701dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06f7fe640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd07013fe70 0x7fd070140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 -- 172.21.15.99:0/3410260223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700b2ce0 msgr2=0x7fd0701dec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700b2ce0 0x7fd0701dec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 -- 172.21.15.99:0/3410260223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd07013fe70 msgr2=0x7fd070140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd07013fe70 0x7fd070140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 -- 172.21.15.99:0/3410260223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06800b770 con 0x7fd0701441d0 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.661+0000 7fd06e7fc640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0701441d0 0x7fd0701dab20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd06400c420 tx=0x7fd06400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd057fff640 1 -- 172.21.15.99:0/3410260223 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0640052d0 con 0x7fd0701441d0 2024-01-19T05:18:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd057fff640 1 -- 172.21.15.99:0/3410260223 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd064005430 con 0x7fd0701441d0 2024-01-19T05:18:32.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0701de410 con 0x7fd0701441d0 2024-01-19T05:18:32.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd057fff640 1 -- 172.21.15.99:0/3410260223 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064007260 con 0x7fd0701441d0 2024-01-19T05:18:32.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0700aa390 con 0x7fd0701441d0 2024-01-19T05:18:32.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0701de930 con 0x7fd0701441d0 2024-01-19T05:18:32.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd057fff640 1 -- 172.21.15.99:0/3410260223 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd0640073c0 con 0x7fd0701441d0 2024-01-19T05:18:32.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd057fff640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd05c066500 0x7fd05c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd057fff640 1 -- 172.21.15.99:0/3410260223 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0640838e0 con 0x7fd0701441d0 2024-01-19T05:18:32.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd06effd640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd05c066500 0x7fd05c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.665+0000 7fd06effd640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd05c066500 0x7fd05c0689c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd070072850 tx=0x7fd06000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.669+0000 7fd057fff640 1 -- 172.21.15.99:0/3410260223 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd064050c10 con 0x7fd0701441d0 2024-01-19T05:18:32.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.821+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0701de930 con 0x7fd0701441d0 2024-01-19T05:18:32.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd057fff640 1 -- 172.21.15.99:0/3410260223 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0701de930 con 0x7fd0701441d0 2024-01-19T05:18:32.823 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:32.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd05c066500 msgr2=0x7fd05c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd05c066500 0x7fd05c0689c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd070072850 tx=0x7fd06000b040 comp rx=0 tx=0).stop 2024-01-19T05:18:32.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0701441d0 msgr2=0x7fd0701dab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0701441d0 0x7fd0701dab20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd06400c420 tx=0x7fd06400c8e0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 shutdown_connections 2024-01-19T05:18:32.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd05c066500 0x7fd05c0689c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd07013fe70 0x7fd070140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0701441d0 0x7fd0701dab20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 --2- 172.21.15.99:0/3410260223 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd0700b2ce0 0x7fd0701dec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 >> 172.21.15.99:0/3410260223 conn(0x7fd0700b8080 msgr2=0x7fd0700af980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:32.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 shutdown_connections 2024-01-19T05:18:32.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.825+0000 7fd0758f3640 1 -- 172.21.15.99:0/3410260223 wait complete. 2024-01-19T05:18:32.840 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:32.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.957+0000 7f6b8ba1e640 1 Processor -- start 2024-01-19T05:18:32.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.957+0000 7f6b8ba1e640 1 -- start start 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b8ba1e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b840b9220 0x7f6b840b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b8ba1e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b84140800 con 0x7f6b841464c0 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b8ba1e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b840b29b0 con 0x7f6b8413fcc0 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b8ba1e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b840afda0 con 0x7f6b840b9220 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b88fb9640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6b841464c0 0x7f6b84146950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33424/0 (socket says 172.21.15.99:33424) 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b88fb9640 1 -- 172.21.15.99:0/2738053178 learned_addr learned my addr 172.21.15.99:0/2738053178 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b897ba640 1 --2- 172.21.15.99:0/2738053178 >> v2:172.21.15.157:3300/0 conn(0x7f6b840b9220 0x7f6b840b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869349024 0 0) 0x7f6b84140800 con 0x7f6b841464c0 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b70003530 con 0x7f6b841464c0 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068807864 0 0) 0x7f6b70003530 con 0x7f6b841464c0 2024-01-19T05:18:32.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 >> v2:172.21.15.157:3300/0 conn(0x7f6b840b9220 msgr2=0x7f6b840b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 --2- 172.21.15.99:0/2738053178 >> v2:172.21.15.157:3300/0 conn(0x7f6b840b9220 0x7f6b840b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 >> v1:172.21.15.157:6789/0 conn(0x7f6b8413fcc0 legacy=0x7f6b841400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840b9600 con 0x7f6b841464c0 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f6b74001680 con 0x7f6b841464c0 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b897ba640 1 --2- 172.21.15.99:0/2738053178 >> v2:172.21.15.157:3300/0 conn(0x7f6b840b9220 0x7f6b840b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 >> v1:172.21.15.99:6789/0 conn(0x7f6b841464c0 legacy=0x7f6b84146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70003980 0x7f6b70003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b700047d0 0x7f6b70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b700052b0 0x7f6b7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840afda0 con 0x7f6b70003980 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000e3c0 con 0x7f6b700047d0 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000e580 con 0x7f6b700052b0 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b897ba640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70003980 0x7f6b70003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b88fb9640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b700047d0 0x7f6b70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b89fbb640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b700052b0 0x7f6b7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b897ba640 1 -- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b700052b0 msgr2=0x7f6b7000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b897ba640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b700052b0 0x7f6b7000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b897ba640 1 -- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b700047d0 msgr2=0x7f6b70004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b897ba640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b700047d0 0x7f6b70004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b897ba640 1 -- 172.21.15.99:0/2738053178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70003530 con 0x7f6b70003980 2024-01-19T05:18:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b89fbb640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b700052b0 0x7f6b7000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:32.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.961+0000 7f6b89fbb640 1 -- 172.21.15.99:0/2738053178 reap_dead start 2024-01-19T05:18:32.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b897ba640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70003980 0x7f6b70003dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b800098a0 tx=0x7f6b8001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89295b0a4f8cc720 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800a9610 con 0x7f6b70003980 2024-01-19T05:18:32.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b800a9770 con 0x7f6b70003980 2024-01-19T05:18:32.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b7bfff640 1 -- 172.21.15.99:0/2738053178 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800a9ae0 con 0x7f6b70003980 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/2738053178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70003980 msgr2=0x7f6b70003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70003980 0x7f6b70003dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b800098a0 tx=0x7f6b8001c520 comp rx=0 tx=0).stop 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/2738053178 shutdown_connections 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 --2- 172.21.15.99:0/2738053178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70003980 0x7f6b70003dc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/2738053178 >> 172.21.15.99:0/2738053178 conn(0x7f6b8406adf0 msgr2=0x7f6b840b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/2738053178 shutdown_connections 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/2738053178 wait complete. 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 Processor -- start 2024-01-19T05:18:32.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- start start 2024-01-19T05:18:32.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b70003980 0x7f6b84145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b841cf780 0x7f6b841d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b841d0c10 0x7f6b8413b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841d10c0 con 0x7f6b841d0c10 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841cfcb0 con 0x7f6b841cf780 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b8ba1e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841cff90 con 0x7f6b70003980 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b841d0c10 0x7f6b8413b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b841d0c10 0x7f6b8413b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32936/0 (socket says 172.21.15.99:32936) 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 -- 172.21.15.99:0/3088438238 learned_addr learned my addr 172.21.15.99:0/3088438238 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b88fb9640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b841cf780 0x7f6b841d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b897ba640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b70003980 0x7f6b84145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 -- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b70003980 msgr2=0x7f6b84145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b70003980 0x7f6b84145930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 -- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b841cf780 msgr2=0x7f6b841d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b841cf780 0x7f6b841d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 -- 172.21.15.99:0/3088438238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84070920 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b88fb9640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b841cf780 0x7f6b841d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b89fbb640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b841d0c10 0x7f6b8413b930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6b84067aa0 tx=0x7f6b7c00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.965+0000 7f6b79ffb640 1 -- 172.21.15.99:0/3088438238 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c003b80 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b79ffb640 1 -- 172.21.15.99:0/3088438238 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c003d00 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b841ce4f0 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b79ffb640 1 -- 172.21.15.99:0/3088438238 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0052b0 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b841ceab0 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b840696e0 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b79ffb640 1 -- 172.21.15.99:0/3088438238 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6b7c005410 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b79ffb640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6b68066500 0x7f6b680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b79ffb640 1 -- 172.21.15.99:0/3088438238 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b7c0836c0 con 0x7f6b841d0c10 2024-01-19T05:18:32.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b897ba640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6b68066500 0x7f6b680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:32.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.969+0000 7f6b897ba640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6b68066500 0x7f6b680689c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b800ae000 tx=0x7f6b800046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:32.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:32.973+0000 7f6b79ffb640 1 -- 172.21.15.99:0/3088438238 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6b7c0509f0 con 0x7f6b841d0c10 2024-01-19T05:18:33.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b8406bd00 con 0x7f6b841d0c10 2024-01-19T05:18:33.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b79ffb640 1 -- 172.21.15.99:0/3088438238 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b7c018020 con 0x7f6b841d0c10 2024-01-19T05:18:33.124 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6b68066500 msgr2=0x7f6b680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6b68066500 0x7f6b680689c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b800ae000 tx=0x7f6b800046d0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b841d0c10 msgr2=0x7f6b8413b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b841d0c10 0x7f6b8413b930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6b84067aa0 tx=0x7f6b7c00db80 comp rx=0 tx=0).stop 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 shutdown_connections 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6b68066500 0x7f6b680689c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b841d0c10 0x7f6b8413b930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b841cf780 0x7f6b841d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 --2- 172.21.15.99:0/3088438238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6b70003980 0x7f6b84145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 >> 172.21.15.99:0/3088438238 conn(0x7f6b8406adf0 msgr2=0x7f6b84142dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 shutdown_connections 2024-01-19T05:18:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.125+0000 7f6b8ba1e640 1 -- 172.21.15.99:0/3088438238 wait complete. 2024-01-19T05:18:33.141 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T05:18:33.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6e55d0640 1 Processor -- start 2024-01-19T05:18:33.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6e55d0640 1 -- start start 2024-01-19T05:18:33.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6e55d0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff6e00b96f0 0x7ff6e00b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6e55d0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6e00b7c40 0x7ff6e0140780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6e55d0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e00b87f0 con 0x7ff6e0140cc0 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6e55d0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e0141110 con 0x7ff6e00b7c40 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6e55d0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e00b9ad0 con 0x7ff6e00b96f0 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6d7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6e00b7c40 0x7ff6e0140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6d7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6e00b7c40 0x7ff6e0140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32946/0 (socket says 172.21.15.99:32946) 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6d7fff640 1 -- 172.21.15.99:0/1252474543 learned_addr learned my addr 172.21.15.99:0/1252474543 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6d7fff640 1 -- 172.21.15.99:0/1252474543 >> v2:172.21.15.157:3300/0 conn(0x7ff6e00b96f0 msgr2=0x7ff6e00b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6deffd640 1 --2- 172.21.15.99:0/1252474543 >> v2:172.21.15.157:3300/0 conn(0x7ff6e00b96f0 0x7ff6e00b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6d7fff640 1 --2- 172.21.15.99:0/1252474543 >> v2:172.21.15.157:3300/0 conn(0x7ff6e00b96f0 0x7ff6e00b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6d7fff640 1 -- 172.21.15.99:0/1252474543 >> v1:172.21.15.157:6789/0 conn(0x7ff6e0140cc0 legacy=0x7ff6e0149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6d7fff640 1 -- 172.21.15.99:0/1252474543 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00b81e0 con 0x7ff6e00b7c40 2024-01-19T05:18:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.249+0000 7ff6deffd640 1 --2- 172.21.15.99:0/1252474543 >> v2:172.21.15.157:3300/0 conn(0x7ff6e00b96f0 0x7ff6e00b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:33.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6d7fff640 1 --2- 172.21.15.99:0/1252474543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e0140780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00b8c50 tx=0x7ff6c801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792704337c6f55e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:33.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6de7fc640 1 -- 172.21.15.99:0/1252474543 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80ac640 con 0x7ff6e00b7c40 2024-01-19T05:18:33.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6de7fc640 1 -- 172.21.15.99:0/1252474543 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c80ac7a0 con 0x7ff6e00b7c40 2024-01-19T05:18:33.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6de7fc640 1 -- 172.21.15.99:0/1252474543 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80acb30 con 0x7ff6e00b7c40 2024-01-19T05:18:33.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- 172.21.15.99:0/1252474543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 msgr2=0x7ff6e0140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/1252474543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e0140780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00b8c50 tx=0x7ff6c801c4c0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- 172.21.15.99:0/1252474543 shutdown_connections 2024-01-19T05:18:33.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/1252474543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e0140780 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/1252474543 >> v2:172.21.15.157:3300/0 conn(0x7ff6e00b96f0 0x7ff6e00b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- 172.21.15.99:0/1252474543 >> 172.21.15.99:0/1252474543 conn(0x7ff6e009e600 msgr2=0x7ff6e00b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:33.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- 172.21.15.99:0/1252474543 shutdown_connections 2024-01-19T05:18:33.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- 172.21.15.99:0/1252474543 wait complete. 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 Processor -- start 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- start start 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e01490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6e00b96f0 0x7ff6e009cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6e0140cc0 0x7ff6e009d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e009c160 con 0x7ff6e00b7c40 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00a0820 con 0x7ff6e0140cc0 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6e55d0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00a01d0 con 0x7ff6e00b96f0 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6deffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e01490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6deffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e01490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32960/0 (socket says 172.21.15.99:32960) 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.253+0000 7ff6deffd640 1 -- 172.21.15.99:0/3874369960 learned_addr learned my addr 172.21.15.99:0/3874369960 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:33.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6deffd640 1 -- 172.21.15.99:0/3874369960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6e00b96f0 msgr2=0x7ff6e009cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d7fff640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6e00b96f0 0x7ff6e009cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6df7fe640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6e0140cc0 0x7ff6e009d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6deffd640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6e00b96f0 0x7ff6e009cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6deffd640 1 -- 172.21.15.99:0/3874369960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6e0140cc0 msgr2=0x7ff6e009d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6deffd640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6e0140cc0 0x7ff6e009d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6deffd640 1 -- 172.21.15.99:0/3874369960 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80094d0 con 0x7ff6e00b7c40 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6deffd640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e01490a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000c7c0 tx=0x7ff6d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d77fe640 1 -- 172.21.15.99:0/3874369960 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0007a30 con 0x7ff6e00b7c40 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d77fe640 1 -- 172.21.15.99:0/3874369960 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0007b90 con 0x7ff6e00b7c40 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e00a04b0 con 0x7ff6e00b7c40 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d77fe640 1 -- 172.21.15.99:0/3874369960 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000ce70 con 0x7ff6e00b7c40 2024-01-19T05:18:33.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e013b830 con 0x7ff6e00b7c40 2024-01-19T05:18:33.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e00a15b0 con 0x7ff6e00b7c40 2024-01-19T05:18:33.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d77fe640 1 -- 172.21.15.99:0/3874369960 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff6d00193f0 con 0x7ff6e00b7c40 2024-01-19T05:18:33.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d77fe640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c0066500 0x7ff6c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d7fff640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c0066500 0x7ff6c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d77fe640 1 -- 172.21.15.99:0/3874369960 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6d0084380 con 0x7ff6e00b7c40 2024-01-19T05:18:33.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.257+0000 7ff6d7fff640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c0066500 0x7ff6c00689c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80ae000 tx=0x7ff6c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.261+0000 7ff6d77fe640 1 -- 172.21.15.99:0/3874369960 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff6d0051620 con 0x7ff6e00b7c40 2024-01-19T05:18:33.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff6e00696e0 con 0x7ff6e00b7c40 2024-01-19T05:18:33.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6d77fe640 1 -- 172.21.15.99:0/3874369960 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff6d005b030 con 0x7ff6e00b7c40 2024-01-19T05:18:33.416 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c0066500 msgr2=0x7ff6c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c0066500 0x7ff6c00689c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80ae000 tx=0x7ff6c8008040 comp rx=0 tx=0).stop 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 msgr2=0x7ff6e01490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e01490a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000c7c0 tx=0x7ff6d000cc80 comp rx=0 tx=0).stop 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 shutdown_connections 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff6c0066500 0x7ff6c00689c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6e0140cc0 0x7ff6e009d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6e00b96f0 0x7ff6e009cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 --2- 172.21.15.99:0/3874369960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6e00b7c40 0x7ff6e01490a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 >> 172.21.15.99:0/3874369960 conn(0x7ff6e009e600 msgr2=0x7ff6e00b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 shutdown_connections 2024-01-19T05:18:33.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.417+0000 7ff6e55d0640 1 -- 172.21.15.99:0/3874369960 wait complete. 2024-01-19T05:18:33.433 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2024-01-19T05:18:33.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:33.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:33.532 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:18:33.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:18:33.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:33.532 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-19T05:18:33.546 INFO:tasks.cephfs.cephfs_test_case:[] 2024-01-19T05:18:33.547 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:33.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.709+0000 7fe166657640 1 Processor -- start 2024-01-19T05:18:33.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe166657640 1 -- start start 2024-01-19T05:18:33.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe166657640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b2ce0 0x7fe160071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe166657640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe1600b1870 0x7fe160072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe166657640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe160143ac0 0x7fe160143f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe166657640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe160141000 con 0x7fe1600b1870 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe166657640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1601444b0 con 0x7fe160143ac0 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe166657640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16006f620 con 0x7fe1600b2ce0 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe1600b1870 0x7fe160072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe1600b1870 0x7fe160072440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32970/0 (socket says 172.21.15.99:32970) 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15f7fe640 1 -- 172.21.15.99:0/1907855870 learned_addr learned my addr 172.21.15.99:0/1907855870 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15f7fe640 1 -- 172.21.15.99:0/1907855870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b2ce0 msgr2=0x7fe160071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15ffff640 1 --2- 172.21.15.99:0/1907855870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b2ce0 0x7fe160071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe164bf4640 1 --2- 172.21.15.99:0/1907855870 >> v2:172.21.15.157:3300/0 conn(0x7fe160143ac0 0x7fe160143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15f7fe640 1 --2- 172.21.15.99:0/1907855870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b2ce0 0x7fe160071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15f7fe640 1 -- 172.21.15.99:0/1907855870 >> v2:172.21.15.157:3300/0 conn(0x7fe160143ac0 msgr2=0x7fe160143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:33.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15f7fe640 1 --2- 172.21.15.99:0/1907855870 >> v2:172.21.15.157:3300/0 conn(0x7fe160143ac0 0x7fe160143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe15f7fe640 1 -- 172.21.15.99:0/1907855870 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160143610 con 0x7fe1600b1870 2024-01-19T05:18:33.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.713+0000 7fe164bf4640 1 --2- 172.21.15.99:0/1907855870 >> v2:172.21.15.157:3300/0 conn(0x7fe160143ac0 0x7fe160143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:33.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 --2- 172.21.15.99:0/1907855870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1600b1870 0x7fe160072440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe16006ef10 tx=0x7fe15001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efe3f3defdd6024 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:33.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15effd640 1 -- 172.21.15.99:0/1907855870 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500a5850 con 0x7fe1600b1870 2024-01-19T05:18:33.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15effd640 1 -- 172.21.15.99:0/1907855870 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500a59b0 con 0x7fe1600b1870 2024-01-19T05:18:33.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15effd640 1 -- 172.21.15.99:0/1907855870 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500a5d40 con 0x7fe1600b1870 2024-01-19T05:18:33.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- 172.21.15.99:0/1907855870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1600b1870 msgr2=0x7fe160072440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 --2- 172.21.15.99:0/1907855870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1600b1870 0x7fe160072440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe16006ef10 tx=0x7fe15001c9d0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- 172.21.15.99:0/1907855870 shutdown_connections 2024-01-19T05:18:33.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 --2- 172.21.15.99:0/1907855870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1600b1870 0x7fe160072440 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 --2- 172.21.15.99:0/1907855870 >> v2:172.21.15.157:3300/0 conn(0x7fe160143ac0 0x7fe160143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 --2- 172.21.15.99:0/1907855870 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b2ce0 0x7fe160071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- 172.21.15.99:0/1907855870 >> 172.21.15.99:0/1907855870 conn(0x7fe1600b8080 msgr2=0x7fe1600b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:33.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- 172.21.15.99:0/1907855870 shutdown_connections 2024-01-19T05:18:33.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- 172.21.15.99:0/1907855870 wait complete. 2024-01-19T05:18:33.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 Processor -- start 2024-01-19T05:18:33.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- start start 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1600b2ce0 0x7fe1600b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe160143ac0 0x7fe1600b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b6bf0 0x7fe16013b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600b70a0 con 0x7fe160143ac0 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600ae5a0 con 0x7fe1600b2ce0 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600acfd0 con 0x7fe1600b6bf0 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe160143ac0 0x7fe1600b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe160143ac0 0x7fe1600b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32974/0 (socket says 172.21.15.99:32974) 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 -- 172.21.15.99:0/2236339841 learned_addr learned my addr 172.21.15.99:0/2236339841 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 -- 172.21.15.99:0/2236339841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b6bf0 msgr2=0x7fe16013b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b6bf0 0x7fe16013b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 -- 172.21.15.99:0/2236339841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1600b2ce0 msgr2=0x7fe1600b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1600b2ce0 0x7fe1600b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 -- 172.21.15.99:0/2236339841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009b30 con 0x7fe160143ac0 2024-01-19T05:18:33.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15f7fe640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe160143ac0 0x7fe1600b66b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1500af040 tx=0x7fe150019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:33.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15cff9640 1 -- 172.21.15.99:0/2236339841 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500b6890 con 0x7fe160143ac0 2024-01-19T05:18:33.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15cff9640 1 -- 172.21.15.99:0/2236339841 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500b6a30 con 0x7fe160143ac0 2024-01-19T05:18:33.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16013eec0 con 0x7fe160143ac0 2024-01-19T05:18:33.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe15cff9640 1 -- 172.21.15.99:0/2236339841 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500b6de0 con 0x7fe160143ac0 2024-01-19T05:18:33.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.717+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16013ec10 con 0x7fe160143ac0 2024-01-19T05:18:33.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.721+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1600b64d0 con 0x7fe160143ac0 2024-01-19T05:18:33.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.721+0000 7fe15cff9640 1 -- 172.21.15.99:0/2236339841 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe150007470 con 0x7fe160143ac0 2024-01-19T05:18:33.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.721+0000 7fe15cff9640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe140066530 0x7fe1400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:33.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.721+0000 7fe15cff9640 1 -- 172.21.15.99:0/2236339841 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe15011f4b0 con 0x7fe160143ac0 2024-01-19T05:18:33.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.721+0000 7fe15ffff640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe140066530 0x7fe1400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:33.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.721+0000 7fe15ffff640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe140066530 0x7fe1400689f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe14800a8b0 tx=0x7fe148008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:33.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.725+0000 7fe15cff9640 1 -- 172.21.15.99:0/2236339841 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe1500ec900 con 0x7fe160143ac0 2024-01-19T05:18:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.917+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1600696e0 con 0x7fe160143ac0 2024-01-19T05:18:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.917+0000 7fe15cff9640 1 -- 172.21.15.99:0/2236339841 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3352 (secure 0 0 0) 0x7fe1500eff20 con 0x7fe160143ac0 2024-01-19T05:18:33.918 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:33.918 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:02.994909+0000","modified":"2024-01-19T05:18:04.990494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:18:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-19T05:18:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe140066530 msgr2=0x7fe1400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe140066530 0x7fe1400689f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe14800a8b0 tx=0x7fe148008040 comp rx=0 tx=0).stop 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe160143ac0 msgr2=0x7fe1600b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe160143ac0 0x7fe1600b66b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1500af040 tx=0x7fe150019770 comp rx=0 tx=0).stop 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 shutdown_connections 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe140066530 0x7fe1400689f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600b6bf0 0x7fe16013b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe160143ac0 0x7fe1600b66b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 --2- 172.21.15.99:0/2236339841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1600b2ce0 0x7fe1600b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 >> 172.21.15.99:0/2236339841 conn(0x7fe1600b8080 msgr2=0x7fe160070170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 shutdown_connections 2024-01-19T05:18:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:33.921+0000 7fe166657640 1 -- 172.21.15.99:0/2236339841 wait complete. 2024-01-19T05:18:33.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.053+0000 7f6a3bbd5640 1 Processor -- start 2024-01-19T05:18:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.053+0000 7f6a3bbd5640 1 -- start start 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.053+0000 7f6a3bbd5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a340b19f0 0x7f6a3406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.053+0000 7f6a3bbd5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6a340724f0 0x7f6a34145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a34070680 con 0x7f6a34144c70 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a34070410 con 0x7f6a340724f0 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a34144790 con 0x7f6a340b19f0 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a39170640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6a34144c70 0x7f6a34071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33428/0 (socket says 172.21.15.99:33428) 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a39170640 1 -- 172.21.15.99:0/4237830536 learned_addr learned my addr 172.21.15.99:0/4237830536 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3a172640 1 --2- 172.21.15.99:0/4237830536 >> v2:172.21.15.99:3300/0 conn(0x7f6a340724f0 0x7f6a34145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3896f640 1 -- 172.21.15.99:0/4237830536 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589023579 0 0) 0x7f6a34070680 con 0x7f6a34144c70 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3896f640 1 -- 172.21.15.99:0/4237830536 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a20003530 con 0x7f6a34144c70 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3a172640 1 -- 172.21.15.99:0/4237830536 >> v2:172.21.15.157:3300/0 conn(0x7f6a340b19f0 msgr2=0x7f6a3406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3a172640 1 --2- 172.21.15.99:0/4237830536 >> v2:172.21.15.157:3300/0 conn(0x7f6a340b19f0 0x7f6a3406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3a172640 1 -- 172.21.15.99:0/4237830536 >> v1:172.21.15.99:6789/0 conn(0x7f6a34144c70 legacy=0x7f6a34071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3a172640 1 -- 172.21.15.99:0/4237830536 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3406f2b0 con 0x7f6a340724f0 2024-01-19T05:18:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3a172640 1 --2- 172.21.15.99:0/4237830536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340724f0 0x7f6a34145100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6a3406d030 tx=0x7f6a2c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53af3384d83a30b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3896f640 1 -- 172.21.15.99:0/4237830536 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0a58e0 con 0x7f6a340724f0 2024-01-19T05:18:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3896f640 1 -- 172.21.15.99:0/4237830536 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0a5a40 con 0x7f6a340724f0 2024-01-19T05:18:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3896f640 1 -- 172.21.15.99:0/4237830536 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0a5dd0 con 0x7f6a340724f0 2024-01-19T05:18:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/4237830536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340724f0 msgr2=0x7f6a34145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/4237830536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340724f0 0x7f6a34145100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6a3406d030 tx=0x7f6a2c01c880 comp rx=0 tx=0).stop 2024-01-19T05:18:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/4237830536 shutdown_connections 2024-01-19T05:18:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/4237830536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340724f0 0x7f6a34145100 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/4237830536 >> v2:172.21.15.157:3300/0 conn(0x7f6a340b19f0 0x7f6a3406ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/4237830536 >> 172.21.15.99:0/4237830536 conn(0x7f6a340b8080 msgr2=0x7f6a340b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:34.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.057+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/4237830536 shutdown_connections 2024-01-19T05:18:34.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/4237830536 wait complete. 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 Processor -- start 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 -- start start 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a340724f0 0x7f6a34141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340b19f0 0x7f6a34140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a34144c70 0x7f6a341dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3413ffc0 con 0x7f6a340b19f0 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3413f520 con 0x7f6a34144c70 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3413f7c0 con 0x7f6a340724f0 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340b19f0 0x7f6a34140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340b19f0 0x7f6a34140610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32986/0 (socket says 172.21.15.99:32986) 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 -- 172.21.15.99:0/3782527328 learned_addr learned my addr 172.21.15.99:0/3782527328 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39971640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a340724f0 0x7f6a34141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3a172640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a34144c70 0x7f6a341dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 -- 172.21.15.99:0/3782527328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a340724f0 msgr2=0x7f6a34141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a340724f0 0x7f6a34141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 -- 172.21.15.99:0/3782527328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a34144c70 msgr2=0x7f6a341dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a34144c70 0x7f6a341dfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 -- 172.21.15.99:0/3782527328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009a70 con 0x7f6a340b19f0 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a39170640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340b19f0 0x7f6a34140610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a300010f0 tx=0x7f6a3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a2a7fc640 1 -- 172.21.15.99:0/3782527328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30005cf0 con 0x7f6a340b19f0 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a2a7fc640 1 -- 172.21.15.99:0/3782527328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a30005e70 con 0x7f6a340b19f0 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3413faa0 con 0x7f6a340b19f0 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a2a7fc640 1 -- 172.21.15.99:0/3782527328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300072d0 con 0x7f6a340b19f0 2024-01-19T05:18:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a34141960 con 0x7f6a340b19f0 2024-01-19T05:18:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3413fce0 con 0x7f6a340b19f0 2024-01-19T05:18:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.061+0000 7f6a2a7fc640 1 -- 172.21.15.99:0/3782527328 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6a30007430 con 0x7f6a340b19f0 2024-01-19T05:18:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.065+0000 7f6a2a7fc640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a18066500 0x7f6a180689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.065+0000 7f6a2a7fc640 1 -- 172.21.15.99:0/3782527328 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a30083430 con 0x7f6a340b19f0 2024-01-19T05:18:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.065+0000 7f6a39971640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a18066500 0x7f6a180689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.065+0000 7f6a39971640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a18066500 0x7f6a180689c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400a790 tx=0x7f6a24008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.069+0000 7f6a2a7fc640 1 -- 172.21.15.99:0/3782527328 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6a30050760 con 0x7f6a340b19f0 2024-01-19T05:18:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.209+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a340696e0 con 0x7f6a340b19f0 2024-01-19T05:18:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.213+0000 7f6a2a7fc640 1 -- 172.21.15.99:0/3782527328 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f6a30053d80 con 0x7f6a340b19f0 2024-01-19T05:18:34.213 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:34.213 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a18066500 msgr2=0x7f6a180689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a18066500 0x7f6a180689c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400a790 tx=0x7f6a24008040 comp rx=0 tx=0).stop 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340b19f0 msgr2=0x7f6a34140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340b19f0 0x7f6a34140610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a300010f0 tx=0x7f6a3000c8f0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 shutdown_connections 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6a18066500 0x7f6a180689c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a34144c70 0x7f6a341dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a340b19f0 0x7f6a34140610 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 --2- 172.21.15.99:0/3782527328 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a340724f0 0x7f6a34141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 >> 172.21.15.99:0/3782527328 conn(0x7f6a340b8080 msgr2=0x7f6a340b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 shutdown_connections 2024-01-19T05:18:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.217+0000 7f6a3bbd5640 1 -- 172.21.15.99:0/3782527328 wait complete. 2024-01-19T05:18:34.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:01.306914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:01.982437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:34.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.353+0000 7f172f278640 1 Processor -- start 2024-01-19T05:18:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.353+0000 7f172f278640 1 -- start start 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f17280b19f0 0x7f172806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1728144c70 0x7f17281450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1728071de0 0x7f1728072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1728070680 con 0x7f1728071de0 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1728070410 con 0x7f17280b19f0 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1728144790 con 0x7f1728144c70 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1728071de0 0x7f1728072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1728071de0 0x7f1728072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32998/0 (socket says 172.21.15.99:32998) 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 -- 172.21.15.99:0/3881809420 learned_addr learned my addr 172.21.15.99:0/3881809420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172c813640 1 --2- 172.21.15.99:0/3881809420 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1728144c70 0x7f17281450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d014640 1 --2- 172.21.15.99:0/3881809420 >> v2:172.21.15.157:3300/0 conn(0x7f17280b19f0 0x7f172806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 -- 172.21.15.99:0/3881809420 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1728144c70 msgr2=0x7f17281450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 --2- 172.21.15.99:0/3881809420 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1728144c70 0x7f17281450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 -- 172.21.15.99:0/3881809420 >> v2:172.21.15.157:3300/0 conn(0x7f17280b19f0 msgr2=0x7f172806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 --2- 172.21.15.99:0/3881809420 >> v2:172.21.15.157:3300/0 conn(0x7f17280b19f0 0x7f172806ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 -- 172.21.15.99:0/3881809420 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172806f2b0 con 0x7f1728071de0 2024-01-19T05:18:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d014640 1 --2- 172.21.15.99:0/3881809420 >> v2:172.21.15.157:3300/0 conn(0x7f17280b19f0 0x7f172806ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172d815640 1 --2- 172.21.15.99:0/3881809420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728072210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f172806d030 tx=0x7f172401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3b86c3dd2c9887 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f171ffff640 1 -- 172.21.15.99:0/3881809420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240ad640 con 0x7f1728071de0 2024-01-19T05:18:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f171ffff640 1 -- 172.21.15.99:0/3881809420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17240ad7a0 con 0x7f1728071de0 2024-01-19T05:18:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f171ffff640 1 -- 172.21.15.99:0/3881809420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240adb30 con 0x7f1728071de0 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 -- 172.21.15.99:0/3881809420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 msgr2=0x7f1728072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 --2- 172.21.15.99:0/3881809420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728072210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f172806d030 tx=0x7f172401c470 comp rx=0 tx=0).stop 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 -- 172.21.15.99:0/3881809420 shutdown_connections 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 --2- 172.21.15.99:0/3881809420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728072210 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 --2- 172.21.15.99:0/3881809420 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1728144c70 0x7f17281450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 --2- 172.21.15.99:0/3881809420 >> v2:172.21.15.157:3300/0 conn(0x7f17280b19f0 0x7f172806ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 -- 172.21.15.99:0/3881809420 >> 172.21.15.99:0/3881809420 conn(0x7f17280b8080 msgr2=0x7f17280b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 -- 172.21.15.99:0/3881809420 shutdown_connections 2024-01-19T05:18:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.357+0000 7f172f278640 1 -- 172.21.15.99:0/3881809420 wait complete. 2024-01-19T05:18:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 Processor -- start 2024-01-19T05:18:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 -- start start 2024-01-19T05:18:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17280b19f0 0x7f172813fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1728144c70 0x7f17281dff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1728144170 con 0x7f1728071de0 2024-01-19T05:18:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172813f640 con 0x7f1728144c70 2024-01-19T05:18:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1728144350 con 0x7f17280b19f0 2024-01-19T05:18:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728143a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33000/0 (socket says 172.21.15.99:33000) 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 -- 172.21.15.99:0/2664046100 learned_addr learned my addr 172.21.15.99:0/2664046100 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172c813640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17280b19f0 0x7f172813fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d815640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1728144c70 0x7f17281dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 -- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17280b19f0 msgr2=0x7f172813fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17280b19f0 0x7f172813fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 -- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1728144c70 msgr2=0x7f17281dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1728144c70 0x7f17281dff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 -- 172.21.15.99:0/2664046100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240094d0 con 0x7f1728071de0 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172c813640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17280b19f0 0x7f172813fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172d014640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728143a50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f172000cf60 tx=0x7f172000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f171dffb640 1 -- 172.21.15.99:0/2664046100 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172000d840 con 0x7f1728071de0 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f171dffb640 1 -- 172.21.15.99:0/2664046100 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172000d9a0 con 0x7f1728071de0 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172813f8e0 con 0x7f1728071de0 2024-01-19T05:18:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f171dffb640 1 -- 172.21.15.99:0/2664046100 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172000dd30 con 0x7f1728071de0 2024-01-19T05:18:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1728140340 con 0x7f1728071de0 2024-01-19T05:18:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.361+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17280696e0 con 0x7f1728071de0 2024-01-19T05:18:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.365+0000 7f171dffb640 1 -- 172.21.15.99:0/2664046100 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1720015440 con 0x7f1728071de0 2024-01-19T05:18:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.365+0000 7f171dffb640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f170c066500 0x7f170c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.365+0000 7f172c813640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f170c066500 0x7f170c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.365+0000 7f171dffb640 1 -- 172.21.15.99:0/2664046100 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1720084940 con 0x7f1728071de0 2024-01-19T05:18:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.365+0000 7f172c813640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f170c066500 0x7f170c0689c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1718006fd0 tx=0x7f1718008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.369+0000 7f171dffb640 1 -- 172.21.15.99:0/2664046100 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1720051bf0 con 0x7f1728071de0 2024-01-19T05:18:34.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1728071890 con 0x7f1728071de0 2024-01-19T05:18:34.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f171dffb640 1 -- 172.21.15.99:0/2664046100 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f172001a020 con 0x7f1728071de0 2024-01-19T05:18:34.511 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:34.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f170c066500 msgr2=0x7f170c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f170c066500 0x7f170c0689c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1718006fd0 tx=0x7f1718008040 comp rx=0 tx=0).stop 2024-01-19T05:18:34.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 msgr2=0x7f1728143a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728143a50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f172000cf60 tx=0x7f172000cf90 comp rx=0 tx=0).stop 2024-01-19T05:18:34.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 shutdown_connections 2024-01-19T05:18:34.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f170c066500 0x7f170c0689c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1728144c70 0x7f17281dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17280b19f0 0x7f172813fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 --2- 172.21.15.99:0/2664046100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728071de0 0x7f1728143a50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 >> 172.21.15.99:0/2664046100 conn(0x7f17280b8080 msgr2=0x7f17280b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:34.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 shutdown_connections 2024-01-19T05:18:34.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.512+0000 7f172f278640 1 -- 172.21.15.99:0/2664046100 wait complete. 2024-01-19T05:18:34.528 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:18:34.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.652+0000 7f128d16c640 1 Processor -- start 2024-01-19T05:18:34.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.652+0000 7f128d16c640 1 -- start start 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128d16c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f128809bc20 0x7f12880af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128d16c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12880b0270 con 0x7f128806a940 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128d16c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1288147a20 con 0x7f1288146ec0 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128d16c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128809e5b0 con 0x7f128809bc20 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f128809bc20 0x7f12880af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f128809bc20 0x7f12880af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33012/0 (socket says 172.21.15.99:33012) 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128659c640 1 -- 172.21.15.99:0/3594542908 learned_addr learned my addr 172.21.15.99:0/3594542908 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f1286d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f128806a940 0x7f128814a690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33432/0 (socket says 172.21.15.99:33432) 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128659c640 1 -- 172.21.15.99:0/3594542908 >> v1:172.21.15.157:6789/0 conn(0x7f1288146ec0 legacy=0x7f1288147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128659c640 1 -- 172.21.15.99:0/3594542908 >> v1:172.21.15.99:6789/0 conn(0x7f128806a940 legacy=0x7f128814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128659c640 1 -- 172.21.15.99:0/3594542908 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288146a60 con 0x7f128809bc20 2024-01-19T05:18:34.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128659c640 1 --2- 172.21.15.99:0/3594542908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12880af890 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1278009870 tx=0x7f127801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34031e0ca17a529 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f1285d9b640 1 -- 172.21.15.99:0/3594542908 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12780ab620 con 0x7f128809bc20 2024-01-19T05:18:34.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f1285d9b640 1 -- 172.21.15.99:0/3594542908 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12780ab780 con 0x7f128809bc20 2024-01-19T05:18:34.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f1285d9b640 1 -- 172.21.15.99:0/3594542908 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12780abb10 con 0x7f128809bc20 2024-01-19T05:18:34.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128d16c640 1 -- 172.21.15.99:0/3594542908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 msgr2=0x7f12880af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.656+0000 7f128d16c640 1 --2- 172.21.15.99:0/3594542908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12880af890 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1278009870 tx=0x7f127801c420 comp rx=0 tx=0).stop 2024-01-19T05:18:34.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- 172.21.15.99:0/3594542908 shutdown_connections 2024-01-19T05:18:34.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 --2- 172.21.15.99:0/3594542908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12880af890 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- 172.21.15.99:0/3594542908 >> 172.21.15.99:0/3594542908 conn(0x7f1288066ef0 msgr2=0x7f12880b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:34.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- 172.21.15.99:0/3594542908 shutdown_connections 2024-01-19T05:18:34.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- 172.21.15.99:0/3594542908 wait complete. 2024-01-19T05:18:34.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 Processor -- start 2024-01-19T05:18:34.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- start start 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f128806a940 0x7f12881374c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12881e18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1288146ec0 0x7f12880717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288149d70 con 0x7f128809bc20 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128806fde0 con 0x7f128806a940 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12881e1e20 con 0x7f1288146ec0 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12881e18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12881e18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33022/0 (socket says 172.21.15.99:33022) 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 -- 172.21.15.99:0/1833896114 learned_addr learned my addr 172.21.15.99:0/1833896114 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f1286d9d640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f128806a940 0x7f12881374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128759e640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1288146ec0 0x7f12880717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 -- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1288146ec0 msgr2=0x7f12880717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1288146ec0 0x7f12880717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 -- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f128806a940 msgr2=0x7f12881374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f128806a940 0x7f12881374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 -- 172.21.15.99:0/1833896114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12780094d0 con 0x7f128809bc20 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f1286d9d640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f128806a940 0x7f12881374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128659c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12881e18e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f12780ad040 tx=0x7f127801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f127f7fe640 1 -- 172.21.15.99:0/1833896114 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12780be5f0 con 0x7f128809bc20 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f127f7fe640 1 -- 172.21.15.99:0/1833896114 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12780be750 con 0x7f128809bc20 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12881e10e0 con 0x7f128809bc20 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f127f7fe640 1 -- 172.21.15.99:0/1833896114 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12780beb00 con 0x7f128809bc20 2024-01-19T05:18:34.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1288070050 con 0x7f128809bc20 2024-01-19T05:18:34.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.660+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12880696e0 con 0x7f128809bc20 2024-01-19T05:18:34.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.664+0000 7f127f7fe640 1 -- 172.21.15.99:0/1833896114 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f12780b43f0 con 0x7f128809bc20 2024-01-19T05:18:34.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.664+0000 7f127f7fe640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1268066530 0x7f12680689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.664+0000 7f127f7fe640 1 -- 172.21.15.99:0/1833896114 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f127811eca0 con 0x7f128809bc20 2024-01-19T05:18:34.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.664+0000 7f1286d9d640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1268066530 0x7f12680689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.664+0000 7f1286d9d640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1268066530 0x7f12680689f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f12800012f0 tx=0x7f1280005c00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.668+0000 7f127f7fe640 1 -- 172.21.15.99:0/1833896114 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f12780ec0f0 con 0x7f128809bc20 2024-01-19T05:18:34.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12881e1590 con 0x7f128809bc20 2024-01-19T05:18:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f127f7fe640 1 -- 172.21.15.99:0/1833896114 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12780ef710 con 0x7f128809bc20 2024-01-19T05:18:34.824 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:18:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1268066530 msgr2=0x7f12680689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1268066530 0x7f12680689f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f12800012f0 tx=0x7f1280005c00 comp rx=0 tx=0).stop 2024-01-19T05:18:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 msgr2=0x7f12881e18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12881e18e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f12780ad040 tx=0x7f127801ac60 comp rx=0 tx=0).stop 2024-01-19T05:18:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 shutdown_connections 2024-01-19T05:18:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1268066530 0x7f12680689f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1288146ec0 0x7f12880717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f128809bc20 0x7f12881e18e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 --2- 172.21.15.99:0/1833896114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f128806a940 0x7f12881374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.824+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 >> 172.21.15.99:0/1833896114 conn(0x7f1288066ef0 msgr2=0x7f12880b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.828+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 shutdown_connections 2024-01-19T05:18:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.828+0000 7f128d16c640 1 -- 172.21.15.99:0/1833896114 wait complete. 2024-01-19T05:18:34.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:18:34.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc2981e640 1 Processor -- start 2024-01-19T05:18:34.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc2981e640 1 -- start start 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc2981e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc240b2ce0 0x7fcc24071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc2981e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcc241441d0 0x7fcc24072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc2981e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2406f620 con 0x7fcc240b1870 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc2981e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc24141000 con 0x7fcc240b2ce0 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc2981e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc24143610 con 0x7fcc241441d0 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc22ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc240b2ce0 0x7fcc24071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc22ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc240b2ce0 0x7fcc24071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33036/0 (socket says 172.21.15.99:33036) 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc22ffd640 1 -- 172.21.15.99:0/408638484 learned_addr learned my addr 172.21.15.99:0/408638484 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc237fe640 1 --2- 172.21.15.99:0/408638484 >> v2:172.21.15.157:3300/0 conn(0x7fcc241441d0 0x7fcc24072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc22ffd640 1 -- 172.21.15.99:0/408638484 >> v2:172.21.15.157:3300/0 conn(0x7fcc241441d0 msgr2=0x7fcc24072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc22ffd640 1 --2- 172.21.15.99:0/408638484 >> v2:172.21.15.157:3300/0 conn(0x7fcc241441d0 0x7fcc24072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc22ffd640 1 -- 172.21.15.99:0/408638484 >> v1:172.21.15.157:6789/0 conn(0x7fcc240b1870 legacy=0x7fcc24143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.960+0000 7fcc22ffd640 1 -- 172.21.15.99:0/408638484 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240b30c0 con 0x7fcc240b2ce0 2024-01-19T05:18:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc22ffd640 1 --2- 172.21.15.99:0/408638484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc240b2ce0 0x7fcc24071f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcc240b10f0 tx=0x7fcc1401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34ca0498a2fbd72 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc227fc640 1 -- 172.21.15.99:0/408638484 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140aa430 con 0x7fcc240b2ce0 2024-01-19T05:18:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc227fc640 1 -- 172.21.15.99:0/408638484 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc140aa590 con 0x7fcc240b2ce0 2024-01-19T05:18:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc227fc640 1 -- 172.21.15.99:0/408638484 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140aa920 con 0x7fcc240b2ce0 2024-01-19T05:18:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- 172.21.15.99:0/408638484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc240b2ce0 msgr2=0x7fcc24071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 --2- 172.21.15.99:0/408638484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc240b2ce0 0x7fcc24071f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcc240b10f0 tx=0x7fcc1401c4d0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- 172.21.15.99:0/408638484 shutdown_connections 2024-01-19T05:18:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 --2- 172.21.15.99:0/408638484 >> v2:172.21.15.157:3300/0 conn(0x7fcc241441d0 0x7fcc24072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 --2- 172.21.15.99:0/408638484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc240b2ce0 0x7fcc24071f00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- 172.21.15.99:0/408638484 >> 172.21.15.99:0/408638484 conn(0x7fcc240b8080 msgr2=0x7fcc240b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:34.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- 172.21.15.99:0/408638484 shutdown_connections 2024-01-19T05:18:34.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- 172.21.15.99:0/408638484 wait complete. 2024-01-19T05:18:34.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 Processor -- start 2024-01-19T05:18:34.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- start start 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc240b2ce0 0x7fcc240ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc241441d0 0x7fcc24138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2413b7f0 0x7fcc24138010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2413a070 con 0x7fcc2413b7f0 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241e24c0 con 0x7fcc240b2ce0 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240ae9e0 con 0x7fcc241441d0 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2413b7f0 0x7fcc24138010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2413b7f0 0x7fcc24138010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33046/0 (socket says 172.21.15.99:33046) 2024-01-19T05:18:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 -- 172.21.15.99:0/3357938651 learned_addr learned my addr 172.21.15.99:0/3357938651 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc22ffd640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc240b2ce0 0x7fcc240ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc1bfff640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc241441d0 0x7fcc24138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 -- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc241441d0 msgr2=0x7fcc24138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc241441d0 0x7fcc24138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 -- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc240b2ce0 msgr2=0x7fcc240ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc240b2ce0 0x7fcc240ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 -- 172.21.15.99:0/3357938651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140094d0 con 0x7fcc2413b7f0 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc1bfff640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc241441d0 0x7fcc24138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc237fe640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2413b7f0 0x7fcc24138010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c007e90 tx=0x7fcc1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc20ff9640 1 -- 172.21.15.99:0/3357938651 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c014420 con 0x7fcc2413b7f0 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc20ff9640 1 -- 172.21.15.99:0/3357938651 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c014580 con 0x7fcc2413b7f0 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc241e2eb0 con 0x7fcc2413b7f0 2024-01-19T05:18:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc20ff9640 1 -- 172.21.15.99:0/3357938651 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c014930 con 0x7fcc2413b7f0 2024-01-19T05:18:34.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.964+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2413ff80 con 0x7fcc2413b7f0 2024-01-19T05:18:34.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.968+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2413b5c0 con 0x7fcc2413b7f0 2024-01-19T05:18:34.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.968+0000 7fcc20ff9640 1 -- 172.21.15.99:0/3357938651 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcc1c014a90 con 0x7fcc2413b7f0 2024-01-19T05:18:34.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.968+0000 7fcc20ff9640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcc04066500 0x7fcc040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.968+0000 7fcc22ffd640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcc04066500 0x7fcc040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.968+0000 7fcc20ff9640 1 -- 172.21.15.99:0/3357938651 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc1c084690 con 0x7fcc2413b7f0 2024-01-19T05:18:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.968+0000 7fcc22ffd640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcc04066500 0x7fcc040689c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcc140ae000 tx=0x7fcc140a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:34.972+0000 7fcc20ff9640 1 -- 172.21.15.99:0/3357938651 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcc2413b5c0 con 0x7fcc2413b7f0 2024-01-19T05:18:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.116+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc2413b5c0 con 0x7fcc2413b7f0 2024-01-19T05:18:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc20ff9640 1 -- 172.21.15.99:0/3357938651 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc2413b5c0 con 0x7fcc2413b7f0 2024-01-19T05:18:35.119 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:18:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcc04066500 msgr2=0x7fcc040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcc04066500 0x7fcc040689c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcc140ae000 tx=0x7fcc140a7000 comp rx=0 tx=0).stop 2024-01-19T05:18:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2413b7f0 msgr2=0x7fcc24138010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2413b7f0 0x7fcc24138010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c007e90 tx=0x7fcc1c00e4b0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 shutdown_connections 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcc04066500 0x7fcc040689c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc2413b7f0 0x7fcc24138010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcc241441d0 0x7fcc24138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 --2- 172.21.15.99:0/3357938651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc240b2ce0 0x7fcc240ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 >> 172.21.15.99:0/3357938651 conn(0x7fcc240b8080 msgr2=0x7fcc240b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 shutdown_connections 2024-01-19T05:18:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.120+0000 7fcc2981e640 1 -- 172.21.15.99:0/3357938651 wait complete. 2024-01-19T05:18:35.135 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:35.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c5165e640 1 Processor -- start 2024-01-19T05:18:35.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c5165e640 1 -- start start 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c5165e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c0b96f0 0x7f4c4c0b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c5165e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4c4c140e90 0x7f4c4c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c5165e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c0b87f0 con 0x7f4c4c0b7c40 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c5165e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c0b9ad0 con 0x7f4c4c140e90 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c5165e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0b81e0 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4c4c140e90 0x7f4c4c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4c4c140e90 0x7f4c4c1511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33056/0 (socket says 172.21.15.99:33056) 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4b7fe640 1 -- 172.21.15.99:0/4184118368 learned_addr learned my addr 172.21.15.99:0/4184118368 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:35.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4affd640 1 --2- 172.21.15.99:0/4184118368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c0b96f0 0x7f4c4c0b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4b7fe640 1 -- 172.21.15.99:0/4184118368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c0b96f0 msgr2=0x7f4c4c0b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:35.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4b7fe640 1 --2- 172.21.15.99:0/4184118368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c0b96f0 0x7f4c4c0b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4b7fe640 1 -- 172.21.15.99:0/4184118368 >> v1:172.21.15.157:6789/0 conn(0x7f4c4c0b7c40 legacy=0x7f4c4c140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:35.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4b7fe640 1 -- 172.21.15.99:0/4184118368 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c06ba20 con 0x7f4c4c140e90 2024-01-19T05:18:35.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c4b7fe640 1 --2- 172.21.15.99:0/4184118368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c140e90 0x7f4c4c1511c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009e50 tx=0x7f4c4401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31abbdbf3dea680 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c49ffb640 1 -- 172.21.15.99:0/4184118368 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c440a57e0 con 0x7f4c4c140e90 2024-01-19T05:18:35.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c49ffb640 1 -- 172.21.15.99:0/4184118368 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c440a5940 con 0x7f4c4c140e90 2024-01-19T05:18:35.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.252+0000 7f4c49ffb640 1 -- 172.21.15.99:0/4184118368 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c440a5cd0 con 0x7f4c4c140e90 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- 172.21.15.99:0/4184118368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c140e90 msgr2=0x7f4c4c1511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 --2- 172.21.15.99:0/4184118368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c140e90 0x7f4c4c1511c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009e50 tx=0x7f4c4401c9a0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- 172.21.15.99:0/4184118368 shutdown_connections 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 --2- 172.21.15.99:0/4184118368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c140e90 0x7f4c4c1511c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 --2- 172.21.15.99:0/4184118368 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c0b96f0 0x7f4c4c0b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- 172.21.15.99:0/4184118368 >> 172.21.15.99:0/4184118368 conn(0x7f4c4c09e600 msgr2=0x7f4c4c0b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- 172.21.15.99:0/4184118368 shutdown_connections 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- 172.21.15.99:0/4184118368 wait complete. 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 Processor -- start 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- start start 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0b7c40 0x7f4c4c09be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c0b96f0 0x7f4c4c139f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c140e90 0x7f4c4c1333f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c09cb00 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c13ea90 con 0x7f4c4c0b7c40 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c09c440 con 0x7f4c4c140e90 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c0b96f0 0x7f4c4c139f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c0b96f0 0x7f4c4c139f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33058/0 (socket says 172.21.15.99:33058) 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 -- 172.21.15.99:0/2765917369 learned_addr learned my addr 172.21.15.99:0/2765917369 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4affd640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0b7c40 0x7f4c4c09be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4b7fe640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c140e90 0x7f4c4c1333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 -- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c140e90 msgr2=0x7f4c4c1333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c140e90 0x7f4c4c1333f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 -- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0b7c40 msgr2=0x7f4c4c09be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0b7c40 0x7f4c4c09be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 -- 172.21.15.99:0/2765917369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44009b30 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4affd640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0b7c40 0x7f4c4c09be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:35.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c4a7fc640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c0b96f0 0x7f4c4c139f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c450 tx=0x7f4c4000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c337fe640 1 -- 172.21.15.99:0/2765917369 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40012830 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c337fe640 1 -- 172.21.15.99:0/2765917369 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c400129b0 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c09c720 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c337fe640 1 -- 172.21.15.99:0/2765917369 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40012d60 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c09f560 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.256+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c09cc40 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.260+0000 7f4c337fe640 1 -- 172.21.15.99:0/2765917369 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4c4001c460 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.260+0000 7f4c337fe640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4c38066500 0x7f4c380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.260+0000 7f4c337fe640 1 -- 172.21.15.99:0/2765917369 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c40083ca0 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.260+0000 7f4c4affd640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4c38066500 0x7f4c380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.260+0000 7f4c4affd640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4c38066500 0x7f4c380689c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c006fd0 tx=0x7f4c3c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.264+0000 7f4c337fe640 1 -- 172.21.15.99:0/2765917369 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4c4c09cc40 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.385 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:18:35.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:18:35.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c4c09cc40 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c337fe640 1 -- 172.21.15.99:0/2765917369 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3352 (secure 0 0 0) 0x7f4c4c09cc40 con 0x7f4c4c0b96f0 2024-01-19T05:18:35.456 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:35.456 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:02.994909+0000","modified":"2024-01-19T05:18:04.990494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:18:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4c38066500 msgr2=0x7f4c380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4c38066500 0x7f4c380689c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c006fd0 tx=0x7f4c3c008040 comp rx=0 tx=0).stop 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c0b96f0 msgr2=0x7f4c4c139f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c0b96f0 0x7f4c4c139f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c450 tx=0x7f4c4000c910 comp rx=0 tx=0).stop 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 shutdown_connections 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4c38066500 0x7f4c380689c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4c4c140e90 0x7f4c4c1333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c4c0b96f0 0x7f4c4c139f80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 --2- 172.21.15.99:0/2765917369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c0b7c40 0x7f4c4c09be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 >> 172.21.15.99:0/2765917369 conn(0x7f4c4c09e600 msgr2=0x7f4c4c140550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 shutdown_connections 2024-01-19T05:18:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.456+0000 7f4c5165e640 1 -- 172.21.15.99:0/2765917369 wait complete. 2024-01-19T05:18:35.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.636+0000 7f8f0eb49640 1 Processor -- start 2024-01-19T05:18:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0eb49640 1 -- start start 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0eb49640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8f080af7e0 0x7f8f080afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0eb49640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f0814b0c0 0x7f8f08155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0eb49640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080b03d0 con 0x7f8f0814ac60 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0eb49640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080b12e0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0eb49640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080b0eb0 con 0x7f8f080af7e0 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8efffff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8f0814ac60 0x7f8f08071ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33442/0 (socket says 172.21.15.99:33442) 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8efffff640 1 -- 172.21.15.99:0/4039766092 learned_addr learned my addr 172.21.15.99:0/4039766092 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0d0e6640 1 --2- 172.21.15.99:0/4039766092 >> v2:172.21.15.99:3300/0 conn(0x7f8f0814b0c0 0x7f8f08155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0c8e5640 1 --2- 172.21.15.99:0/4039766092 >> v2:172.21.15.157:3300/0 conn(0x7f8f080af7e0 0x7f8f080afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8eff7fe640 1 -- 172.21.15.99:0/4039766092 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324944479 0 0) 0x7f8f080b03d0 con 0x7f8f0814ac60 2024-01-19T05:18:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8eff7fe640 1 -- 172.21.15.99:0/4039766092 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef0003530 con 0x7f8f0814ac60 2024-01-19T05:18:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0d0e6640 1 -- 172.21.15.99:0/4039766092 >> v2:172.21.15.157:3300/0 conn(0x7f8f080af7e0 msgr2=0x7f8f080afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0d0e6640 1 --2- 172.21.15.99:0/4039766092 >> v2:172.21.15.157:3300/0 conn(0x7f8f080af7e0 0x7f8f080afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0d0e6640 1 -- 172.21.15.99:0/4039766092 >> v1:172.21.15.99:6789/0 conn(0x7f8f0814ac60 legacy=0x7f8f08071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.640+0000 7f8f0d0e6640 1 -- 172.21.15.99:0/4039766092 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080b06b0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0d0e6640 1 --2- 172.21.15.99:0/4039766092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08155500 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f0806d600 tx=0x7f8f0001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae61292120248699 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8eff7fe640 1 -- 172.21.15.99:0/4039766092 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a58e0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8eff7fe640 1 -- 172.21.15.99:0/4039766092 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000a5a40 con 0x7f8f0814b0c0 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8eff7fe640 1 -- 172.21.15.99:0/4039766092 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a5db0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 -- 172.21.15.99:0/4039766092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 msgr2=0x7f8f08155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/4039766092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08155500 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f0806d600 tx=0x7f8f0001c910 comp rx=0 tx=0).stop 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 -- 172.21.15.99:0/4039766092 shutdown_connections 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/4039766092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08155500 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/4039766092 >> v2:172.21.15.157:3300/0 conn(0x7f8f080af7e0 0x7f8f080afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 -- 172.21.15.99:0/4039766092 >> 172.21.15.99:0/4039766092 conn(0x7f8f080b8080 msgr2=0x7f8f080b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:35.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 -- 172.21.15.99:0/4039766092 shutdown_connections 2024-01-19T05:18:35.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 -- 172.21.15.99:0/4039766092 wait complete. 2024-01-19T05:18:35.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.644+0000 7f8f0eb49640 1 Processor -- start 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 -- start start 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f080af7e0 0x7f8f08140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f0814ac60 0x7f8f081433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08142fc0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f081459d0 con 0x7f8f080af7e0 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08145cb0 con 0x7f8f0814ac60 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33072/0 (socket says 172.21.15.99:33072) 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 -- 172.21.15.99:0/3207025598 learned_addr learned my addr 172.21.15.99:0/3207025598 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0c8e5640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f080af7e0 0x7f8f08140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 -- 172.21.15.99:0/3207025598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f0814ac60 msgr2=0x7f8f081433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f0814ac60 0x7f8f081433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 -- 172.21.15.99:0/3207025598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f080af7e0 msgr2=0x7f8f08140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f080af7e0 0x7f8f08140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 -- 172.21.15.99:0/3207025598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009a70 con 0x7f8f0814b0c0 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0d0e6640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08143920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8f000b0040 tx=0x7f8f000196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8efd7fa640 1 -- 172.21.15.99:0/3207025598 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a58e0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8efd7fa640 1 -- 172.21.15.99:0/3207025598 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000b9860 con 0x7f8f0814b0c0 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f08144900 con 0x7f8f0814b0c0 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8efd7fa640 1 -- 172.21.15.99:0/3207025598 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000b9c10 con 0x7f8f0814b0c0 2024-01-19T05:18:35.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f08144be0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f08143100 con 0x7f8f0814b0c0 2024-01-19T05:18:35.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8efd7fa640 1 -- 172.21.15.99:0/3207025598 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8f000c4460 con 0x7f8f0814b0c0 2024-01-19T05:18:35.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8efd7fa640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8ef4066530 0x7f8ef40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8efd7fa640 1 -- 172.21.15.99:0/3207025598 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f0011f8e0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.648+0000 7f8f0c8e5640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8ef4066530 0x7f8ef40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.652+0000 7f8f0c8e5640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8ef4066530 0x7f8ef40689f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009790 tx=0x7f8ef8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.652+0000 7f8efd7fa640 1 -- 172.21.15.99:0/3207025598 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8f000eccf0 con 0x7f8f0814b0c0 2024-01-19T05:18:35.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.808+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f08143100 con 0x7f8f0814b0c0 2024-01-19T05:18:35.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.808+0000 7f8efd7fa640 1 -- 172.21.15.99:0/3207025598 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f8f08143100 con 0x7f8f0814b0c0 2024-01-19T05:18:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:35.810 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:35.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8ef4066530 msgr2=0x7f8ef40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8ef4066530 0x7f8ef40689f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009790 tx=0x7f8ef8008040 comp rx=0 tx=0).stop 2024-01-19T05:18:35.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 msgr2=0x7f8f08143920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08143920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8f000b0040 tx=0x7f8f000196b0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 shutdown_connections 2024-01-19T05:18:35.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8ef4066530 0x7f8ef40689f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f0814b0c0 0x7f8f08143920 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f0814ac60 0x7f8f081433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 --2- 172.21.15.99:0/3207025598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f080af7e0 0x7f8f08140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 >> 172.21.15.99:0/3207025598 conn(0x7f8f080b8080 msgr2=0x7f8f08070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:35.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 shutdown_connections 2024-01-19T05:18:35.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.812+0000 7f8f0eb49640 1 -- 172.21.15.99:0/3207025598 wait complete. 2024-01-19T05:18:35.828 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T05:18:35.828 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:35.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.944+0000 7fddf016c640 1 Processor -- start 2024-01-19T05:18:35.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.944+0000 7fddf016c640 1 -- start start 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddf016c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdde806ebe0 0x7fdde8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddf016c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde806f070 con 0x7fdde80b19f0 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddf016c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde8070680 con 0x7fdde8072320 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddf016c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde8070410 con 0x7fdde806ebe0 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddedf08640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdde80b19f0 0x7fdde8144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33456/0 (socket says 172.21.15.99:33456) 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddedf08640 1 -- 172.21.15.99:0/2115480897 learned_addr learned my addr 172.21.15.99:0/2115480897 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532854884 0 0) 0x7fddd8001120 con 0x7fdde80b19f0 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fdded707640 1 --2- 172.21.15.99:0/2115480897 >> v2:172.21.15.157:3300/0 conn(0x7fdde806ebe0 0x7fdde8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd4003530 con 0x7fdde80b19f0 2024-01-19T05:18:35.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569094212 0 0) 0x7fddd4003530 con 0x7fdde80b19f0 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 >> v2:172.21.15.157:3300/0 conn(0x7fdde806ebe0 msgr2=0x7fdde8071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 --2- 172.21.15.99:0/2115480897 >> v2:172.21.15.157:3300/0 conn(0x7fdde806ebe0 0x7fdde8071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 >> v1:172.21.15.157:6789/0 conn(0x7fdde8072320 legacy=0x7fdde814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8144790 con 0x7fdde80b19f0 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fddd8001810 con 0x7fdde80b19f0 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 >> v1:172.21.15.99:6789/0 conn(0x7fdde80b19f0 legacy=0x7fdde8144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddd40039d0 0x7fddd4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40047d0 0x7fddd4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40051e0 0x7fddd400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8070410 con 0x7fddd40051e0 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd400c130 con 0x7fddd40047d0 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd400c2f0 con 0x7fddd40039d0 2024-01-19T05:18:35.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddee709640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40051e0 0x7fddd400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fdded707640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40047d0 0x7fddd4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddedf08640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddd40039d0 0x7fddd4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddee709640 1 -- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddd40039d0 msgr2=0x7fddd4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:35.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddee709640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddd40039d0 0x7fddd4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddee709640 1 -- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40047d0 msgr2=0x7fddd4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:35.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddee709640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40047d0 0x7fddd4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fddee709640 1 -- 172.21.15.99:0/2115480897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4003530 con 0x7fddd40051e0 2024-01-19T05:18:35.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.948+0000 7fdded707640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40047d0 0x7fddd4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 -- 172.21.15.99:0/2115480897 reap_dead start 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40051e0 0x7fddd400b990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdde0001e40 tx=0x7fdde001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e757dbd754e85095 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0003b80 con 0x7fddd40051e0 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0003ce0 con 0x7fddd40051e0 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddecf06640 1 -- 172.21.15.99:0/2115480897 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0005260 con 0x7fddd40051e0 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- 172.21.15.99:0/2115480897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40051e0 msgr2=0x7fddd400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40051e0 0x7fddd400b990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdde0001e40 tx=0x7fdde001c740 comp rx=0 tx=0).stop 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- 172.21.15.99:0/2115480897 shutdown_connections 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 --2- 172.21.15.99:0/2115480897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40051e0 0x7fddd400b990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- 172.21.15.99:0/2115480897 >> 172.21.15.99:0/2115480897 conn(0x7fdde80b8080 msgr2=0x7fdde80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- 172.21.15.99:0/2115480897 shutdown_connections 2024-01-19T05:18:35.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- 172.21.15.99:0/2115480897 wait complete. 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 Processor -- start 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- start start 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40051e0 0x7fdde80ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdde81cbd70 0x7fdde81cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde81cb230 0x7fdde81cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde81d0b00 con 0x7fdde81cb230 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde81ca8b0 con 0x7fddd40051e0 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde81cab00 con 0x7fdde81cbd70 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde81cb230 0x7fdde81cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde81cb230 0x7fdde81cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33096/0 (socket says 172.21.15.99:33096) 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 -- 172.21.15.99:0/1091580834 learned_addr learned my addr 172.21.15.99:0/1091580834 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fdded707640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdde81cbd70 0x7fdde81cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddedf08640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40051e0 0x7fdde80ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 -- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdde81cbd70 msgr2=0x7fdde81cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdde81cbd70 0x7fdde81cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 -- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40051e0 msgr2=0x7fdde80ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40051e0 0x7fdde80ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 -- 172.21.15.99:0/1091580834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80ad060 con 0x7fdde81cb230 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddedf08640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40051e0 0x7fdde80ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddee709640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde81cb230 0x7fdde81cb6b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdde001cfe0 tx=0x7fddd4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddde7fc640 1 -- 172.21.15.99:0/1091580834 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0005430 con 0x7fdde81cb230 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddde7fc640 1 -- 172.21.15.99:0/1091580834 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde00055b0 con 0x7fdde81cb230 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde81cc810 con 0x7fdde81cb230 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddde7fc640 1 -- 172.21.15.99:0/1091580834 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde00a6440 con 0x7fdde81cb230 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.952+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde81d9eb0 con 0x7fdde81cb230 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.956+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde81caf50 con 0x7fdde81cb230 2024-01-19T05:18:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.956+0000 7fddde7fc640 1 -- 172.21.15.99:0/1091580834 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdde00a65a0 con 0x7fdde81cb230 2024-01-19T05:18:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.956+0000 7fddde7fc640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066530 0x7fddcc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.956+0000 7fddde7fc640 1 -- 172.21.15.99:0/1091580834 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdde011cbd0 con 0x7fdde81cb230 2024-01-19T05:18:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.956+0000 7fddedf08640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066530 0x7fddcc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.956+0000 7fddedf08640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066530 0x7fddcc0689f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fddd8001280 tx=0x7fddd8001330 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:35.960+0000 7fddde7fc640 1 -- 172.21.15.99:0/1091580834 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdde81caf50 con 0x7fdde81cb230 2024-01-19T05:18:36.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.144+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdde81caf50 con 0x7fdde81cb230 2024-01-19T05:18:36.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddde7fc640 1 -- 172.21.15.99:0/1091580834 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3352 (secure 0 0 0) 0x7fdde81caf50 con 0x7fdde81cb230 2024-01-19T05:18:36.147 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:36.147 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:02.994909+0000","modified":"2024-01-19T05:18:04.990494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:18:36.148 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-19T05:18:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066530 msgr2=0x7fddcc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066530 0x7fddcc0689f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fddd8001280 tx=0x7fddd8001330 comp rx=0 tx=0).stop 2024-01-19T05:18:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde81cb230 msgr2=0x7fdde81cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde81cb230 0x7fdde81cb6b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdde001cfe0 tx=0x7fddd4005800 comp rx=0 tx=0).stop 2024-01-19T05:18:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 shutdown_connections 2024-01-19T05:18:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fddcc066530 0x7fddcc0689f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdde81cb230 0x7fdde81cb6b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdde81cbd70 0x7fdde81cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 --2- 172.21.15.99:0/1091580834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddd40051e0 0x7fdde80ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 >> 172.21.15.99:0/1091580834 conn(0x7fdde80b8080 msgr2=0x7fdde80b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 shutdown_connections 2024-01-19T05:18:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.148+0000 7fddf016c640 1 -- 172.21.15.99:0/1091580834 wait complete. 2024-01-19T05:18:36.164 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.280+0000 7fd29ccd1640 1 Processor -- start 2024-01-19T05:18:36.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.280+0000 7fd29ccd1640 1 -- start start 2024-01-19T05:18:36.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29ccd1640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd29806a940 0x7fd29809e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29ccd1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd29809d590 0x7fd29809d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29ccd1640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2980b4c10 con 0x7fd29813e2f0 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29ccd1640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2980b4900 con 0x7fd29806a940 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29ccd1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29809cbe0 con 0x7fd29809d590 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd29806a940 0x7fd29809e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd296d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd29813e2f0 0x7fd29813e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33458/0 (socket says 172.21.15.99:33458) 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd296d9d640 1 -- 172.21.15.99:0/277512202 learned_addr learned my addr 172.21.15.99:0/277512202 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd295d9b640 1 --2- 172.21.15.99:0/277512202 >> v2:172.21.15.157:3300/0 conn(0x7fd29809d590 0x7fd29809d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29659c640 1 -- 172.21.15.99:0/277512202 >> v2:172.21.15.157:3300/0 conn(0x7fd29809d590 msgr2=0x7fd29809d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29659c640 1 --2- 172.21.15.99:0/277512202 >> v2:172.21.15.157:3300/0 conn(0x7fd29809d590 0x7fd29809d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29659c640 1 -- 172.21.15.99:0/277512202 >> v1:172.21.15.99:6789/0 conn(0x7fd29813e2f0 legacy=0x7fd29813e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29559a640 1 -- 172.21.15.99:0/277512202 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430575031 0 0) 0x7fd2980b4c10 con 0x7fd29813e2f0 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29659c640 1 -- 172.21.15.99:0/277512202 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29813ee10 con 0x7fd29806a940 2024-01-19T05:18:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd295d9b640 1 --2- 172.21.15.99:0/277512202 >> v2:172.21.15.157:3300/0 conn(0x7fd29809d590 0x7fd29809d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:36.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29659c640 1 --2- 172.21.15.99:0/277512202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd29809e190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd29806db60 tx=0x7fd28001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299421d352216df0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29559a640 1 -- 172.21.15.99:0/277512202 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800ab600 con 0x7fd29806a940 2024-01-19T05:18:36.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29559a640 1 -- 172.21.15.99:0/277512202 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2800a7050 con 0x7fd29806a940 2024-01-19T05:18:36.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29559a640 1 -- 172.21.15.99:0/277512202 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800ab980 con 0x7fd29806a940 2024-01-19T05:18:36.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29ccd1640 1 -- 172.21.15.99:0/277512202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 msgr2=0x7fd29809e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.284+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/277512202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd29809e190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd29806db60 tx=0x7fd28001c340 comp rx=0 tx=0).stop 2024-01-19T05:18:36.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- 172.21.15.99:0/277512202 shutdown_connections 2024-01-19T05:18:36.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/277512202 >> v2:172.21.15.157:3300/0 conn(0x7fd29809d590 0x7fd29809d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/277512202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd29809e190 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- 172.21.15.99:0/277512202 >> 172.21.15.99:0/277512202 conn(0x7fd298066ef0 msgr2=0x7fd2980b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:36.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- 172.21.15.99:0/277512202 shutdown_connections 2024-01-19T05:18:36.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- 172.21.15.99:0/277512202 wait complete. 2024-01-19T05:18:36.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 Processor -- start 2024-01-19T05:18:36.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- start start 2024-01-19T05:18:36.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd298136330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd29809d590 0x7fd298136870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd29813e2f0 0x7fd29809a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29809a020 con 0x7fd29806a940 2024-01-19T05:18:36.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980999f0 con 0x7fd29813e2f0 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd298137730 con 0x7fd29809d590 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd298136330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd298136330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33110/0 (socket says 172.21.15.99:33110) 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 -- 172.21.15.99:0/814545545 learned_addr learned my addr 172.21.15.99:0/814545545 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 -- 172.21.15.99:0/814545545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd29809d590 msgr2=0x7fd298136870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd295d9b640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd29809d590 0x7fd298136870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd296d9d640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd29813e2f0 0x7fd29809a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd29809d590 0x7fd298136870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 -- 172.21.15.99:0/814545545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd29813e2f0 msgr2=0x7fd29809a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd29813e2f0 0x7fd29809a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 -- 172.21.15.99:0/814545545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd280009420 con 0x7fd29806a940 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29659c640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd298136330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd280018f50 tx=0x7fd28001ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd28effd640 1 -- 172.21.15.99:0/814545545 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800b37d0 con 0x7fd29806a940 2024-01-19T05:18:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd28effd640 1 -- 172.21.15.99:0/814545545 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2800b3950 con 0x7fd29806a940 2024-01-19T05:18:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd28effd640 1 -- 172.21.15.99:0/814545545 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800b3d00 con 0x7fd29806a940 2024-01-19T05:18:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd298099c40 con 0x7fd29806a940 2024-01-19T05:18:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2981355f0 con 0x7fd29806a940 2024-01-19T05:18:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.288+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd298136db0 con 0x7fd29806a940 2024-01-19T05:18:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.292+0000 7fd28effd640 1 -- 172.21.15.99:0/814545545 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd2800b2070 con 0x7fd29806a940 2024-01-19T05:18:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.292+0000 7fd28effd640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd278066500 0x7fd2780689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.292+0000 7fd28effd640 1 -- 172.21.15.99:0/814545545 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd28011e1f0 con 0x7fd29806a940 2024-01-19T05:18:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.292+0000 7fd295d9b640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd278066500 0x7fd2780689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.292+0000 7fd295d9b640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd278066500 0x7fd2780689c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd288006fd0 tx=0x7fd288008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.296+0000 7fd28effd640 1 -- 172.21.15.99:0/814545545 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd2800eb520 con 0x7fd29806a940 2024-01-19T05:18:36.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.484+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2980696e0 con 0x7fd29806a940 2024-01-19T05:18:36.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.484+0000 7fd28effd640 1 -- 172.21.15.99:0/814545545 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3352 (secure 0 0 0) 0x7fd2800b0d30 con 0x7fd29806a940 2024-01-19T05:18:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:36.486 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2365172536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2365172536},{"type":"v1","addr":"172.21.15.99:6835","nonce":2365172536}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:02.994909+0000","modified":"2024-01-19T05:18:04.990494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6833/355732632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":355732632},{"type":"v1","addr":"172.21.15.157:6833","nonce":355732632}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-19T05:18:36.486 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-19T05:18:36.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd278066500 msgr2=0x7fd2780689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd278066500 0x7fd2780689c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd288006fd0 tx=0x7fd288008040 comp rx=0 tx=0).stop 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 msgr2=0x7fd298136330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd298136330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd280018f50 tx=0x7fd28001ab80 comp rx=0 tx=0).stop 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 shutdown_connections 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd278066500 0x7fd2780689c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd29813e2f0 0x7fd29809a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd29809d590 0x7fd298136870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 --2- 172.21.15.99:0/814545545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd29806a940 0x7fd298136330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 >> 172.21.15.99:0/814545545 conn(0x7fd298066ef0 msgr2=0x7fd29806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 shutdown_connections 2024-01-19T05:18:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.488+0000 7fd29ccd1640 1 -- 172.21.15.99:0/814545545 wait complete. 2024-01-19T05:18:36.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.620+0000 7f2eb687e640 1 Processor -- start 2024-01-19T05:18:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.620+0000 7f2eb687e640 1 -- start start 2024-01-19T05:18:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2eb00b19f0 0x7f2eb006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 0x7f2eb0145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb0070680 con 0x7f2eb0144c70 2024-01-19T05:18:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb0070410 con 0x7f2eb00b19f0 2024-01-19T05:18:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0144790 con 0x7f2eb00724f0 2024-01-19T05:18:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2eb00b19f0 0x7f2eb006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2eb00b19f0 0x7f2eb006ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33114/0 (socket says 172.21.15.99:33114) 2024-01-19T05:18:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaffff640 1 -- 172.21.15.99:0/708112027 learned_addr learned my addr 172.21.15.99:0/708112027 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb4e1b640 1 --2- 172.21.15.99:0/708112027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 0x7f2eb0145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaffff640 1 -- 172.21.15.99:0/708112027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 msgr2=0x7f2eb0145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaffff640 1 --2- 172.21.15.99:0/708112027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 0x7f2eb0145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaffff640 1 -- 172.21.15.99:0/708112027 >> v1:172.21.15.157:6789/0 conn(0x7f2eb0144c70 legacy=0x7f2eb0071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaffff640 1 -- 172.21.15.99:0/708112027 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb006f2b0 con 0x7f2eb00b19f0 2024-01-19T05:18:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaffff640 1 --2- 172.21.15.99:0/708112027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb006ebe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009870 tx=0x7f2e9801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443f0947fbf9d36a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaeffd640 1 -- 172.21.15.99:0/708112027 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980ab610 con 0x7f2eb00b19f0 2024-01-19T05:18:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaeffd640 1 -- 172.21.15.99:0/708112027 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e980ab770 con 0x7f2eb00b19f0 2024-01-19T05:18:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eaeffd640 1 -- 172.21.15.99:0/708112027 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980abb00 con 0x7f2eb00b19f0 2024-01-19T05:18:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 -- 172.21.15.99:0/708112027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 msgr2=0x7f2eb006ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 --2- 172.21.15.99:0/708112027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb006ebe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009870 tx=0x7f2e9801c470 comp rx=0 tx=0).stop 2024-01-19T05:18:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 -- 172.21.15.99:0/708112027 shutdown_connections 2024-01-19T05:18:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 --2- 172.21.15.99:0/708112027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 0x7f2eb0145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 --2- 172.21.15.99:0/708112027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb006ebe0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 -- 172.21.15.99:0/708112027 >> 172.21.15.99:0/708112027 conn(0x7f2eb00b8080 msgr2=0x7f2eb00b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 -- 172.21.15.99:0/708112027 shutdown_connections 2024-01-19T05:18:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.624+0000 7f2eb687e640 1 -- 172.21.15.99:0/708112027 wait complete. 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 Processor -- start 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 -- start start 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 0x7f2eb013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb013de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2eb0144c70 0x7f2eb01dd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb013d530 con 0x7f2eb00b19f0 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb013e340 con 0x7f2eb0144c70 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb01414b0 con 0x7f2eb00724f0 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb013de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb013de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33118/0 (socket says 172.21.15.99:33118) 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 -- 172.21.15.99:0/1622337672 learned_addr learned my addr 172.21.15.99:0/1622337672 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaffff640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 0x7f2eb013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb4e1b640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2eb0144c70 0x7f2eb01dd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 -- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 msgr2=0x7f2eb013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 0x7f2eb013cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 -- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2eb0144c70 msgr2=0x7f2eb01dd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2eb0144c70 0x7f2eb01dd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 -- 172.21.15.99:0/1622337672 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980094d0 con 0x7f2eb00b19f0 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb4e1b640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2eb0144c70 0x7f2eb01dd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eaf7fe640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb013de00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c7a0 tx=0x7f2ea000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eacff9640 1 -- 172.21.15.99:0/1622337672 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0003d90 con 0x7f2eb00b19f0 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eacff9640 1 -- 172.21.15.99:0/1622337672 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0005070 con 0x7f2eb00b19f0 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb013d720 con 0x7f2eb00b19f0 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eacff9640 1 -- 172.21.15.99:0/1622337672 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0005420 con 0x7f2eb00b19f0 2024-01-19T05:18:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb013c900 con 0x7f2eb00b19f0 2024-01-19T05:18:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb01dca10 con 0x7f2eb00b19f0 2024-01-19T05:18:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.628+0000 7f2eacff9640 1 -- 172.21.15.99:0/1622337672 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2ea0005580 con 0x7f2eb00b19f0 2024-01-19T05:18:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.632+0000 7f2eacff9640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e90066530 0x7f2e900689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.632+0000 7f2eacff9640 1 -- 172.21.15.99:0/1622337672 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea0083670 con 0x7f2eb00b19f0 2024-01-19T05:18:36.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.632+0000 7f2eaffff640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e90066530 0x7f2e900689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.632+0000 7f2eaffff640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e90066530 0x7f2e900689f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e980af000 tx=0x7f2e980b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.636+0000 7f2eacff9640 1 -- 172.21.15.99:0/1622337672 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2eb01dca10 con 0x7f2eb00b19f0 2024-01-19T05:18:36.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.780+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2eb01dca10 con 0x7f2eb00b19f0 2024-01-19T05:18:36.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eacff9640 1 -- 172.21.15.99:0/1622337672 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f2eb01dca10 con 0x7f2eb00b19f0 2024-01-19T05:18:36.783 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:36.783 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:04.506577+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:01.306914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:01.982437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:36.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e90066530 msgr2=0x7f2e900689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e90066530 0x7f2e900689f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e980af000 tx=0x7f2e980b6040 comp rx=0 tx=0).stop 2024-01-19T05:18:36.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 msgr2=0x7f2eb013de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb013de00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c7a0 tx=0x7f2ea000cc60 comp rx=0 tx=0).stop 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 shutdown_connections 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e90066530 0x7f2e900689f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2eb0144c70 0x7f2eb01dd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eb00b19f0 0x7f2eb013de00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 --2- 172.21.15.99:0/1622337672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2eb00724f0 0x7f2eb013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 >> 172.21.15.99:0/1622337672 conn(0x7f2eb00b8080 msgr2=0x7f2eb00b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 shutdown_connections 2024-01-19T05:18:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.784+0000 7f2eb687e640 1 -- 172.21.15.99:0/1622337672 wait complete. 2024-01-19T05:18:36.801 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-19T05:18:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d5b446640 1 Processor -- start 2024-01-19T05:18:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d5b446640 1 -- start start 2024-01-19T05:18:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d5b446640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0d540b2ce0 0x7f0d54071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d5b446640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5406f620 con 0x7f0d540b1870 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d5b446640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d54143610 con 0x7f0d541441d0 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d5b446640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d54141000 con 0x7f0d540b2ce0 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d589e1640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0d540b1870 0x7f0d54143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33464/0 (socket says 172.21.15.99:33464) 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d589e1640 1 -- 172.21.15.99:0/1340893786 learned_addr learned my addr 172.21.15.99:0/1340893786 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d591e2640 1 --2- 172.21.15.99:0/1340893786 >> v2:172.21.15.157:3300/0 conn(0x7f0d540b2ce0 0x7f0d54071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443695687 0 0) 0x7f0d5406f620 con 0x7f0d540b1870 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d40003530 con 0x7f0d540b1870 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2559909678 0 0) 0x7f0d40003530 con 0x7f0d540b1870 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 >> v2:172.21.15.157:3300/0 conn(0x7f0d540b2ce0 msgr2=0x7f0d54071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 --2- 172.21.15.99:0/1340893786 >> v2:172.21.15.157:3300/0 conn(0x7f0d540b2ce0 0x7f0d54071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 >> v1:172.21.15.157:6789/0 conn(0x7f0d541441d0 legacy=0x7f0d5414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d540b30c0 con 0x7f0d540b1870 2024-01-19T05:18:36.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f0d440016a0 con 0x7f0d540b1870 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 >> v1:172.21.15.99:6789/0 conn(0x7f0d540b1870 legacy=0x7f0d54143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d400039d0 0x7f0d40003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d400047d0 0x7f0d40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54141000 con 0x7f0d40005190 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4000c090 con 0x7f0d400047d0 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4000c250 con 0x7f0d400039d0 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d599e3640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d589e1640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d400047d0 0x7f0d40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d591e2640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d400039d0 0x7f0d40003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d599e3640 1 -- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d400039d0 msgr2=0x7f0d40003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d599e3640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d400039d0 0x7f0d40003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d599e3640 1 -- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d400047d0 msgr2=0x7f0d40004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d599e3640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d400047d0 0x7f0d40004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d599e3640 1 -- 172.21.15.99:0/1340893786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40003530 con 0x7f0d40005190 2024-01-19T05:18:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.924+0000 7f0d591e2640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d400039d0 0x7f0d40003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d599e3640 1 -- 172.21.15.99:0/1340893786 reap_dead start 2024-01-19T05:18:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d599e3640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d4000b990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c001e70 tx=0x7f0d4c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25c676597a23c1b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c003b80 con 0x7f0d40005190 2024-01-19T05:18:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c003d00 con 0x7f0d40005190 2024-01-19T05:18:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d4bfff640 1 -- 172.21.15.99:0/1340893786 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c005260 con 0x7f0d40005190 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- 172.21.15.99:0/1340893786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 msgr2=0x7f0d4000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d4000b990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c001e70 tx=0x7f0d4c01c760 comp rx=0 tx=0).stop 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- 172.21.15.99:0/1340893786 shutdown_connections 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 --2- 172.21.15.99:0/1340893786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d4000b990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- 172.21.15.99:0/1340893786 >> 172.21.15.99:0/1340893786 conn(0x7f0d540b8080 msgr2=0x7f0d540b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- 172.21.15.99:0/1340893786 shutdown_connections 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- 172.21.15.99:0/1340893786 wait complete. 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 Processor -- start 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- start start 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d5413de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d5413e380 0x7f0d541dcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d541dd030 0x7f0d54070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540a8f20 con 0x7f0d40005190 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d541dc6d0 con 0x7f0d541dd030 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d5b446640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d541dc3c0 con 0x7f0d5413e380 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d591e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d5413de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d591e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d5413de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33134/0 (socket says 172.21.15.99:33134) 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d591e2640 1 -- 172.21.15.99:0/857705045 learned_addr learned my addr 172.21.15.99:0/857705045 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d589e1640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d5413e380 0x7f0d541dcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d599e3640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d541dd030 0x7f0d54070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d591e2640 1 -- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d5413e380 msgr2=0x7f0d541dcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d591e2640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d5413e380 0x7f0d541dcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d591e2640 1 -- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d541dd030 msgr2=0x7f0d54070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d591e2640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d541dd030 0x7f0d54070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d591e2640 1 -- 172.21.15.99:0/857705045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5406f490 con 0x7f0d40005190 2024-01-19T05:18:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d589e1640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d5413e380 0x7f0d541dcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.928+0000 7f0d599e3640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d541dd030 0x7f0d54070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d591e2640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d5413de40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0d500108d0 tx=0x7f0d50010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d49ffb640 1 -- 172.21.15.99:0/857705045 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000eb60 con 0x7f0d40005190 2024-01-19T05:18:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d49ffb640 1 -- 172.21.15.99:0/857705045 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5000ecc0 con 0x7f0d40005190 2024-01-19T05:18:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5406fa00 con 0x7f0d40005190 2024-01-19T05:18:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d49ffb640 1 -- 172.21.15.99:0/857705045 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5001c400 con 0x7f0d40005190 2024-01-19T05:18:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d541ccd30 con 0x7f0d40005190 2024-01-19T05:18:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d541dc940 con 0x7f0d40005190 2024-01-19T05:18:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d49ffb640 1 -- 172.21.15.99:0/857705045 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0d5001c560 con 0x7f0d40005190 2024-01-19T05:18:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d49ffb640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d38066500 0x7f0d380689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d49ffb640 1 -- 172.21.15.99:0/857705045 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d500844e0 con 0x7f0d40005190 2024-01-19T05:18:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d589e1640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d38066500 0x7f0d380689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.932+0000 7f0d589e1640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d38066500 0x7f0d380689c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d440017d0 tx=0x7f0d44000ee0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:36.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:36.936+0000 7f0d49ffb640 1 -- 172.21.15.99:0/857705045 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0d50051810 con 0x7f0d40005190 2024-01-19T05:18:37.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.116+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0d540696e0 con 0x7f0d40005190 2024-01-19T05:18:37.117 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-01-19T05:18:37.116+0000 7efe6f296640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T05:18:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.120+0000 7f0d49ffb640 1 -- 172.21.15.99:0/857705045 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0d50054e30 con 0x7f0d40005190 2024-01-19T05:18:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T05:18:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d38066500 msgr2=0x7f0d380689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d38066500 0x7f0d380689c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d440017d0 tx=0x7f0d44000ee0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 msgr2=0x7f0d5413de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d5413de40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0d500108d0 tx=0x7f0d50010d90 comp rx=0 tx=0).stop 2024-01-19T05:18:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 shutdown_connections 2024-01-19T05:18:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0d38066500 0x7f0d380689c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d541dd030 0x7f0d54070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d5413e380 0x7f0d541dcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 --2- 172.21.15.99:0/857705045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d40005190 0x7f0d5413de40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 >> 172.21.15.99:0/857705045 conn(0x7f0d540b8080 msgr2=0x7f0d541425b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 shutdown_connections 2024-01-19T05:18:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.124+0000 7f0d5b446640 1 -- 172.21.15.99:0/857705045 wait complete. 2024-01-19T05:18:37.131 INFO:tasks.ceph.mds.b.smithi157.stderr: -1078> 2024-01-19T05:18:08.891+0000 7f406c835640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T05:18:37.139 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-19T05:18:37.176 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-01-19T05:18:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e31be6640 1 Processor -- start 2024-01-19T05:18:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e31be6640 1 -- start start 2024-01-19T05:18:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e31be6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2e2c0b19f0 0x7f2e2c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e31be6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 0x7f2e2c145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e31be6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c070680 con 0x7f2e2c144c70 2024-01-19T05:18:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e31be6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c070410 con 0x7f2e2c0b19f0 2024-01-19T05:18:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e31be6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c144790 con 0x7f2e2c0724f0 2024-01-19T05:18:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2b7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2e2c0b19f0 0x7f2e2c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2affd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f2e2c144c70 0x7f2e2c071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:37020/0 (socket says 172.21.15.99:37020) 2024-01-19T05:18:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2affd640 1 -- 172.21.15.99:0/469679507 learned_addr learned my addr 172.21.15.99:0/469679507 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2bfff640 1 --2- 172.21.15.99:0/469679507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 0x7f2e2c145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2a7fc640 1 -- 172.21.15.99:0/469679507 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395807480 0 0) 0x7f2e2c070680 con 0x7f2e2c144c70 2024-01-19T05:18:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2a7fc640 1 -- 172.21.15.99:0/469679507 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e18003530 con 0x7f2e2c144c70 2024-01-19T05:18:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2b7fe640 1 -- 172.21.15.99:0/469679507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 msgr2=0x7f2e2c145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2b7fe640 1 --2- 172.21.15.99:0/469679507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 0x7f2e2c145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2b7fe640 1 -- 172.21.15.99:0/469679507 >> v1:172.21.15.157:6789/0 conn(0x7f2e2c144c70 legacy=0x7f2e2c071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.248+0000 7f2e2b7fe640 1 -- 172.21.15.99:0/469679507 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c06f2b0 con 0x7f2e2c0b19f0 2024-01-19T05:18:37.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e2b7fe640 1 --2- 172.21.15.99:0/469679507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 0x7f2e2c06ebe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e240097c0 tx=0x7f2e2401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8379e45b6145c63 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:37.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e2a7fc640 1 -- 172.21.15.99:0/469679507 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240ac630 con 0x7f2e2c0b19f0 2024-01-19T05:18:37.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e2a7fc640 1 -- 172.21.15.99:0/469679507 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e240ac790 con 0x7f2e2c0b19f0 2024-01-19T05:18:37.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e2a7fc640 1 -- 172.21.15.99:0/469679507 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240acb00 con 0x7f2e2c0b19f0 2024-01-19T05:18:37.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e31be6640 1 -- 172.21.15.99:0/469679507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 msgr2=0x7f2e2c06ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:37.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e31be6640 1 --2- 172.21.15.99:0/469679507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 0x7f2e2c06ebe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e240097c0 tx=0x7f2e2401c3f0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e31be6640 1 -- 172.21.15.99:0/469679507 shutdown_connections 2024-01-19T05:18:37.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e31be6640 1 --2- 172.21.15.99:0/469679507 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 0x7f2e2c145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e31be6640 1 --2- 172.21.15.99:0/469679507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 0x7f2e2c06ebe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e31be6640 1 -- 172.21.15.99:0/469679507 >> 172.21.15.99:0/469679507 conn(0x7f2e2c0b8080 msgr2=0x7f2e2c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:37.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e31be6640 1 -- 172.21.15.99:0/469679507 shutdown_connections 2024-01-19T05:18:37.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.252+0000 7f2e31be6640 1 -- 172.21.15.99:0/469679507 wait complete. 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 Processor -- start 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 -- start start 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 0x7f2e2c1414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 0x7f2e2c1e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e2c144c70 0x7f2e2c1e0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c13c450 con 0x7f2e2c144c70 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c141a00 con 0x7f2e2c0b19f0 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c140aa0 con 0x7f2e2c0724f0 2024-01-19T05:18:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e2c144c70 0x7f2e2c1e0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e2c144c70 0x7f2e2c1e0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33148/0 (socket says 172.21.15.99:33148) 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 -- 172.21.15.99:0/890543153 learned_addr learned my addr 172.21.15.99:0/890543153 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2b7fe640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 0x7f2e2c1414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2affd640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 0x7f2e2c1e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 -- 172.21.15.99:0/890543153 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 msgr2=0x7f2e2c1414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 0x7f2e2c1414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 -- 172.21.15.99:0/890543153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 msgr2=0x7f2e2c1e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 0x7f2e2c1e02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 -- 172.21.15.99:0/890543153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009420 con 0x7f2e2c144c70 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2bfff640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e2c144c70 0x7f2e2c1e0830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00e820 tx=0x7f2e1c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e23fff640 1 -- 172.21.15.99:0/890543153 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c009530 con 0x7f2e2c144c70 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e23fff640 1 -- 172.21.15.99:0/890543153 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00eed0 con 0x7f2e2c144c70 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c140f30 con 0x7f2e2c144c70 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e23fff640 1 -- 172.21.15.99:0/890543153 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00cb60 con 0x7f2e2c144c70 2024-01-19T05:18:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c13f0d0 con 0x7f2e2c144c70 2024-01-19T05:18:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c0696e0 con 0x7f2e2c144c70 2024-01-19T05:18:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e23fff640 1 -- 172.21.15.99:0/890543153 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2e1c00ccc0 con 0x7f2e2c144c70 2024-01-19T05:18:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e23fff640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e0c066500 0x7f2e0c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e23fff640 1 -- 172.21.15.99:0/890543153 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2e1c084230 con 0x7f2e2c144c70 2024-01-19T05:18:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.256+0000 7f2e2b7fe640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e0c066500 0x7f2e0c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.260+0000 7f2e2b7fe640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e0c066500 0x7f2e0c0689c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e240ae000 tx=0x7f2e240a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.260+0000 7f2e23fff640 1 -- 172.21.15.99:0/890543153 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2e1c051500 con 0x7f2e2c144c70 2024-01-19T05:18:37.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:37.440+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2e2c0b5f20 con 0x7f2e2c144c70 2024-01-19T05:18:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.128+0000 7f2e23fff640 1 -- 172.21.15.99:0/890543153 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e1c054b20 con 0x7f2e2c144c70 2024-01-19T05:18:38.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.128+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e0c066500 msgr2=0x7f2e0c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:38.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.128+0000 7f2e31be6640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e0c066500 0x7f2e0c0689c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e240ae000 tx=0x7f2e240a7000 comp rx=0 tx=0).stop 2024-01-19T05:18:38.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.128+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e2c144c70 msgr2=0x7f2e2c1e0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.128+0000 7f2e31be6640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e2c144c70 0x7f2e2c1e0830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00e820 tx=0x7f2e1c00ece0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.132+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 shutdown_connections 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.132+0000 7f2e31be6640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2e0c066500 0x7f2e0c0689c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.132+0000 7f2e31be6640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e2c144c70 0x7f2e2c1e0830 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.132+0000 7f2e31be6640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e2c0b19f0 0x7f2e2c1e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.132+0000 7f2e31be6640 1 --2- 172.21.15.99:0/890543153 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e2c0724f0 0x7f2e2c1414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.132+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 >> 172.21.15.99:0/890543153 conn(0x7f2e2c0b8080 msgr2=0x7f2e2c0b6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.132+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 shutdown_connections 2024-01-19T05:18:38.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.132+0000 7f2e31be6640 1 -- 172.21.15.99:0/890543153 wait complete. 2024-01-19T05:18:38.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-19T05:18:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39dcb7c640 1 Processor -- start 2024-01-19T05:18:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39dcb7c640 1 -- start start 2024-01-19T05:18:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39dcb7c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f39d8140be0 0x7f39d81528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39dcb7c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d80b87f0 con 0x7f39d80b96f0 2024-01-19T05:18:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39dcb7c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d80b9ad0 con 0x7f39d8140780 2024-01-19T05:18:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39dcb7c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d80b81e0 con 0x7f39d8140be0 2024-01-19T05:18:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39d659c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f39d80b96f0 0x7f39d80b7700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33474/0 (socket says 172.21.15.99:33474) 2024-01-19T05:18:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39d6d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f39d8140be0 0x7f39d81528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39d659c640 1 -- 172.21.15.99:0/3246670734 learned_addr learned my addr 172.21.15.99:0/3246670734 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39d6d9d640 1 -- 172.21.15.99:0/3246670734 >> v1:172.21.15.157:6789/0 conn(0x7f39d8140780 legacy=0x7f39d814f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39d6d9d640 1 -- 172.21.15.99:0/3246670734 >> v1:172.21.15.99:6789/0 conn(0x7f39d80b96f0 legacy=0x7f39d80b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:38.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.280+0000 7f39d6d9d640 1 -- 172.21.15.99:0/3246670734 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d806ba20 con 0x7f39d8140be0 2024-01-19T05:18:38.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 --2- 172.21.15.99:0/3246670734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d81528e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f39d806bc10 tx=0x7f39d001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1af2dbbe10de454 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d559a640 1 -- 172.21.15.99:0/3246670734 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00a59a0 con 0x7f39d8140be0 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d559a640 1 -- 172.21.15.99:0/3246670734 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00a5b00 con 0x7f39d8140be0 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d559a640 1 -- 172.21.15.99:0/3246670734 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00a5e90 con 0x7f39d8140be0 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- 172.21.15.99:0/3246670734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 msgr2=0x7f39d81528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 --2- 172.21.15.99:0/3246670734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d81528e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f39d806bc10 tx=0x7f39d001c8c0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- 172.21.15.99:0/3246670734 shutdown_connections 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 --2- 172.21.15.99:0/3246670734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d81528e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- 172.21.15.99:0/3246670734 >> 172.21.15.99:0/3246670734 conn(0x7f39d809e600 msgr2=0x7f39d80b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- 172.21.15.99:0/3246670734 shutdown_connections 2024-01-19T05:18:38.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- 172.21.15.99:0/3246670734 wait complete. 2024-01-19T05:18:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 Processor -- start 2024-01-19T05:18:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- start start 2024-01-19T05:18:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d80b96f0 0x7f39d80a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d8140780 0x7f39d8141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d8144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d8138e80 con 0x7f39d8140be0 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d8144790 con 0x7f39d8140780 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80b6bd0 con 0x7f39d80b96f0 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d8144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d8144c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33166/0 (socket says 172.21.15.99:33166) 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 -- 172.21.15.99:0/1484287411 learned_addr learned my addr 172.21.15.99:0/1484287411 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d659c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d80b96f0 0x7f39d80a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d5d9b640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d8140780 0x7f39d8141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 -- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d80b96f0 msgr2=0x7f39d80a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d80b96f0 0x7f39d80a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 -- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d8140780 msgr2=0x7f39d8141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d8140780 0x7f39d8141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 -- 172.21.15.99:0/1484287411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0009a70 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d5d9b640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d8140780 0x7f39d8141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39d6d9d640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d8144c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f39d00b0040 tx=0x7f39d0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39c6ffd640 1 -- 172.21.15.99:0/1484287411 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00ade20 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39c6ffd640 1 -- 172.21.15.99:0/1484287411 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00b9450 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d81476f0 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39c6ffd640 1 -- 172.21.15.99:0/1484287411 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00b9800 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.284+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d81426f0 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.288+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d8147550 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.288+0000 7f39c6ffd640 1 -- 172.21.15.99:0/1484287411 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f39d00b9960 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.288+0000 7f39c6ffd640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f39b8066500 0x7f39b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.288+0000 7f39c6ffd640 1 -- 172.21.15.99:0/1484287411 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f39d011f7a0 con 0x7f39d8140be0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.288+0000 7f39d659c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f39b8066500 0x7f39b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.288+0000 7f39d659c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f39b8066500 0x7f39b80689c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39c8000f70 tx=0x7f39c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.292+0000 7f39c6ffd640 1 -- 172.21.15.99:0/1484287411 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f39d8147550 con 0x7f39d8140be0 2024-01-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:38.440+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f39d8147550 con 0x7f39d8140be0 2024-01-19T05:18:39.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.128+0000 7f39c6ffd640 1 -- 172.21.15.99:0/1484287411 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f39d8147550 con 0x7f39d8140be0 2024-01-19T05:18:39.130 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-01-19T05:18:39.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f39b8066500 msgr2=0x7f39b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:39.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f39b8066500 0x7f39b80689c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39c8000f70 tx=0x7f39c8009040 comp rx=0 tx=0).stop 2024-01-19T05:18:39.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 msgr2=0x7f39d8144c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:39.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d8144c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f39d00b0040 tx=0x7f39d0019660 comp rx=0 tx=0).stop 2024-01-19T05:18:39.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 shutdown_connections 2024-01-19T05:18:39.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f39b8066500 0x7f39b80689c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39d8140be0 0x7f39d8144c20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39d8140780 0x7f39d8141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 --2- 172.21.15.99:0/1484287411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f39d80b96f0 0x7f39d80a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 >> 172.21.15.99:0/1484287411 conn(0x7f39d809e600 msgr2=0x7f39d80ba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:39.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 shutdown_connections 2024-01-19T05:18:39.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.132+0000 7f39dcb7c640 1 -- 172.21.15.99:0/1484287411 wait complete. 2024-01-19T05:18:39.157 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-19T05:18:39.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc9a0e36640 1 Processor -- start 2024-01-19T05:18:39.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc9a0e36640 1 -- start start 2024-01-19T05:18:39.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc9a0e36640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c0b2ce0 0x7fc99c071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc9a0e36640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc99c1441d0 0x7fc99c072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc9a0e36640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c06f620 con 0x7fc99c0b1870 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc9a0e36640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c141000 con 0x7fc99c1441d0 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc9a0e36640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c143610 con 0x7fc99c0b2ce0 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc999d9b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc99c0b1870 0x7fc99c143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33484/0 (socket says 172.21.15.99:33484) 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc999d9b640 1 -- 172.21.15.99:0/238252462 learned_addr learned my addr 172.21.15.99:0/238252462 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc99ad9d640 1 --2- 172.21.15.99:0/238252462 >> v2:172.21.15.99:3300/0 conn(0x7fc99c1441d0 0x7fc99c072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc99a59c640 1 --2- 172.21.15.99:0/238252462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c0b2ce0 0x7fc99c071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc99959a640 1 -- 172.21.15.99:0/238252462 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120163805 0 0) 0x7fc99c06f620 con 0x7fc99c0b1870 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc99959a640 1 -- 172.21.15.99:0/238252462 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc984005740 con 0x7fc99c0b1870 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc99ad9d640 1 -- 172.21.15.99:0/238252462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c0b2ce0 msgr2=0x7fc99c071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc99ad9d640 1 --2- 172.21.15.99:0/238252462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c0b2ce0 0x7fc99c071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc99ad9d640 1 -- 172.21.15.99:0/238252462 >> v1:172.21.15.99:6789/0 conn(0x7fc99c0b1870 legacy=0x7fc99c143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:39.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.284+0000 7fc99ad9d640 1 -- 172.21.15.99:0/238252462 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0b30c0 con 0x7fc99c1441d0 2024-01-19T05:18:39.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc99ad9d640 1 --2- 172.21.15.99:0/238252462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c072440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc994009d90 tx=0x7fc99401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96a9ccb271040b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:39.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc99959a640 1 -- 172.21.15.99:0/238252462 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940a59e0 con 0x7fc99c1441d0 2024-01-19T05:18:39.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc99959a640 1 -- 172.21.15.99:0/238252462 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9940a5b40 con 0x7fc99c1441d0 2024-01-19T05:18:39.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc99959a640 1 -- 172.21.15.99:0/238252462 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940ad440 con 0x7fc99c1441d0 2024-01-19T05:18:39.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- 172.21.15.99:0/238252462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 msgr2=0x7fc99c072440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:39.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/238252462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c072440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc994009d90 tx=0x7fc99401c920 comp rx=0 tx=0).stop 2024-01-19T05:18:39.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- 172.21.15.99:0/238252462 shutdown_connections 2024-01-19T05:18:39.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/238252462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c072440 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/238252462 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c0b2ce0 0x7fc99c071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- 172.21.15.99:0/238252462 >> 172.21.15.99:0/238252462 conn(0x7fc99c0b8080 msgr2=0x7fc99c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:39.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- 172.21.15.99:0/238252462 shutdown_connections 2024-01-19T05:18:39.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- 172.21.15.99:0/238252462 wait complete. 2024-01-19T05:18:39.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 Processor -- start 2024-01-19T05:18:39.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- start start 2024-01-19T05:18:39.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc99c0b2ce0 0x7fc99c13bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c139560 0x7fc99c1df090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c13ac40 con 0x7fc99c1441d0 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c13af20 con 0x7fc99c0b2ce0 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c13b200 con 0x7fc99c139560 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c139020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33178/0 (socket says 172.21.15.99:33178) 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 -- 172.21.15.99:0/3869892821 learned_addr learned my addr 172.21.15.99:0/3869892821 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 -- 172.21.15.99:0/3869892821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c139560 msgr2=0x7fc99c1df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c139560 0x7fc99c1df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 -- 172.21.15.99:0/3869892821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc99c0b2ce0 msgr2=0x7fc99c13bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:39.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc99c0b2ce0 0x7fc99c13bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:39.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 -- 172.21.15.99:0/3869892821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994009a70 con 0x7fc99c1441d0 2024-01-19T05:18:39.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc999d9b640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c139020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c450 tx=0x7fc99000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:39.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc98affd640 1 -- 172.21.15.99:0/3869892821 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990005cf0 con 0x7fc99c1441d0 2024-01-19T05:18:39.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc98affd640 1 -- 172.21.15.99:0/3869892821 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990005e50 con 0x7fc99c1441d0 2024-01-19T05:18:39.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c144910 con 0x7fc99c1441d0 2024-01-19T05:18:39.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc98affd640 1 -- 172.21.15.99:0/3869892821 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990007290 con 0x7fc99c1441d0 2024-01-19T05:18:39.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.288+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c13ce80 con 0x7fc99c1441d0 2024-01-19T05:18:39.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.292+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c13b3c0 con 0x7fc99c1441d0 2024-01-19T05:18:39.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.292+0000 7fc98affd640 1 -- 172.21.15.99:0/3869892821 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc9900073f0 con 0x7fc99c1441d0 2024-01-19T05:18:39.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.292+0000 7fc98affd640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc97c066500 0x7fc97c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:39.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.292+0000 7fc98affd640 1 -- 172.21.15.99:0/3869892821 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fc9900832e0 con 0x7fc99c1441d0 2024-01-19T05:18:39.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.292+0000 7fc99a59c640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc97c066500 0x7fc97c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:39.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.292+0000 7fc99a59c640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc97c066500 0x7fc97c0689c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098f0 tx=0x7fc98c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:39.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.296+0000 7fc98affd640 1 -- 172.21.15.99:0/3869892821 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc9900506d0 con 0x7fc99c1441d0 2024-01-19T05:18:39.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:39.456+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc99c13ad80 con 0x7fc99c1441d0 2024-01-19T05:18:40.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.136+0000 7fc98affd640 1 -- 172.21.15.99:0/3869892821 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc99c13ad80 con 0x7fc99c1441d0 2024-01-19T05:18:40.137 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc97c066500 msgr2=0x7fc97c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc97c066500 0x7fc97c0689c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098f0 tx=0x7fc98c008040 comp rx=0 tx=0).stop 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 msgr2=0x7fc99c139020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c139020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c450 tx=0x7fc99000c910 comp rx=0 tx=0).stop 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 shutdown_connections 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc97c066500 0x7fc97c0689c0 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098f0 tx=0x7fc98c008040 comp rx=0 tx=0).stop 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc99c139560 0x7fc99c1df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc99c1441d0 0x7fc99c139020 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c450 tx=0x7fc99000c910 comp rx=0 tx=0).stop 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 --2- 172.21.15.99:0/3869892821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc99c0b2ce0 0x7fc99c13bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.140+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 >> 172.21.15.99:0/3869892821 conn(0x7fc99c0b8080 msgr2=0x7fc99c141d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.144+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 shutdown_connections 2024-01-19T05:18:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.144+0000 7fc9a0e36640 1 -- 172.21.15.99:0/3869892821 wait complete. 2024-01-19T05:18:40.169 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-19T05:18:40.169 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-19T05:18:40.169 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-19T05:18:40.169 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:18:40.170 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-19T05:18:40.170 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-19T05:18:40.170 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-19T05:18:40.170 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:18:40.180 INFO:tasks.ceph.mds.a:Stopped 2024-01-19T05:18:40.180 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-19T05:18:40.183 INFO:tasks.ceph.mds.b:Stopped 2024-01-19T05:18:40.183 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-19T05:18:40.224 INFO:tasks.ceph.mds.a:Started 2024-01-19T05:18:40.225 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:40.225 INFO:tasks.ceph.mds.b:Started 2024-01-19T05:18:40.226 DEBUG:teuthology.parallel:result is None 2024-01-19T05:18:40.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-19T05:18:40.294 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-01-19T05:18:40.309 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-01-19T05:18:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f132cc58640 1 Processor -- start 2024-01-19T05:18:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f132cc58640 1 -- start start 2024-01-19T05:18:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f132cc58640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1328072510 0x7f13281415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f132cc58640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1328141b00 0x7f132814eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f132cc58640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13281485b0 con 0x7f132806e150 2024-01-19T05:18:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f132cc58640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132806e530 con 0x7f1328141b00 2024-01-19T05:18:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f132cc58640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1328147f60 con 0x7f1328072510 2024-01-19T05:18:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f1326d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1328141b00 0x7f132814eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f1326d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1328141b00 0x7f132814eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33200/0 (socket says 172.21.15.99:33200) 2024-01-19T05:18:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f1326d9d640 1 -- 172.21.15.99:0/822538910 learned_addr learned my addr 172.21.15.99:0/822538910 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f1325d9b640 1 --2- 172.21.15.99:0/822538910 >> v2:172.21.15.157:3300/0 conn(0x7f1328072510 0x7f13281415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f1326d9d640 1 -- 172.21.15.99:0/822538910 >> v2:172.21.15.157:3300/0 conn(0x7f1328072510 msgr2=0x7f13281415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f1326d9d640 1 --2- 172.21.15.99:0/822538910 >> v2:172.21.15.157:3300/0 conn(0x7f1328072510 0x7f13281415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f1326d9d640 1 -- 172.21.15.99:0/822538910 >> v1:172.21.15.157:6789/0 conn(0x7f132806e150 legacy=0x7f1328144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.352+0000 7f1326d9d640 1 -- 172.21.15.99:0/822538910 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328148240 con 0x7f1328141b00 2024-01-19T05:18:40.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 --2- 172.21.15.99:0/822538910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132814eef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f13280a0470 tx=0x7f132001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c593e73c4c17e67f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:40.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132559a640 1 -- 172.21.15.99:0/822538910 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200a5740 con 0x7f1328141b00 2024-01-19T05:18:40.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132559a640 1 -- 172.21.15.99:0/822538910 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13200a58a0 con 0x7f1328141b00 2024-01-19T05:18:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132559a640 1 -- 172.21.15.99:0/822538910 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200a5c30 con 0x7f1328141b00 2024-01-19T05:18:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- 172.21.15.99:0/822538910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 msgr2=0x7f132814eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 --2- 172.21.15.99:0/822538910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132814eef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f13280a0470 tx=0x7f132001c8e0 comp rx=0 tx=0).stop 2024-01-19T05:18:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- 172.21.15.99:0/822538910 shutdown_connections 2024-01-19T05:18:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 --2- 172.21.15.99:0/822538910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132814eef0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 --2- 172.21.15.99:0/822538910 >> v2:172.21.15.157:3300/0 conn(0x7f1328072510 0x7f13281415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- 172.21.15.99:0/822538910 >> 172.21.15.99:0/822538910 conn(0x7f13280ba500 msgr2=0x7f13280ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- 172.21.15.99:0/822538910 shutdown_connections 2024-01-19T05:18:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- 172.21.15.99:0/822538910 wait complete. 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 Processor -- start 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- start start 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f132806e150 0x7f132809ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1328072510 0x7f132809f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132809db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132809c940 con 0x7f1328141b00 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132809aa40 con 0x7f1328072510 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132809d680 con 0x7f132806e150 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132809db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132809db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33210/0 (socket says 172.21.15.99:33210) 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 -- 172.21.15.99:0/3858690735 learned_addr learned my addr 172.21.15.99:0/3858690735 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1325d9b640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1328072510 0x7f132809f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132659c640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f132806e150 0x7f132809ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 -- 172.21.15.99:0/3858690735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f132806e150 msgr2=0x7f132809ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f132806e150 0x7f132809ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 -- 172.21.15.99:0/3858690735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1328072510 msgr2=0x7f132809f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1328072510 0x7f132809f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 -- 172.21.15.99:0/3858690735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320009b30 con 0x7f1328141b00 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1326d9d640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132809db60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f13200af040 tx=0x7f13200196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1316ffd640 1 -- 172.21.15.99:0/3858690735 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200b8670 con 0x7f1328141b00 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1316ffd640 1 -- 172.21.15.99:0/3858690735 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13200b87d0 con 0x7f1328141b00 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13280b0140 con 0x7f1328141b00 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f1316ffd640 1 -- 172.21.15.99:0/3858690735 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200b8b80 con 0x7f1328141b00 2024-01-19T05:18:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.356+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132814ef80 con 0x7f1328141b00 2024-01-19T05:18:40.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.360+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13280696e0 con 0x7f1328141b00 2024-01-19T05:18:40.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.360+0000 7f1316ffd640 1 -- 172.21.15.99:0/3858690735 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f13200b8ce0 con 0x7f1328141b00 2024-01-19T05:18:40.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.360+0000 7f1316ffd640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1308066500 0x7f13080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:40.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.360+0000 7f1316ffd640 1 -- 172.21.15.99:0/3858690735 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f132011efe0 con 0x7f1328141b00 2024-01-19T05:18:40.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.360+0000 7f132659c640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1308066500 0x7f13080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:40.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.360+0000 7f132659c640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1308066500 0x7f13080689c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1318001770 tx=0x7f1318009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:40.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.364+0000 7f1316ffd640 1 -- 172.21.15.99:0/3858690735 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f13200ec8a0 con 0x7f1328141b00 2024-01-19T05:18:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:40.532+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f132809d810 con 0x7f1328141b00 2024-01-19T05:18:41.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.152+0000 7f1316ffd640 1 -- 172.21.15.99:0/3858690735 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13200efec0 con 0x7f1328141b00 2024-01-19T05:18:41.154 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-01-19T05:18:41.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1308066500 msgr2=0x7f13080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1308066500 0x7f13080689c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1318001770 tx=0x7f1318009040 comp rx=0 tx=0).stop 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 msgr2=0x7f132809db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132809db60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f13200af040 tx=0x7f13200196e0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 shutdown_connections 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1308066500 0x7f13080689c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1328141b00 0x7f132809db60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1328072510 0x7f132809f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 --2- 172.21.15.99:0/3858690735 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f132806e150 0x7f132809ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 >> 172.21.15.99:0/3858690735 conn(0x7f13280ba500 msgr2=0x7f13280b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 shutdown_connections 2024-01-19T05:18:41.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.156+0000 7f132cc58640 1 -- 172.21.15.99:0/3858690735 wait complete. 2024-01-19T05:18:41.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-19T05:18:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.296+0000 7fe6afc18640 1 Processor -- start 2024-01-19T05:18:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.296+0000 7fe6afc18640 1 -- start start 2024-01-19T05:18:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6afc18640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe6a806ebe0 0x7fe6a8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6afc18640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a806f070 con 0x7fe6a80b19f0 2024-01-19T05:18:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6afc18640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a8070680 con 0x7fe6a8072320 2024-01-19T05:18:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6afc18640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a8070410 con 0x7fe6a806ebe0 2024-01-19T05:18:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ad9b4640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe6a80b19f0 0x7fe6a8144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33490/0 (socket says 172.21.15.99:33490) 2024-01-19T05:18:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ad9b4640 1 -- 172.21.15.99:0/4144553879 learned_addr learned my addr 172.21.15.99:0/4144553879 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591331643 0 0) 0x7fe698001120 con 0x7fe6a80b19f0 2024-01-19T05:18:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ad1b3640 1 --2- 172.21.15.99:0/4144553879 >> v2:172.21.15.157:3300/0 conn(0x7fe6a806ebe0 0x7fe6a8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe694003530 con 0x7fe6a80b19f0 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4049251286 0 0) 0x7fe694003530 con 0x7fe6a80b19f0 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 >> v2:172.21.15.157:3300/0 conn(0x7fe6a806ebe0 msgr2=0x7fe6a8071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 --2- 172.21.15.99:0/4144553879 >> v2:172.21.15.157:3300/0 conn(0x7fe6a806ebe0 0x7fe6a8071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 >> v1:172.21.15.157:6789/0 conn(0x7fe6a8072320 legacy=0x7fe6a814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8144790 con 0x7fe6a80b19f0 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fe698001810 con 0x7fe6a80b19f0 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 >> v1:172.21.15.99:6789/0 conn(0x7fe6a80b19f0 legacy=0x7fe6a8144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe694003980 0x7fe694003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6940047d0 0x7fe694004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe694005190 0x7fe69400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8070410 con 0x7fe694005190 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69400c130 con 0x7fe694003980 2024-01-19T05:18:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69400c2f0 con 0x7fe6940047d0 2024-01-19T05:18:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ae1b5640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe694005190 0x7fe69400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ad9b4640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe694003980 0x7fe694003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ad1b3640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6940047d0 0x7fe694004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ae1b5640 1 -- 172.21.15.99:0/4144553879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6940047d0 msgr2=0x7fe694004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ae1b5640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6940047d0 0x7fe694004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ae1b5640 1 -- 172.21.15.99:0/4144553879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe694003980 msgr2=0x7fe694003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ae1b5640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe694003980 0x7fe694003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ae1b5640 1 -- 172.21.15.99:0/4144553879 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694003530 con 0x7fe694005190 2024-01-19T05:18:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ae1b5640 1 -- 172.21.15.99:0/4144553879 reap_dead start 2024-01-19T05:18:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ae1b5640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe694005190 0x7fe69400b990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0001e70 tx=0x7fe6a001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726bbe0e3567d7a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0003b80 con 0x7fe694005190 2024-01-19T05:18:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a0003d20 con 0x7fe694005190 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.300+0000 7fe6ac9b2640 1 -- 172.21.15.99:0/4144553879 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0005260 con 0x7fe694005190 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- 172.21.15.99:0/4144553879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe694005190 msgr2=0x7fe69400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe694005190 0x7fe69400b990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0001e70 tx=0x7fe6a001c760 comp rx=0 tx=0).stop 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- 172.21.15.99:0/4144553879 shutdown_connections 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 --2- 172.21.15.99:0/4144553879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe694005190 0x7fe69400b990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- 172.21.15.99:0/4144553879 >> 172.21.15.99:0/4144553879 conn(0x7fe6a80b8080 msgr2=0x7fe6a80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- 172.21.15.99:0/4144553879 shutdown_connections 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- 172.21.15.99:0/4144553879 wait complete. 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 Processor -- start 2024-01-19T05:18:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- start start 2024-01-19T05:18:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe694005190 0x7fe6a813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6a813d370 0x7fe6a81dd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6a81dd9f0 0x7fe6a80abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80ad7c0 con 0x7fe6a813d370 2024-01-19T05:18:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a81ddff0 con 0x7fe6a81dd9f0 2024-01-19T05:18:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80aaf40 con 0x7fe694005190 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6a813d370 0x7fe6a81dd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6a813d370 0x7fe6a81dd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33234/0 (socket says 172.21.15.99:33234) 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 -- 172.21.15.99:0/110868535 learned_addr learned my addr 172.21.15.99:0/110868535 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad9b4640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe694005190 0x7fe6a813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ae1b5640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6a81dd9f0 0x7fe6a80abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 -- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe694005190 msgr2=0x7fe6a813ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe694005190 0x7fe6a813ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 -- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6a81dd9f0 msgr2=0x7fe6a80abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6a81dd9f0 0x7fe6a80abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 -- 172.21.15.99:0/110868535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a813dd70 con 0x7fe6a813d370 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad9b4640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe694005190 0x7fe6a813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6ad1b3640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6a813d370 0x7fe6a81dd4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4011560 tx=0x7fe6a4011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe69e7fc640 1 -- 172.21.15.99:0/110868535 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4015930 con 0x7fe6a813d370 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe69e7fc640 1 -- 172.21.15.99:0/110868535 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a4015a90 con 0x7fe6a813d370 2024-01-19T05:18:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe69e7fc640 1 -- 172.21.15.99:0/110868535 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4015e20 con 0x7fe6a813d370 2024-01-19T05:18:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a80ace90 con 0x7fe6a813d370 2024-01-19T05:18:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a80ac040 con 0x7fe6a813d370 2024-01-19T05:18:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.304+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a81de1b0 con 0x7fe6a813d370 2024-01-19T05:18:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.308+0000 7fe69e7fc640 1 -- 172.21.15.99:0/110868535 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe6a400f460 con 0x7fe6a813d370 2024-01-19T05:18:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.308+0000 7fe69e7fc640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe68c066530 0x7fe68c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.308+0000 7fe6ad9b4640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe68c066530 0x7fe68c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.308+0000 7fe69e7fc640 1 -- 172.21.15.99:0/110868535 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6a40842e0 con 0x7fe6a813d370 2024-01-19T05:18:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.308+0000 7fe6ad9b4640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe68c066530 0x7fe68c0689f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe698001060 tx=0x7fe698000f70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.312+0000 7fe69e7fc640 1 -- 172.21.15.99:0/110868535 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe6a4051960 con 0x7fe6a813d370 2024-01-19T05:18:41.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.524+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe6a81dde00 con 0x7fe6a813d370 2024-01-19T05:18:41.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.524+0000 7fe69e7fc640 1 -- 172.21.15.99:0/110868535 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+5207 (secure 0 0 0) 0x7fe6a4054f80 con 0x7fe6a813d370 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDTBaplI1Z6GhAAjE1qrFtYKxlAWBZWDIGvhQ==", 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDTBapl139qIBAAv46OAf1fqp6NHUL1G5lJpw==", 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDWBapl09otJBAABLiFKXjUqdxU/jTPAI+2/A==", 2024-01-19T05:18:41.527 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDZBaplpF84KBAA6Ktwr0nLv5cchz/DSdNg7w==", 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDcBaplokOALhAAhr0Z/I21azQtlSdnNhLtog==", 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDfBapl+E3zNRAA+KBnm0jPtQr5XrWTcGAAhg==", 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-01-19T05:18:41.529 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDjBapl2B11OhAAhPfxLl7BQbZkfT3eVWYP+A==", 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.530 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDnBaplQsozAhAAF+MoyV3OQOfOYIcOO0DtFg==", 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDqBapl/80YCBAAKvmh1mLQHl2HzK95MKC8aA==", 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDtBapljl5bDhAAPlVtPR3FBwsulKIl5g3lfA==", 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-01-19T05:18:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDTBaplWVQgJhAAFrZruGldx9x7uUC0VUJzcg==", 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDTBaplW/EDBBAAaWCNb028o0Sp5mcK1VXdjA==", 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-01-19T05:18:41.533 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-mds", 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDyBaplGeDPLxAACMX0IZNJk140sEM/Q4+4ZA==", 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-mds" 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-mgr", 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDyBapl9fnPLxAAofffEG26xzvDdfDHo3ny1A==", 2024-01-19T05:18:41.534 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-osd", 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDyBaplphPQLxAAFKZEBJpDZFuJmze5ZEW3Hg==", 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-osd" 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rbd", 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDyBapltSrQLxAAp+prNMYSHRxw6w1bnXs2oA==", 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-19T05:18:41.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDyBaplqEPQLxAAodwttfVK38qmgN8dUPSXIA==", 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rgw", 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDyBapliFrQLxAA/Cf1TfvsuUJEOPSJI3sqgw==", 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-19T05:18:41.536 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDTBaplVZQ8FxAA/EfnirPNB1ooVl9fjdHieg==", 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-01-19T05:18:41.537 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQDTBaplDl6rFBAAll1qnW8tuARQ/SJGd1f5zw==", 2024-01-19T05:18:41.538 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-01-19T05:18:41.538 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-01-19T05:18:41.538 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-01-19T05:18:41.538 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-01-19T05:18:41.538 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.538 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:41.538 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-19T05:18:41.538 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe68c066530 msgr2=0x7fe68c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe68c066530 0x7fe68c0689f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe698001060 tx=0x7fe698000f70 comp rx=0 tx=0).stop 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6a813d370 msgr2=0x7fe6a81dd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6a813d370 0x7fe6a81dd4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4011560 tx=0x7fe6a4011a20 comp rx=0 tx=0).stop 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 shutdown_connections 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fe68c066530 0x7fe68c0689f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6a81dd9f0 0x7fe6a80abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6a813d370 0x7fe6a81dd4b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 --2- 172.21.15.99:0/110868535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe694005190 0x7fe6a813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 >> 172.21.15.99:0/110868535 conn(0x7fe6a80b8080 msgr2=0x7fe6a80b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:41.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 shutdown_connections 2024-01-19T05:18:41.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.528+0000 7fe6afc18640 1 -- 172.21.15.99:0/110868535 wait complete. 2024-01-19T05:18:41.545 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-19T05:18:41.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff660917640 1 Processor -- start 2024-01-19T05:18:41.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff660917640 1 -- start start 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff660917640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff65c0b2ce0 0x7ff65c071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff660917640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff65c0b1870 0x7ff65c072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff660917640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c06f620 con 0x7ff65c143ac0 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff660917640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c141000 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff660917640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c143610 con 0x7ff65c0b1870 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff65a59c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff65c0b2ce0 0x7ff65c071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff65a59c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff65c0b2ce0 0x7ff65c071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33238/0 (socket says 172.21.15.99:33238) 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff65a59c640 1 -- 172.21.15.99:0/1546743840 learned_addr learned my addr 172.21.15.99:0/1546743840 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff659d9b640 1 --2- 172.21.15.99:0/1546743840 >> v2:172.21.15.157:3300/0 conn(0x7ff65c0b1870 0x7ff65c072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff65a59c640 1 -- 172.21.15.99:0/1546743840 >> v2:172.21.15.157:3300/0 conn(0x7ff65c0b1870 msgr2=0x7ff65c072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff65a59c640 1 --2- 172.21.15.99:0/1546743840 >> v2:172.21.15.157:3300/0 conn(0x7ff65c0b1870 0x7ff65c072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff65a59c640 1 -- 172.21.15.99:0/1546743840 >> v1:172.21.15.157:6789/0 conn(0x7ff65c143ac0 legacy=0x7ff65c143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.660+0000 7ff65a59c640 1 -- 172.21.15.99:0/1546743840 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0b30c0 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 --2- 172.21.15.99:0/1546743840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c071f00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff65c06acd0 tx=0x7ff65401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c6ef27ade5b240 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:41.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65959a640 1 -- 172.21.15.99:0/1546743840 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400b2d0 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65959a640 1 -- 172.21.15.99:0/1546743840 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400b430 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65959a640 1 -- 172.21.15.99:0/1546743840 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540a7c90 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- 172.21.15.99:0/1546743840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 msgr2=0x7ff65c071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 --2- 172.21.15.99:0/1546743840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c071f00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff65c06acd0 tx=0x7ff65401eba0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- 172.21.15.99:0/1546743840 shutdown_connections 2024-01-19T05:18:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 --2- 172.21.15.99:0/1546743840 >> v2:172.21.15.157:3300/0 conn(0x7ff65c0b1870 0x7ff65c072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 --2- 172.21.15.99:0/1546743840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c071f00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- 172.21.15.99:0/1546743840 >> 172.21.15.99:0/1546743840 conn(0x7ff65c0b8080 msgr2=0x7ff65c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- 172.21.15.99:0/1546743840 shutdown_connections 2024-01-19T05:18:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- 172.21.15.99:0/1546743840 wait complete. 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 Processor -- start 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- start start 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c0adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff65c143ac0 0x7ff65c0ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff65c1de020 0x7ff65c1de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0aaf50 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0ad1f0 con 0x7ff65c143ac0 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff660917640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0ad720 con 0x7ff65c1de020 2024-01-19T05:18:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c0adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c0adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33240/0 (socket says 172.21.15.99:33240) 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 -- 172.21.15.99:0/1939880217 learned_addr learned my addr 172.21.15.99:0/1939880217 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 -- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff65c1de020 msgr2=0x7ff65c1de4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65ad9d640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff65c1de020 0x7ff65c1de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff659d9b640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff65c143ac0 0x7ff65c0ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff65c1de020 0x7ff65c1de4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 -- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff65c143ac0 msgr2=0x7ff65c0ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff65c143ac0 0x7ff65c0ab370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65a59c640 1 -- 172.21.15.99:0/1939880217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65400bd40 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.664+0000 7ff65ad9d640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff65c1de020 0x7ff65c1de4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff65a59c640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c0adea0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6540b1040 tx=0x7ff65401b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff652ffd640 1 -- 172.21.15.99:0/1939880217 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654009800 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff652ffd640 1 -- 172.21.15.99:0/1939880217 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654009980 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c0abdc0 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff652ffd640 1 -- 172.21.15.99:0/1939880217 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654009d30 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c0aab70 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c0696e0 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff652ffd640 1 -- 172.21.15.99:0/1939880217 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff6540ba470 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff652ffd640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff640066500 0x7ff6400689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:41.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff652ffd640 1 -- 172.21.15.99:0/1939880217 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff654121540 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff659d9b640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff640066500 0x7ff6400689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:41.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.668+0000 7ff659d9b640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff640066500 0x7ff6400689c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff65c1df0e0 tx=0x7ff644008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.672+0000 7ff652ffd640 1 -- 172.21.15.99:0/1939880217 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff6540eebd0 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.880+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff65c06f060 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff652ffd640 1 -- 172.21.15.99:0/1939880217 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff6540f21f0 con 0x7ff65c0b2ce0 2024-01-19T05:18:41.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff640066500 msgr2=0x7ff6400689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff640066500 0x7ff6400689c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff65c1df0e0 tx=0x7ff644008040 comp rx=0 tx=0).stop 2024-01-19T05:18:41.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 msgr2=0x7ff65c0adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c0adea0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6540b1040 tx=0x7ff65401b940 comp rx=0 tx=0).stop 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 shutdown_connections 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff640066500 0x7ff6400689c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff65c1de020 0x7ff65c1de4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff65c143ac0 0x7ff65c0ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 --2- 172.21.15.99:0/1939880217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff65c0b2ce0 0x7ff65c0adea0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 >> 172.21.15.99:0/1939880217 conn(0x7ff65c0b8080 msgr2=0x7ff65c141470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 shutdown_connections 2024-01-19T05:18:41.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:41.884+0000 7ff660917640 1 -- 172.21.15.99:0/1939880217 wait complete. 2024-01-19T05:18:41.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-19T05:18:42.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.004+0000 7f7881f26640 1 Processor -- start 2024-01-19T05:18:42.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.004+0000 7f7881f26640 1 -- start start 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f787c1441d0 0x7f787c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c06f620 con 0x7f787c0b2ce0 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c143610 con 0x7f787c0b1870 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c141000 con 0x7f787c1441d0 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787bfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f787c1441d0 0x7f787c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787bfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f787c1441d0 0x7f787c14edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48200/0 (socket says 172.21.15.99:48200) 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787bfff640 1 -- 172.21.15.99:0/506232705 learned_addr learned my addr 172.21.15.99:0/506232705 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787b7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f787c0b2ce0 0x7f787c071f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42826/0 (socket says 172.21.15.99:42826) 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787bfff640 1 -- 172.21.15.99:0/506232705 >> v1:172.21.15.157:6789/0 conn(0x7f787c0b1870 legacy=0x7f787c143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787bfff640 1 -- 172.21.15.99:0/506232705 >> v1:172.21.15.99:6789/0 conn(0x7f787c0b2ce0 legacy=0x7f787c071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787bfff640 1 -- 172.21.15.99:0/506232705 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0b30c0 con 0x7f787c1441d0 2024-01-19T05:18:42.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787bfff640 1 --2- 172.21.15.99:0/506232705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c14edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7874009e50 tx=0x7f787401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406cb4ba3feac1b server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787a7fc640 1 -- 172.21.15.99:0/506232705 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740a5860 con 0x7f787c1441d0 2024-01-19T05:18:42.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787a7fc640 1 -- 172.21.15.99:0/506232705 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78740a59c0 con 0x7f787c1441d0 2024-01-19T05:18:42.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f787a7fc640 1 -- 172.21.15.99:0/506232705 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740a5d50 con 0x7f787c1441d0 2024-01-19T05:18:42.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 -- 172.21.15.99:0/506232705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 msgr2=0x7f787c14edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 --2- 172.21.15.99:0/506232705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c14edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7874009e50 tx=0x7f787401c9a0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 -- 172.21.15.99:0/506232705 shutdown_connections 2024-01-19T05:18:42.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 --2- 172.21.15.99:0/506232705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c14edb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 -- 172.21.15.99:0/506232705 >> 172.21.15.99:0/506232705 conn(0x7f787c0b8080 msgr2=0x7f787c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:42.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 -- 172.21.15.99:0/506232705 shutdown_connections 2024-01-19T05:18:42.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.008+0000 7f7881f26640 1 -- 172.21.15.99:0/506232705 wait complete. 2024-01-19T05:18:42.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 Processor -- start 2024-01-19T05:18:42.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 -- start start 2024-01-19T05:18:42.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f787c0b2ce0 0x7f787c13a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c139020 0x7f787c1394d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c137df0 con 0x7f787c1441d0 2024-01-19T05:18:42.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c13d3f0 con 0x7f787c139020 2024-01-19T05:18:42.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c13c7f0 con 0x7f787c0b2ce0 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48206/0 (socket says 172.21.15.99:48206) 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 -- 172.21.15.99:0/3411736688 learned_addr learned my addr 172.21.15.99:0/3411736688 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 -- 172.21.15.99:0/3411736688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f787c0b2ce0 msgr2=0x7f787c13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f787c0b2ce0 0x7f787c13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 -- 172.21.15.99:0/3411736688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c139020 msgr2=0x7f787c1394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c139020 0x7f787c1394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 -- 172.21.15.99:0/3411736688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874009b30 con 0x7f787c1441d0 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787affd640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c139c20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f787000c480 tx=0x7f787000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7863fff640 1 -- 172.21.15.99:0/3411736688 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870012830 con 0x7f787c1441d0 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7863fff640 1 -- 172.21.15.99:0/3411736688 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78700129b0 con 0x7f787c1441d0 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c139a10 con 0x7f787c1441d0 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7863fff640 1 -- 172.21.15.99:0/3411736688 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870012d60 con 0x7f787c1441d0 2024-01-19T05:18:42.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c13f1d0 con 0x7f787c1441d0 2024-01-19T05:18:42.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c138d40 con 0x7f787c1441d0 2024-01-19T05:18:42.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7863fff640 1 -- 172.21.15.99:0/3411736688 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f787001c460 con 0x7f787c1441d0 2024-01-19T05:18:42.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7863fff640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7868066500 0x7f78680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f787b7fe640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7868066500 0x7f78680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.012+0000 7f7863fff640 1 -- 172.21.15.99:0/3411736688 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78700839e0 con 0x7f787c1441d0 2024-01-19T05:18:42.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.016+0000 7f787b7fe640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7868066500 0x7f78680689c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f787c13afa0 tx=0x7f786c0079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.020+0000 7f7863fff640 1 -- 172.21.15.99:0/3411736688 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f787c138d40 con 0x7f787c1441d0 2024-01-19T05:18:42.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.216+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f787c138d40 con 0x7f787c1441d0 2024-01-19T05:18:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.220+0000 7f7863fff640 1 -- 172.21.15.99:0/3411736688 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f787c138d40 con 0x7f787c1441d0 2024-01-19T05:18:42.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7868066500 msgr2=0x7f78680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7868066500 0x7f78680689c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f787c13afa0 tx=0x7f786c0079b0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 msgr2=0x7f787c139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c139c20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f787000c480 tx=0x7f787000c940 comp rx=0 tx=0).stop 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 shutdown_connections 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7868066500 0x7f78680689c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f787c139020 0x7f787c1394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f787c1441d0 0x7f787c139c20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 --2- 172.21.15.99:0/3411736688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f787c0b2ce0 0x7f787c13a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 >> 172.21.15.99:0/3411736688 conn(0x7f787c0b8080 msgr2=0x7f787c141500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 shutdown_connections 2024-01-19T05:18:42.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.224+0000 7f7881f26640 1 -- 172.21.15.99:0/3411736688 wait complete. 2024-01-19T05:18:42.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-19T05:18:42.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e6bcf640 1 Processor -- start 2024-01-19T05:18:42.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e6bcf640 1 -- start start 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e6bcf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f33e00b9220 0x7f33e00b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e6bcf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 0x7f33e0146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e6bcf640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f33e013fcc0 0x7f33e0140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e6bcf640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00b29b0 con 0x7f33e013fcc0 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e6bcf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00afda0 con 0x7f33e00b9220 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e6bcf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0146e60 con 0x7f33e01464c0 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e516c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f33e013fcc0 0x7f33e0140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e516c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f33e013fcc0 0x7f33e0140110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48216/0 (socket says 172.21.15.99:48216) 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e516c640 1 -- 172.21.15.99:0/2716328215 learned_addr learned my addr 172.21.15.99:0/2716328215 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:42.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33dffff640 1 --2- 172.21.15.99:0/2716328215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 0x7f33e0146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e496b640 1 --2- 172.21.15.99:0/2716328215 >> v2:172.21.15.157:3300/0 conn(0x7f33e00b9220 0x7f33e00b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e516c640 1 -- 172.21.15.99:0/2716328215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 msgr2=0x7f33e0146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e516c640 1 --2- 172.21.15.99:0/2716328215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 0x7f33e0146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e516c640 1 -- 172.21.15.99:0/2716328215 >> v2:172.21.15.157:3300/0 conn(0x7f33e00b9220 msgr2=0x7f33e00b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e516c640 1 --2- 172.21.15.99:0/2716328215 >> v2:172.21.15.157:3300/0 conn(0x7f33e00b9220 0x7f33e00b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.352+0000 7f33e516c640 1 -- 172.21.15.99:0/2716328215 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00b9600 con 0x7f33e013fcc0 2024-01-19T05:18:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e516c640 1 --2- 172.21.15.99:0/2716328215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e0140110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f33e00aff40 tx=0x7f33d801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c93ddea4d4e38c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33df7fe640 1 -- 172.21.15.99:0/2716328215 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80ad680 con 0x7f33e013fcc0 2024-01-19T05:18:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33df7fe640 1 -- 172.21.15.99:0/2716328215 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d80ad7e0 con 0x7f33e013fcc0 2024-01-19T05:18:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33df7fe640 1 -- 172.21.15.99:0/2716328215 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80adb70 con 0x7f33e013fcc0 2024-01-19T05:18:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- 172.21.15.99:0/2716328215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 msgr2=0x7f33e0140110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/2716328215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e0140110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f33e00aff40 tx=0x7f33d801c440 comp rx=0 tx=0).stop 2024-01-19T05:18:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- 172.21.15.99:0/2716328215 shutdown_connections 2024-01-19T05:18:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/2716328215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e0140110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/2716328215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 0x7f33e0146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/2716328215 >> v2:172.21.15.157:3300/0 conn(0x7f33e00b9220 0x7f33e00b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- 172.21.15.99:0/2716328215 >> 172.21.15.99:0/2716328215 conn(0x7f33e006adf0 msgr2=0x7f33e00b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:42.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- 172.21.15.99:0/2716328215 shutdown_connections 2024-01-19T05:18:42.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- 172.21.15.99:0/2716328215 wait complete. 2024-01-19T05:18:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 Processor -- start 2024-01-19T05:18:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- start start 2024-01-19T05:18:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33e00b9220 0x7f33e00ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e00af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 0x7f33e01deb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00ace90 con 0x7f33e013fcc0 2024-01-19T05:18:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e01de730 con 0x7f33e00b9220 2024-01-19T05:18:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e6bcf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00acc40 con 0x7f33e01464c0 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33dffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e00af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33dffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e00af0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48224/0 (socket says 172.21.15.99:48224) 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33dffff640 1 -- 172.21.15.99:0/3802927132 learned_addr learned my addr 172.21.15.99:0/3802927132 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e496b640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33e00b9220 0x7f33e00ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e516c640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 0x7f33e01deb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33dffff640 1 -- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 msgr2=0x7f33e01deb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33dffff640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 0x7f33e01deb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33dffff640 1 -- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33e00b9220 msgr2=0x7f33e00ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33dffff640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33e00b9220 0x7f33e00ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33dffff640 1 -- 172.21.15.99:0/3802927132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80094d0 con 0x7f33e013fcc0 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.356+0000 7f33e496b640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33e00b9220 0x7f33e00ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33dffff640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e00af0e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f33c8007e70 tx=0x7f33c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33dd7fa640 1 -- 172.21.15.99:0/3802927132 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8014620 con 0x7f33e013fcc0 2024-01-19T05:18:42.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33dd7fa640 1 -- 172.21.15.99:0/3802927132 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8014780 con 0x7f33e013fcc0 2024-01-19T05:18:42.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e00af620 con 0x7f33e013fcc0 2024-01-19T05:18:42.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33dd7fa640 1 -- 172.21.15.99:0/3802927132 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8014b30 con 0x7f33e013fcc0 2024-01-19T05:18:42.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e0140d60 con 0x7f33e013fcc0 2024-01-19T05:18:42.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e00696e0 con 0x7f33e013fcc0 2024-01-19T05:18:42.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33dd7fa640 1 -- 172.21.15.99:0/3802927132 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f33c8014c90 con 0x7f33e013fcc0 2024-01-19T05:18:42.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33dd7fa640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f33c0066500 0x7f33c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33dd7fa640 1 -- 172.21.15.99:0/3802927132 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33c80843c0 con 0x7f33e013fcc0 2024-01-19T05:18:42.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33e496b640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f33c0066500 0x7f33c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.360+0000 7f33e496b640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f33c0066500 0x7f33c00689c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f33e006c860 tx=0x7f33d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.364+0000 7f33dd7fa640 1 -- 172.21.15.99:0/3802927132 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f33c8051a40 con 0x7f33e013fcc0 2024-01-19T05:18:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.560+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f33e006bd00 con 0x7f33e013fcc0 2024-01-19T05:18:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.564+0000 7f33dd7fa640 1 -- 172.21.15.99:0/3802927132 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f33c8055060 con 0x7f33e013fcc0 2024-01-19T05:18:42.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f33c0066500 msgr2=0x7f33c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f33c0066500 0x7f33c00689c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f33e006c860 tx=0x7f33d0008040 comp rx=0 tx=0).stop 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 msgr2=0x7f33e00af0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e00af0e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f33c8007e70 tx=0x7f33c800e4b0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 shutdown_connections 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f33c0066500 0x7f33c00689c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33e01464c0 0x7f33e01deb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e013fcc0 0x7f33e00af0e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 --2- 172.21.15.99:0/3802927132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33e00b9220 0x7f33e00ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 >> 172.21.15.99:0/3802927132 conn(0x7f33e006adf0 msgr2=0x7f33e0144830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 shutdown_connections 2024-01-19T05:18:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.568+0000 7f33e6bcf640 1 -- 172.21.15.99:0/3802927132 wait complete. 2024-01-19T05:18:42.581 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-19T05:18:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4f5d81640 1 Processor -- start 2024-01-19T05:18:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4f5d81640 1 -- start start 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4f5d81640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb4f006ccf0 0x7fb4f0144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4f5d81640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4f00aec10 0x7fb4f013cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4f5d81640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f0143dc0 con 0x7fb4f00b3a10 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4f5d81640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f00b3ea0 con 0x7fb4f00aec10 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4f5d81640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f006d0d0 con 0x7fb4f006ccf0 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4eeffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb4f00b3a10 0x7fb4f00ae500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42842/0 (socket says 172.21.15.99:42842) 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4eeffd640 1 -- 172.21.15.99:0/2853007112 learned_addr learned my addr 172.21.15.99:0/2853007112 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4effff640 1 --2- 172.21.15.99:0/2853007112 >> v2:172.21.15.99:3300/0 conn(0x7fb4f00aec10 0x7fb4f013cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4ef7fe640 1 --2- 172.21.15.99:0/2853007112 >> v2:172.21.15.157:3300/0 conn(0x7fb4f006ccf0 0x7fb4f0144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4ee7fc640 1 -- 172.21.15.99:0/2853007112 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483786887 0 0) 0x7fb4f0143dc0 con 0x7fb4f00b3a10 2024-01-19T05:18:42.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4ee7fc640 1 -- 172.21.15.99:0/2853007112 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4dc003530 con 0x7fb4f00b3a10 2024-01-19T05:18:42.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4effff640 1 -- 172.21.15.99:0/2853007112 >> v2:172.21.15.157:3300/0 conn(0x7fb4f006ccf0 msgr2=0x7fb4f0144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:42.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4effff640 1 --2- 172.21.15.99:0/2853007112 >> v2:172.21.15.157:3300/0 conn(0x7fb4f006ccf0 0x7fb4f0144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4effff640 1 -- 172.21.15.99:0/2853007112 >> v1:172.21.15.99:6789/0 conn(0x7fb4f00b3a10 legacy=0x7fb4f00ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.704+0000 7fb4effff640 1 -- 172.21.15.99:0/2853007112 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0143770 con 0x7fb4f00aec10 2024-01-19T05:18:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4effff640 1 --2- 172.21.15.99:0/2853007112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f013cfb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb4f006d970 tx=0x7fb4e001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f351d27134a514 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4ee7fc640 1 -- 172.21.15.99:0/2853007112 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00ac620 con 0x7fb4f00aec10 2024-01-19T05:18:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4ee7fc640 1 -- 172.21.15.99:0/2853007112 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00ac780 con 0x7fb4f00aec10 2024-01-19T05:18:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4ee7fc640 1 -- 172.21.15.99:0/2853007112 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00acb10 con 0x7fb4f00aec10 2024-01-19T05:18:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- 172.21.15.99:0/2853007112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 msgr2=0x7fb4f013cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/2853007112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f013cfb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb4f006d970 tx=0x7fb4e001c3a0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- 172.21.15.99:0/2853007112 shutdown_connections 2024-01-19T05:18:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/2853007112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f013cfb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/2853007112 >> v2:172.21.15.157:3300/0 conn(0x7fb4f006ccf0 0x7fb4f0144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- 172.21.15.99:0/2853007112 >> 172.21.15.99:0/2853007112 conn(0x7fb4f0066ef0 msgr2=0x7fb4f00b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- 172.21.15.99:0/2853007112 shutdown_connections 2024-01-19T05:18:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- 172.21.15.99:0/2853007112 wait complete. 2024-01-19T05:18:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 Processor -- start 2024-01-19T05:18:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- start start 2024-01-19T05:18:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4f006ccf0 0x7fb4f006ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb4f00b3a10 0x7fb4f00716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0070d70 con 0x7fb4f00aec10 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01dd3f0 con 0x7fb4f006ccf0 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4f5d81640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0070600 con 0x7fb4f00b3a10 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4eeffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4eeffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f0071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48242/0 (socket says 172.21.15.99:48242) 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4eeffd640 1 -- 172.21.15.99:0/3765400878 learned_addr learned my addr 172.21.15.99:0/3765400878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4effff640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb4f00b3a10 0x7fb4f00716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4ef7fe640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4f006ccf0 0x7fb4f006ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4eeffd640 1 -- 172.21.15.99:0/3765400878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb4f00b3a10 msgr2=0x7fb4f00716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4eeffd640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb4f00b3a10 0x7fb4f00716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4eeffd640 1 -- 172.21.15.99:0/3765400878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4f006ccf0 msgr2=0x7fb4f006ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4eeffd640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4f006ccf0 0x7fb4f006ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.708+0000 7fb4eeffd640 1 -- 172.21.15.99:0/3765400878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009420 con 0x7fb4f00aec10 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4eeffd640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f0071190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800c3f0 tx=0x7fb4d800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4e7fff640 1 -- 172.21.15.99:0/3765400878 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8005cf0 con 0x7fb4f00aec10 2024-01-19T05:18:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4e7fff640 1 -- 172.21.15.99:0/3765400878 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8005e50 con 0x7fb4f00aec10 2024-01-19T05:18:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f0070850 con 0x7fb4f00aec10 2024-01-19T05:18:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4e7fff640 1 -- 172.21.15.99:0/3765400878 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80072f0 con 0x7fb4f00aec10 2024-01-19T05:18:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f01385e0 con 0x7fb4f00aec10 2024-01-19T05:18:42.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f0070eb0 con 0x7fb4f00aec10 2024-01-19T05:18:42.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4e7fff640 1 -- 172.21.15.99:0/3765400878 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb4d8007450 con 0x7fb4f00aec10 2024-01-19T05:18:42.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4e7fff640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb4d0066500 0x7fb4d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:42.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4ef7fe640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb4d0066500 0x7fb4d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:42.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4e7fff640 1 -- 172.21.15.99:0/3765400878 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb4d8083100 con 0x7fb4f00aec10 2024-01-19T05:18:42.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.712+0000 7fb4ef7fe640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb4d0066500 0x7fb4d00689c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80074a0 tx=0x7fb4e800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:42.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.716+0000 7fb4e7fff640 1 -- 172.21.15.99:0/3765400878 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb4f0070eb0 con 0x7fb4f00aec10 2024-01-19T05:18:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.924+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb4f0070eb0 con 0x7fb4f00aec10 2024-01-19T05:18:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.928+0000 7fb4e7fff640 1 -- 172.21.15.99:0/3765400878 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb4f0070eb0 con 0x7fb4f00aec10 2024-01-19T05:18:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb4d0066500 msgr2=0x7fb4d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb4d0066500 0x7fb4d00689c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80074a0 tx=0x7fb4e800b040 comp rx=0 tx=0).stop 2024-01-19T05:18:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 msgr2=0x7fb4f0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f0071190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800c3f0 tx=0x7fb4d800c8b0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 shutdown_connections 2024-01-19T05:18:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb4d0066500 0x7fb4d00689c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb4f00b3a10 0x7fb4f00716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4f00aec10 0x7fb4f0071190 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 --2- 172.21.15.99:0/3765400878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4f006ccf0 0x7fb4f006ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:42.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 >> 172.21.15.99:0/3765400878 conn(0x7fb4f0066ef0 msgr2=0x7fb4f006a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:42.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 shutdown_connections 2024-01-19T05:18:42.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:42.932+0000 7fb4f5d81640 1 -- 172.21.15.99:0/3765400878 wait complete. 2024-01-19T05:18:42.946 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-19T05:18:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.064+0000 7f93a8657640 1 Processor -- start 2024-01-19T05:18:43.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.064+0000 7f93a8657640 1 -- start start 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93a00b2ce0 0x7f93a0071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 0x7f93a0072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a006f620 con 0x7f93a00b1870 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a0141000 con 0x7f93a00b2ce0 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0143610 con 0x7f93a01441d0 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a63f3640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93a00b2ce0 0x7f93a0071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a5bf2640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f93a00b1870 0x7f93a0143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42844/0 (socket says 172.21.15.99:42844) 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a5bf2640 1 -- 172.21.15.99:0/265137304 learned_addr learned my addr 172.21.15.99:0/265137304 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a63f3640 1 -- 172.21.15.99:0/265137304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 msgr2=0x7f93a0072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a6bf4640 1 --2- 172.21.15.99:0/265137304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 0x7f93a0072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a53f1640 1 -- 172.21.15.99:0/265137304 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872598478 0 0) 0x7f93a006f620 con 0x7f93a00b1870 2024-01-19T05:18:43.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a63f3640 1 --2- 172.21.15.99:0/265137304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 0x7f93a0072440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a63f3640 1 -- 172.21.15.99:0/265137304 >> v1:172.21.15.99:6789/0 conn(0x7f93a00b1870 legacy=0x7f93a0143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a63f3640 1 -- 172.21.15.99:0/265137304 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a00b30c0 con 0x7f93a00b2ce0 2024-01-19T05:18:43.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a63f3640 1 --2- 172.21.15.99:0/265137304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0071f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f939c0097c0 tx=0x7f939c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f0c27a1f201341 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a53f1640 1 -- 172.21.15.99:0/265137304 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0ab650 con 0x7f93a00b2ce0 2024-01-19T05:18:43.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a53f1640 1 -- 172.21.15.99:0/265137304 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c0ab7b0 con 0x7f93a00b2ce0 2024-01-19T05:18:43.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a53f1640 1 -- 172.21.15.99:0/265137304 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0abb40 con 0x7f93a00b2ce0 2024-01-19T05:18:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 -- 172.21.15.99:0/265137304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 msgr2=0x7f93a0071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 --2- 172.21.15.99:0/265137304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0071f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f939c0097c0 tx=0x7f939c01c450 comp rx=0 tx=0).stop 2024-01-19T05:18:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 -- 172.21.15.99:0/265137304 shutdown_connections 2024-01-19T05:18:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 --2- 172.21.15.99:0/265137304 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 0x7f93a0072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 --2- 172.21.15.99:0/265137304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0071f00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 -- 172.21.15.99:0/265137304 >> 172.21.15.99:0/265137304 conn(0x7f93a00b8080 msgr2=0x7f93a00b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 -- 172.21.15.99:0/265137304 shutdown_connections 2024-01-19T05:18:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.068+0000 7f93a8657640 1 -- 172.21.15.99:0/265137304 wait complete. 2024-01-19T05:18:43.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 Processor -- start 2024-01-19T05:18:43.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 -- start start 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 0x7f93a01dee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93a01df3c0 0x7f93a013d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00a92f0 con 0x7f93a00b2ce0 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a01de9f0 con 0x7f93a01df3c0 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a01df870 con 0x7f93a01441d0 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0140510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48262/0 (socket says 172.21.15.99:48262) 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 -- 172.21.15.99:0/3402968704 learned_addr learned my addr 172.21.15.99:0/3402968704 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a5bf2640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 0x7f93a01dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 -- 172.21.15.99:0/3402968704 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 msgr2=0x7f93a01dee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 0x7f93a01dee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 -- 172.21.15.99:0/3402968704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93a01df3c0 msgr2=0x7f93a013d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93a01df3c0 0x7f93a013d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 -- 172.21.15.99:0/3402968704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c009420 con 0x7f93a00b2ce0 2024-01-19T05:18:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a63f3640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0140510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f939c0ad040 tx=0x7f939c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f9396ffd640 1 -- 172.21.15.99:0/3402968704 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0b4730 con 0x7f93a00b2ce0 2024-01-19T05:18:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f9396ffd640 1 -- 172.21.15.99:0/3402968704 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c0b48d0 con 0x7f93a00b2ce0 2024-01-19T05:18:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f9396ffd640 1 -- 172.21.15.99:0/3402968704 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0b4c80 con 0x7f93a00b2ce0 2024-01-19T05:18:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a013c350 con 0x7f93a00b2ce0 2024-01-19T05:18:43.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a00a8590 con 0x7f93a00b2ce0 2024-01-19T05:18:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a00a8790 con 0x7f93a00b2ce0 2024-01-19T05:18:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.072+0000 7f9396ffd640 1 -- 172.21.15.99:0/3402968704 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f939c0bd410 con 0x7f93a00b2ce0 2024-01-19T05:18:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.076+0000 7f9396ffd640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9384066530 0x7f93840689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.076+0000 7f9396ffd640 1 -- 172.21.15.99:0/3402968704 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f939c11fe10 con 0x7f93a00b2ce0 2024-01-19T05:18:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.076+0000 7f93a5bf2640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9384066530 0x7f93840689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.076+0000 7f93a5bf2640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9384066530 0x7f93840689f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93a01388a0 tx=0x7f9390009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.080+0000 7f9396ffd640 1 -- 172.21.15.99:0/3402968704 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f939c0ed490 con 0x7f93a00b2ce0 2024-01-19T05:18:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.276+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f93a01deb80 con 0x7f93a00b2ce0 2024-01-19T05:18:43.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.280+0000 7f9396ffd640 1 -- 172.21.15.99:0/3402968704 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f939c0f0ab0 con 0x7f93a00b2ce0 2024-01-19T05:18:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9384066530 msgr2=0x7f93840689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9384066530 0x7f93840689f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93a01388a0 tx=0x7f9390009040 comp rx=0 tx=0).stop 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 msgr2=0x7f93a0140510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0140510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f939c0ad040 tx=0x7f939c01ac90 comp rx=0 tx=0).stop 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 shutdown_connections 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9384066530 0x7f93840689f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93a01df3c0 0x7f93a013d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93a01441d0 0x7f93a01dee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 --2- 172.21.15.99:0/3402968704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93a00b2ce0 0x7f93a0140510 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 >> 172.21.15.99:0/3402968704 conn(0x7f93a00b8080 msgr2=0x7f93a0141f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 shutdown_connections 2024-01-19T05:18:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.284+0000 7f93a8657640 1 -- 172.21.15.99:0/3402968704 wait complete. 2024-01-19T05:18:43.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-19T05:18:43.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf4afb9640 1 Processor -- start 2024-01-19T05:18:43.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf4afb9640 1 -- start start 2024-01-19T05:18:43.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf4afb9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdf4413e860 0x7fdf440b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf4afb9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdf44066810 0x7fdf4414ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf4afb9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440b2d80 con 0x7fdf440663f0 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf4afb9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440b2ba0 con 0x7fdf44066810 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf4afb9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440b4c90 con 0x7fdf4413e860 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf49556640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdf44066810 0x7fdf4414ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf43fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdf440663f0 0x7fdf441445e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42860/0 (socket says 172.21.15.99:42860) 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.408+0000 7fdf43fff640 1 -- 172.21.15.99:0/3964608539 learned_addr learned my addr 172.21.15.99:0/3964608539 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf49556640 1 -- 172.21.15.99:0/3964608539 >> v2:172.21.15.157:3300/0 conn(0x7fdf4413e860 msgr2=0x7fdf440b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf49556640 1 --2- 172.21.15.99:0/3964608539 >> v2:172.21.15.157:3300/0 conn(0x7fdf4413e860 0x7fdf440b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf49556640 1 -- 172.21.15.99:0/3964608539 >> v1:172.21.15.99:6789/0 conn(0x7fdf440663f0 legacy=0x7fdf441445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf49556640 1 -- 172.21.15.99:0/3964608539 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440b4920 con 0x7fdf44066810 2024-01-19T05:18:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf437fe640 1 -- 172.21.15.99:0/3964608539 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177084117 0 0) 0x7fdf440b2d80 con 0x7fdf440663f0 2024-01-19T05:18:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf49556640 1 --2- 172.21.15.99:0/3964608539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf44066810 0x7fdf4414ef60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf440b9220 tx=0x7fdf3801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4b7ddc653c91aa server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf437fe640 1 -- 172.21.15.99:0/3964608539 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf380ab600 con 0x7fdf44066810 2024-01-19T05:18:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf437fe640 1 -- 172.21.15.99:0/3964608539 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf380a7050 con 0x7fdf44066810 2024-01-19T05:18:43.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf437fe640 1 -- 172.21.15.99:0/3964608539 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf380ab980 con 0x7fdf44066810 2024-01-19T05:18:43.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3964608539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf44066810 msgr2=0x7fdf4414ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3964608539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf44066810 0x7fdf4414ef60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf440b9220 tx=0x7fdf3801c3d0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3964608539 shutdown_connections 2024-01-19T05:18:43.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3964608539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf44066810 0x7fdf4414ef60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3964608539 >> v2:172.21.15.157:3300/0 conn(0x7fdf4413e860 0x7fdf440b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3964608539 >> 172.21.15.99:0/3964608539 conn(0x7fdf4406ad70 msgr2=0x7fdf440b8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:43.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3964608539 shutdown_connections 2024-01-19T05:18:43.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.412+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3964608539 wait complete. 2024-01-19T05:18:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 Processor -- start 2024-01-19T05:18:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 -- start start 2024-01-19T05:18:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf440663f0 0x7fdf441e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf44066810 0x7fdf44138c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf4413e860 0x7fdf441439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441e0790 con 0x7fdf440663f0 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4413dc60 con 0x7fdf44066810 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441e0140 con 0x7fdf4413e860 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf440663f0 0x7fdf441e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf440663f0 0x7fdf441e0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48270/0 (socket says 172.21.15.99:48270) 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 -- 172.21.15.99:0/3003448733 learned_addr learned my addr 172.21.15.99:0/3003448733 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf43fff640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf44066810 0x7fdf44138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 -- 172.21.15.99:0/3003448733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf4413e860 msgr2=0x7fdf441439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf4413e860 0x7fdf441439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 -- 172.21.15.99:0/3003448733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf44066810 msgr2=0x7fdf44138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf44066810 0x7fdf44138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 -- 172.21.15.99:0/3003448733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf38009420 con 0x7fdf440663f0 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf48d55640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf440663f0 0x7fdf441e0c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00ba80 tx=0x7fdf3c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf417fa640 1 -- 172.21.15.99:0/3003448733 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00cc00 con 0x7fdf440663f0 2024-01-19T05:18:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf417fa640 1 -- 172.21.15.99:0/3003448733 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c00cd80 con 0x7fdf440663f0 2024-01-19T05:18:43.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf417fa640 1 -- 172.21.15.99:0/3003448733 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c014680 con 0x7fdf440663f0 2024-01-19T05:18:43.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf441e0420 con 0x7fdf440663f0 2024-01-19T05:18:43.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4413d920 con 0x7fdf440663f0 2024-01-19T05:18:43.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf44066e10 con 0x7fdf440663f0 2024-01-19T05:18:43.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf417fa640 1 -- 172.21.15.99:0/3003448733 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdf3c01d3b0 con 0x7fdf440663f0 2024-01-19T05:18:43.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf417fa640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdf30066500 0x7fdf300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf417fa640 1 -- 172.21.15.99:0/3003448733 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf3c083ad0 con 0x7fdf440663f0 2024-01-19T05:18:43.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf43fff640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdf30066500 0x7fdf300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.416+0000 7fdf43fff640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdf30066500 0x7fdf300689c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdf34000f70 tx=0x7fdf34009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.420+0000 7fdf417fa640 1 -- 172.21.15.99:0/3003448733 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fdf3c051150 con 0x7fdf440663f0 2024-01-19T05:18:43.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.632+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdf440696e0 con 0x7fdf440663f0 2024-01-19T05:18:43.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf417fa640 1 -- 172.21.15.99:0/3003448733 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdf3c0190a0 con 0x7fdf440663f0 2024-01-19T05:18:43.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdf30066500 msgr2=0x7fdf300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdf30066500 0x7fdf300689c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdf34000f70 tx=0x7fdf34009040 comp rx=0 tx=0).stop 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf440663f0 msgr2=0x7fdf441e0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf440663f0 0x7fdf441e0c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00ba80 tx=0x7fdf3c00bf40 comp rx=0 tx=0).stop 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 shutdown_connections 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdf30066500 0x7fdf300689c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf4413e860 0x7fdf441439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf44066810 0x7fdf44138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 --2- 172.21.15.99:0/3003448733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf440663f0 0x7fdf441e0c20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 >> 172.21.15.99:0/3003448733 conn(0x7fdf4406ad70 msgr2=0x7fdf440b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 shutdown_connections 2024-01-19T05:18:43.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.636+0000 7fdf4afb9640 1 -- 172.21.15.99:0/3003448733 wait complete. 2024-01-19T05:18:43.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:43.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1449fc5640 1 Processor -- start 2024-01-19T05:18:43.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1449fc5640 1 -- start start 2024-01-19T05:18:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1449fc5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14440b19f0 0x7f144406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1449fc5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14440724f0 0x7f1444145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1449fc5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1444070680 con 0x7f1444144c70 2024-01-19T05:18:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1449fc5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1444070410 con 0x7f14440b19f0 2024-01-19T05:18:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1449fc5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1444144790 con 0x7f14440724f0 2024-01-19T05:18:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1442ffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1444144c70 0x7f1444071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42872/0 (socket says 172.21.15.99:42872) 2024-01-19T05:18:43.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1442ffd640 1 -- 172.21.15.99:0/1914897387 learned_addr learned my addr 172.21.15.99:0/1914897387 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14437fe640 1 --2- 172.21.15.99:0/1914897387 >> v2:172.21.15.157:3300/0 conn(0x7f14440b19f0 0x7f144406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1443fff640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14440724f0 0x7f1444145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555156074 0 0) 0x7f1444070680 con 0x7f1444144c70 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f142c003530 con 0x7f1444144c70 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2062652103 0 0) 0x7f142c003530 con 0x7f1444144c70 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14440724f0 msgr2=0x7f1444145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14440724f0 0x7f1444145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 >> v2:172.21.15.157:3300/0 conn(0x7f14440b19f0 msgr2=0x7f144406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 --2- 172.21.15.99:0/1914897387 >> v2:172.21.15.157:3300/0 conn(0x7f14440b19f0 0x7f144406ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144406f2b0 con 0x7f1444144c70 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f1434001680 con 0x7f1444144c70 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 >> v1:172.21.15.99:6789/0 conn(0x7f1444144c70 legacy=0x7f1444071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c003980 0x7f142c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0047d0 0x7f142c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14440724f0 0x7f142c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1444070410 con 0x7f142c0047d0 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1444144790 con 0x7f142c003980 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c00b990 con 0x7f14440724f0 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1442ffd640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0047d0 0x7f142c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f14437fe640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c003980 0x7f142c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1443fff640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14440724f0 0x7f142c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1442ffd640 1 -- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14440724f0 msgr2=0x7f142c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1442ffd640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14440724f0 0x7f142c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1442ffd640 1 -- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c003980 msgr2=0x7f142c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1442ffd640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c003980 0x7f142c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.772+0000 7f1442ffd640 1 -- 172.21.15.99:0/1914897387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c003530 con 0x7f142c0047d0 2024-01-19T05:18:43.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1442ffd640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0047d0 0x7f142c004c50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f143400c270 tx=0x7f143401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1e17f6a6f6c14e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14340058e0 con 0x7f142c0047d0 2024-01-19T05:18:43.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1434005a40 con 0x7f142c0047d0 2024-01-19T05:18:43.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f14427fc640 1 -- 172.21.15.99:0/1914897387 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434005e10 con 0x7f142c0047d0 2024-01-19T05:18:43.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- 172.21.15.99:0/1914897387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0047d0 msgr2=0x7f142c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 --2- 172.21.15.99:0/1914897387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0047d0 0x7f142c004c50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f143400c270 tx=0x7f143401cc10 comp rx=0 tx=0).stop 2024-01-19T05:18:43.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1443fff640 1 -- 172.21.15.99:0/1914897387 reap_dead start 2024-01-19T05:18:43.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- 172.21.15.99:0/1914897387 shutdown_connections 2024-01-19T05:18:43.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- 172.21.15.99:0/1914897387 >> 172.21.15.99:0/1914897387 conn(0x7f14440b8080 msgr2=0x7f14440b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:43.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- 172.21.15.99:0/1914897387 shutdown_connections 2024-01-19T05:18:43.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- 172.21.15.99:0/1914897387 wait complete. 2024-01-19T05:18:43.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 Processor -- start 2024-01-19T05:18:43.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- start start 2024-01-19T05:18:43.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c0047d0 0x7f144413dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f144413e580 0x7f1444138010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1444138550 0x7f14441e0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144413ed20 con 0x7f144413e580 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144413f300 con 0x7f142c0047d0 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1449fc5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1444138a00 con 0x7f1444138550 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1442ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f144413e580 0x7f1444138010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1442ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f144413e580 0x7f1444138010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48286/0 (socket says 172.21.15.99:48286) 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.776+0000 7f1442ffd640 1 -- 172.21.15.99:0/1161638970 learned_addr learned my addr 172.21.15.99:0/1161638970 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f14437fe640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c0047d0 0x7f144413dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1442ffd640 1 -- 172.21.15.99:0/1161638970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1444138550 msgr2=0x7f14441e0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1442ffd640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1444138550 0x7f14441e0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1442ffd640 1 -- 172.21.15.99:0/1161638970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c0047d0 msgr2=0x7f144413dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1442ffd640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c0047d0 0x7f144413dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1442ffd640 1 -- 172.21.15.99:0/1161638970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144413ef70 con 0x7f144413e580 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f14437fe640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c0047d0 0x7f144413dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:43.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1442ffd640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f144413e580 0x7f1444138010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1434007040 tx=0x7f142c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f142bfff640 1 -- 172.21.15.99:0/1161638970 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14340a5a90 con 0x7f144413e580 2024-01-19T05:18:43.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f142bfff640 1 -- 172.21.15.99:0/1161638970 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14340a5bf0 con 0x7f144413e580 2024-01-19T05:18:43.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144414cb70 con 0x7f144413e580 2024-01-19T05:18:43.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f142bfff640 1 -- 172.21.15.99:0/1161638970 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434005e80 con 0x7f144413e580 2024-01-19T05:18:43.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144413f960 con 0x7f144413e580 2024-01-19T05:18:43.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14440b65f0 con 0x7f144413e580 2024-01-19T05:18:43.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f142bfff640 1 -- 172.21.15.99:0/1161638970 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f14340047f0 con 0x7f144413e580 2024-01-19T05:18:43.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f142bfff640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1430066530 0x7f14300689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:43.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f142bfff640 1 -- 172.21.15.99:0/1161638970 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f143411d570 con 0x7f144413e580 2024-01-19T05:18:43.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f14437fe640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1430066530 0x7f14300689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:43.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.780+0000 7f14437fe640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1430066530 0x7f14300689f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1438009a20 tx=0x7f1438008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:43.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.784+0000 7f142bfff640 1 -- 172.21.15.99:0/1161638970 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f14340eab50 con 0x7f144413e580 2024-01-19T05:18:43.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.928+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f144406f7a0 con 0x7f144413e580 2024-01-19T05:18:43.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f142bfff640 1 -- 172.21.15.99:0/1161638970 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+12822 (secure 0 0 0) 0x7f143411d020 con 0x7f144413e580 2024-01-19T05:18:43.931 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:43.931 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:41.154832+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:43.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1430066530 msgr2=0x7f14300689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1430066530 0x7f14300689f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1438009a20 tx=0x7f1438008040 comp rx=0 tx=0).stop 2024-01-19T05:18:43.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f144413e580 msgr2=0x7f1444138010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:43.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f144413e580 0x7f1444138010 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1434007040 tx=0x7f142c005800 comp rx=0 tx=0).stop 2024-01-19T05:18:43.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 shutdown_connections 2024-01-19T05:18:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1430066530 0x7f14300689f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1444138550 0x7f14441e0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f144413e580 0x7f1444138010 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 --2- 172.21.15.99:0/1161638970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f142c0047d0 0x7f144413dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 >> 172.21.15.99:0/1161638970 conn(0x7f14440b8080 msgr2=0x7f14440b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 shutdown_connections 2024-01-19T05:18:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:43.932+0000 7f1449fc5640 1 -- 172.21.15.99:0/1161638970 wait complete. 2024-01-19T05:18:43.949 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:18:43.949 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:18:44.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.068+0000 7f711f2cf640 1 Processor -- start 2024-01-19T05:18:44.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.068+0000 7f711f2cf640 1 -- start start 2024-01-19T05:18:44.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f71180b19f0 0x7f711806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f71180724f0 0x7f7118145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7118070680 con 0x7f7118144c70 2024-01-19T05:18:44.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7118070410 con 0x7f71180724f0 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7118144790 con 0x7f71180b19f0 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711d86c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f71180724f0 0x7f7118145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711c86a640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7118144c70 0x7f7118071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42886/0 (socket says 172.21.15.99:42886) 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711c86a640 1 -- 172.21.15.99:0/860654183 learned_addr learned my addr 172.21.15.99:0/860654183 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711d06b640 1 --2- 172.21.15.99:0/860654183 >> v2:172.21.15.157:3300/0 conn(0x7f71180b19f0 0x7f711806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711d86c640 1 -- 172.21.15.99:0/860654183 >> v2:172.21.15.157:3300/0 conn(0x7f71180b19f0 msgr2=0x7f711806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f710ffff640 1 -- 172.21.15.99:0/860654183 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152906629 0 0) 0x7f7118070680 con 0x7f7118144c70 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711d86c640 1 --2- 172.21.15.99:0/860654183 >> v2:172.21.15.157:3300/0 conn(0x7f71180b19f0 0x7f711806ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711d86c640 1 -- 172.21.15.99:0/860654183 >> v1:172.21.15.99:6789/0 conn(0x7f7118144c70 legacy=0x7f7118071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711d86c640 1 -- 172.21.15.99:0/860654183 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711806f2b0 con 0x7f71180724f0 2024-01-19T05:18:44.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711d06b640 1 --2- 172.21.15.99:0/860654183 >> v2:172.21.15.157:3300/0 conn(0x7f71180b19f0 0x7f711806ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:44.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711d86c640 1 --2- 172.21.15.99:0/860654183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f7118145100 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f711806d030 tx=0x7f711401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f465c305b83a3e90 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f710ffff640 1 -- 172.21.15.99:0/860654183 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71140ab600 con 0x7f71180724f0 2024-01-19T05:18:44.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f710ffff640 1 -- 172.21.15.99:0/860654183 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71140a7050 con 0x7f71180724f0 2024-01-19T05:18:44.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f710ffff640 1 -- 172.21.15.99:0/860654183 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71140ab980 con 0x7f71180724f0 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 -- 172.21.15.99:0/860654183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 msgr2=0x7f7118145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 --2- 172.21.15.99:0/860654183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f7118145100 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f711806d030 tx=0x7f711401c3d0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 -- 172.21.15.99:0/860654183 shutdown_connections 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 --2- 172.21.15.99:0/860654183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f7118145100 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 --2- 172.21.15.99:0/860654183 >> v2:172.21.15.157:3300/0 conn(0x7f71180b19f0 0x7f711806ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 -- 172.21.15.99:0/860654183 >> 172.21.15.99:0/860654183 conn(0x7f71180b8080 msgr2=0x7f71180b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 -- 172.21.15.99:0/860654183 shutdown_connections 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.072+0000 7f711f2cf640 1 -- 172.21.15.99:0/860654183 wait complete. 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 Processor -- start 2024-01-19T05:18:44.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 -- start start 2024-01-19T05:18:44.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f71180b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71180b19f0 0x7f71181df130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7118144c70 0x7f71181df670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711813e9f0 con 0x7f71180724f0 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71181dece0 con 0x7f71180b19f0 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711813e7a0 con 0x7f7118144c70 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f71180b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f71180b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48304/0 (socket says 172.21.15.99:48304) 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 -- 172.21.15.99:0/952989239 learned_addr learned my addr 172.21.15.99:0/952989239 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711c86a640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71180b19f0 0x7f71181df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d86c640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7118144c70 0x7f71181df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 -- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7118144c70 msgr2=0x7f71181df670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7118144c70 0x7f71181df670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 -- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71180b19f0 msgr2=0x7f71181df130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71180b19f0 0x7f71181df130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 -- 172.21.15.99:0/952989239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009420 con 0x7f71180724f0 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d86c640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7118144c70 0x7f71181df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711d06b640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f71180b1190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f711000cf60 tx=0x7f711000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f710dffb640 1 -- 172.21.15.99:0/952989239 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000d840 con 0x7f71180724f0 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f710dffb640 1 -- 172.21.15.99:0/952989239 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711000d9a0 con 0x7f71180724f0 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711813f530 con 0x7f71180724f0 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f710dffb640 1 -- 172.21.15.99:0/952989239 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000dd30 con 0x7f71180724f0 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711813fa80 con 0x7f71180724f0 2024-01-19T05:18:44.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.076+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71180696e0 con 0x7f71180724f0 2024-01-19T05:18:44.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.080+0000 7f710dffb640 1 -- 172.21.15.99:0/952989239 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7110015440 con 0x7f71180724f0 2024-01-19T05:18:44.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.080+0000 7f710dffb640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f70fc066500 0x7f70fc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.080+0000 7f710dffb640 1 -- 172.21.15.99:0/952989239 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7110084c10 con 0x7f71180724f0 2024-01-19T05:18:44.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.080+0000 7f711c86a640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f70fc066500 0x7f70fc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.080+0000 7f711c86a640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f70fc066500 0x7f70fc0689c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f711813e0a0 tx=0x7f7108009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.084+0000 7f710dffb640 1 -- 172.21.15.99:0/952989239 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7110052420 con 0x7f71180724f0 2024-01-19T05:18:44.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.236+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7118142030 con 0x7f71180724f0 2024-01-19T05:18:44.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.236+0000 7f710dffb640 1 -- 172.21.15.99:0/952989239 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7110024020 con 0x7f71180724f0 2024-01-19T05:18:44.237 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:18:44.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f70fc066500 msgr2=0x7f70fc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f70fc066500 0x7f70fc0689c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f711813e0a0 tx=0x7f7108009040 comp rx=0 tx=0).stop 2024-01-19T05:18:44.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 msgr2=0x7f71180b1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f71180b1190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f711000cf60 tx=0x7f711000cf90 comp rx=0 tx=0).stop 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 shutdown_connections 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f70fc066500 0x7f70fc0689c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7118144c70 0x7f71181df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71180b19f0 0x7f71181df130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 --2- 172.21.15.99:0/952989239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71180724f0 0x7f71180b1190 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 >> 172.21.15.99:0/952989239 conn(0x7f71180b8080 msgr2=0x7f71180b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 shutdown_connections 2024-01-19T05:18:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.240+0000 7f711f2cf640 1 -- 172.21.15.99:0/952989239 wait complete. 2024-01-19T05:18:44.254 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-19T05:18:44.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae2d61640 1 Processor -- start 2024-01-19T05:18:44.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae2d61640 1 -- start start 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae2d61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6adc147110 0x7f6adc147550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae2d61640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6adc140290 0x7f6adc140700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae2d61640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc146c80 con 0x7f6adc06e0e0 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae2d61640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc06e4c0 con 0x7f6adc140290 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae2d61640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc146930 con 0x7f6adc147110 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae0afd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6adc06e0e0 0x7f6adc14a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42902/0 (socket says 172.21.15.99:42902) 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae0afd640 1 -- 172.21.15.99:0/3495882987 learned_addr learned my addr 172.21.15.99:0/3495882987 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189387166 0 0) 0x7f6adc146c80 con 0x7f6adc06e0e0 2024-01-19T05:18:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac4003530 con 0x7f6adc06e0e0 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae12fe640 1 --2- 172.21.15.99:0/3495882987 >> v2:172.21.15.157:3300/0 conn(0x7f6adc140290 0x7f6adc140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adbfff640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6adc147110 0x7f6adc147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509080646 0 0) 0x7f6ac4003530 con 0x7f6adc06e0e0 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6adc147110 msgr2=0x7f6adc147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6adc147110 0x7f6adc147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 >> v2:172.21.15.157:3300/0 conn(0x7f6adc140290 msgr2=0x7f6adc140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 --2- 172.21.15.99:0/3495882987 >> v2:172.21.15.157:3300/0 conn(0x7f6adc140290 0x7f6adc140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc14abf0 con 0x7f6adc06e0e0 2024-01-19T05:18:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f6acc001680 con 0x7f6adc06e0e0 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 >> v1:172.21.15.99:6789/0 conn(0x7f6adc06e0e0 legacy=0x7f6adc14a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac4003980 0x7f6ac4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6adc147110 0x7f6ac40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac4004d10 0x7f6ac4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc06e4c0 con 0x7f6ac4003980 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc146930 con 0x7f6ac4004d10 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400ba40 con 0x7f6adc147110 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae0afd640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac4003980 0x7f6ac4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae12fe640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac4004d10 0x7f6ac4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6adbfff640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6adc147110 0x7f6ac40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae0afd640 1 -- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6adc147110 msgr2=0x7f6ac40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae0afd640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6adc147110 0x7f6ac40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae0afd640 1 -- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac4004d10 msgr2=0x7f6ac4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae0afd640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac4004d10 0x7f6ac4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae0afd640 1 -- 172.21.15.99:0/3495882987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4003530 con 0x7f6ac4003980 2024-01-19T05:18:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.368+0000 7f6ae12fe640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ac4004d10 0x7f6ac4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:44.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae0afd640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac4003980 0x7f6ac4003da0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c210 tx=0x7f6acc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7202f39c7823b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0058e0 con 0x7f6ac4003980 2024-01-19T05:18:44.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc005a40 con 0x7f6ac4003980 2024-01-19T05:18:44.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6adb7fe640 1 -- 172.21.15.99:0/3495882987 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc005e10 con 0x7f6ac4003980 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3495882987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac4003980 msgr2=0x7f6ac4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 --2- 172.21.15.99:0/3495882987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ac4003980 0x7f6ac4003da0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c210 tx=0x7f6acc01cc60 comp rx=0 tx=0).stop 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 -- 172.21.15.99:0/3495882987 reap_dead start 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3495882987 shutdown_connections 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3495882987 >> 172.21.15.99:0/3495882987 conn(0x7f6adc0ba500 msgr2=0x7f6adc0ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3495882987 shutdown_connections 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3495882987 wait complete. 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 Processor -- start 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- start start 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ac4003980 0x7f6adc09a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc099fb0 0x7f6adc1e2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6adc13e880 0x7f6adc13ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc099b20 con 0x7f6adc13e880 2024-01-19T05:18:44.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1e3000 con 0x7f6adc099fb0 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc09c500 con 0x7f6ac4003980 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6adc13e880 0x7f6adc13ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6adc13e880 0x7f6adc13ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48322/0 (socket says 172.21.15.99:48322) 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 -- 172.21.15.99:0/3561784175 learned_addr learned my addr 172.21.15.99:0/3561784175 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae0afd640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ac4003980 0x7f6adc09a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6adbfff640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc099fb0 0x7f6adc1e2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 -- 172.21.15.99:0/3561784175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ac4003980 msgr2=0x7f6adc09a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ac4003980 0x7f6adc09a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 -- 172.21.15.99:0/3561784175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc099fb0 msgr2=0x7f6adc1e2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc099fb0 0x7f6adc1e2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 -- 172.21.15.99:0/3561784175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc09c220 con 0x7f6adc13e880 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae12fe640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6adc13e880 0x7f6adc13ed00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009fd0 tx=0x7f6ad400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ad97fa640 1 -- 172.21.15.99:0/3561784175 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4017400 con 0x7f6adc13e880 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ad97fa640 1 -- 172.21.15.99:0/3561784175 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4011040 con 0x7f6adc13e880 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ad97fa640 1 -- 172.21.15.99:0/3561784175 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4017780 con 0x7f6adc13e880 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc14c160 con 0x7f6adc13e880 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.372+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0b9a90 con 0x7f6adc13e880 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.376+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc0b5d40 con 0x7f6adc13e880 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.376+0000 7f6ad97fa640 1 -- 172.21.15.99:0/3561784175 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6ad40203b0 con 0x7f6adc13e880 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.376+0000 7f6ad97fa640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ac8066530 0x7f6ac80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.376+0000 7f6ad97fa640 1 -- 172.21.15.99:0/3561784175 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ad4083d70 con 0x7f6adc13e880 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.376+0000 7f6ae0afd640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ac8066530 0x7f6ac80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.376+0000 7f6ae0afd640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ac8066530 0x7f6ac80689f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0aa000 tx=0x7f6acc001a10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.380+0000 7f6ad97fa640 1 -- 172.21.15.99:0/3561784175 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6ad40513f0 con 0x7f6adc13e880 2024-01-19T05:18:44.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6adc099cd0 con 0x7f6adc13e880 2024-01-19T05:18:44.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ad97fa640 1 -- 172.21.15.99:0/3561784175 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v25) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6adc099cd0 con 0x7f6adc13e880 2024-01-19T05:18:44.535 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:44.535 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-01-19T05:18:44.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-19T05:18:44.535 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-01-19T05:18:44.535 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-01-19T05:18:44.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:44.535 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-01-19T05:18:44.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ac8066530 msgr2=0x7f6ac80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ac8066530 0x7f6ac80689f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0aa000 tx=0x7f6acc001a10 comp rx=0 tx=0).stop 2024-01-19T05:18:44.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6adc13e880 msgr2=0x7f6adc13ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6adc13e880 0x7f6adc13ed00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009fd0 tx=0x7f6ad400f4a0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 shutdown_connections 2024-01-19T05:18:44.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6ac8066530 0x7f6ac80689f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6adc13e880 0x7f6adc13ed00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6adc099fb0 0x7f6adc1e2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 --2- 172.21.15.99:0/3561784175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ac4003980 0x7f6adc09a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 >> 172.21.15.99:0/3561784175 conn(0x7f6adc0ba500 msgr2=0x7f6adc0b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:44.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 shutdown_connections 2024-01-19T05:18:44.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.536+0000 7f6ae2d61640 1 -- 172.21.15.99:0/3561784175 wait complete. 2024-01-19T05:18:44.552 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-19T05:18:44.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68db5cd640 1 Processor -- start 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68db5cd640 1 -- start start 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68db5cd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f68d406ebe0 0x7f68d4071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68db5cd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d4072320 0x7f68d414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68db5cd640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d406f070 con 0x7f68d40b19f0 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68db5cd640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d4070680 con 0x7f68d406ebe0 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68db5cd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4070410 con 0x7f68d4072320 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d8b68640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f68d406ebe0 0x7f68d4071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d8b68640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f68d406ebe0 0x7f68d4071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48328/0 (socket says 172.21.15.99:48328) 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d8b68640 1 -- 172.21.15.99:0/2559684751 learned_addr learned my addr 172.21.15.99:0/2559684751 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d9b6a640 1 --2- 172.21.15.99:0/2559684751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d4072320 0x7f68d414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d8b68640 1 -- 172.21.15.99:0/2559684751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d4072320 msgr2=0x7f68d414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:44.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d8b68640 1 --2- 172.21.15.99:0/2559684751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d4072320 0x7f68d414ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d8b68640 1 -- 172.21.15.99:0/2559684751 >> v1:172.21.15.157:6789/0 conn(0x7f68d40b19f0 legacy=0x7f68d4144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:44.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d8b68640 1 -- 172.21.15.99:0/2559684751 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4144790 con 0x7f68d406ebe0 2024-01-19T05:18:44.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68d8b68640 1 --2- 172.21.15.99:0/2559684751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d406ebe0 0x7f68d4071de0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009870 tx=0x7f68c401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5309c70801e3530 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68cbfff640 1 -- 172.21.15.99:0/2559684751 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40ab620 con 0x7f68d406ebe0 2024-01-19T05:18:44.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68cbfff640 1 -- 172.21.15.99:0/2559684751 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c40ab780 con 0x7f68d406ebe0 2024-01-19T05:18:44.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.668+0000 7f68cbfff640 1 -- 172.21.15.99:0/2559684751 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40abb10 con 0x7f68d406ebe0 2024-01-19T05:18:44.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- 172.21.15.99:0/2559684751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d406ebe0 msgr2=0x7f68d4071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 --2- 172.21.15.99:0/2559684751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d406ebe0 0x7f68d4071de0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009870 tx=0x7f68c401c440 comp rx=0 tx=0).stop 2024-01-19T05:18:44.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- 172.21.15.99:0/2559684751 shutdown_connections 2024-01-19T05:18:44.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 --2- 172.21.15.99:0/2559684751 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d4072320 0x7f68d414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 --2- 172.21.15.99:0/2559684751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d406ebe0 0x7f68d4071de0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- 172.21.15.99:0/2559684751 >> 172.21.15.99:0/2559684751 conn(0x7f68d40b8080 msgr2=0x7f68d40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:44.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- 172.21.15.99:0/2559684751 shutdown_connections 2024-01-19T05:18:44.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- 172.21.15.99:0/2559684751 wait complete. 2024-01-19T05:18:44.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 Processor -- start 2024-01-19T05:18:44.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- start start 2024-01-19T05:18:44.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d406ebe0 0x7f68d4131d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d4072320 0x7f68d412ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d40b19f0 0x7f68d40b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4131010 con 0x7f68d4072320 2024-01-19T05:18:44.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d40b6090 con 0x7f68d40b19f0 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4133410 con 0x7f68d406ebe0 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d4072320 0x7f68d412ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d4072320 0x7f68d412ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48334/0 (socket says 172.21.15.99:48334) 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 -- 172.21.15.99:0/947072891 learned_addr learned my addr 172.21.15.99:0/947072891 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 -- 172.21.15.99:0/947072891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d406ebe0 msgr2=0x7f68d4131d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d9369640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d406ebe0 0x7f68d4131d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d9b6a640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d40b19f0 0x7f68d40b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d406ebe0 0x7f68d4131d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 -- 172.21.15.99:0/947072891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d40b19f0 msgr2=0x7f68d40b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d40b19f0 0x7f68d40b7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 -- 172.21.15.99:0/947072891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40094d0 con 0x7f68d4072320 2024-01-19T05:18:44.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68d8b68640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d4072320 0x7f68d412ad10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f68c401aaf0 tx=0x7f68c401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68c9ffb640 1 -- 172.21.15.99:0/947072891 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40be3f0 con 0x7f68d4072320 2024-01-19T05:18:44.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68c9ffb640 1 -- 172.21.15.99:0/947072891 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c40be550 con 0x7f68d4072320 2024-01-19T05:18:44.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68c9ffb640 1 -- 172.21.15.99:0/947072891 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40be900 con 0x7f68d4072320 2024-01-19T05:18:44.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d41336f0 con 0x7f68d4072320 2024-01-19T05:18:44.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.672+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d41344b0 con 0x7f68d4072320 2024-01-19T05:18:44.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.676+0000 7f68c9ffb640 1 -- 172.21.15.99:0/947072891 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f68c40c7440 con 0x7f68d4072320 2024-01-19T05:18:44.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.676+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d40b6c50 con 0x7f68d4072320 2024-01-19T05:18:44.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.676+0000 7f68c9ffb640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f68b8066500 0x7f68b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:44.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.676+0000 7f68d9369640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f68b8066500 0x7f68b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:44.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.676+0000 7f68c9ffb640 1 -- 172.21.15.99:0/947072891 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68c411e1e0 con 0x7f68d4072320 2024-01-19T05:18:44.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.676+0000 7f68d9369640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f68b8066500 0x7f68b80689c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68d000a750 tx=0x7f68d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:44.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.680+0000 7f68c9ffb640 1 -- 172.21.15.99:0/947072891 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f68d40b6c50 con 0x7f68d4072320 2024-01-19T05:18:44.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:44.824+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f68d40b7030 con 0x7f68d4072320 2024-01-19T05:18:45.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.288+0000 7f68c9ffb640 1 -- 172.21.15.99:0/947072891 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v26) v1 ==== 138+0+0 (secure 0 0 0) 0x7f68d40b7030 con 0x7f68d4072320 2024-01-19T05:18:45.287 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-01-19T05:18:45.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f68b8066500 msgr2=0x7f68b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f68b8066500 0x7f68b80689c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68d000a750 tx=0x7f68d0008040 comp rx=0 tx=0).stop 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d4072320 msgr2=0x7f68d412ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d4072320 0x7f68d412ad10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f68c401aaf0 tx=0x7f68c401ac80 comp rx=0 tx=0).stop 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 shutdown_connections 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f68b8066500 0x7f68b80689c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d40b19f0 0x7f68d40b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68d4072320 0x7f68d412ad10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 --2- 172.21.15.99:0/947072891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d406ebe0 0x7f68d4131d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 >> 172.21.15.99:0/947072891 conn(0x7f68d40b8080 msgr2=0x7f68d40735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 shutdown_connections 2024-01-19T05:18:45.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.292+0000 7f68db5cd640 1 -- 172.21.15.99:0/947072891 wait complete. 2024-01-19T05:18:45.317 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-19T05:18:45.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5ce1b20640 1 Processor -- start 2024-01-19T05:18:45.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5ce1b20640 1 -- start start 2024-01-19T05:18:45.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5ce1b20640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc06dc00 0x7f5cdc0b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5ce1b20640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5cdc06dfe0 0x7f5cdc1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5ce1b20640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc071d00 con 0x7f5cdc144c20 2024-01-19T05:18:45.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5ce1b20640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc071220 con 0x7f5cdc06dfe0 2024-01-19T05:18:45.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5ce1b20640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc071500 con 0x7f5cdc06dc00 2024-01-19T05:18:45.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdbfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5cdc144c20 0x7f5cdc0b4c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42914/0 (socket says 172.21.15.99:42914) 2024-01-19T05:18:45.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdbfff640 1 -- 172.21.15.99:0/4153892874 learned_addr learned my addr 172.21.15.99:0/4153892874 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdb7fe640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc06dc00 0x7f5cdc0b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdaffd640 1 --2- 172.21.15.99:0/4153892874 >> v2:172.21.15.157:3300/0 conn(0x7f5cdc06dfe0 0x7f5cdc1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68033610 0 0) 0x7f5cdc071d00 con 0x7f5cdc144c20 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc4003530 con 0x7f5cdc144c20 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431130457 0 0) 0x7f5cc4003530 con 0x7f5cdc144c20 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc06dc00 msgr2=0x7f5cdc0b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc06dc00 0x7f5cdc0b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 >> v2:172.21.15.157:3300/0 conn(0x7f5cdc06dfe0 msgr2=0x7f5cdc1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 --2- 172.21.15.99:0/4153892874 >> v2:172.21.15.157:3300/0 conn(0x7f5cdc06dfe0 0x7f5cdc1446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0717e0 con 0x7f5cdc144c20 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f5ccc001a20 con 0x7f5cdc144c20 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 >> v1:172.21.15.99:6789/0 conn(0x7f5cdc144c20 legacy=0x7f5cdc0b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc06dc00 0x7f5cc4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cc4003f00 0x7f5cc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cc4004d10 0x7f5cc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc071220 con 0x7f5cc4004d10 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc071500 con 0x7f5cc4003f00 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc400b9e0 con 0x7f5cdc06dc00 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdbfff640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cc4004d10 0x7f5cc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdb7fe640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc06dc00 0x7f5cc4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdaffd640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cc4003f00 0x7f5cc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdbfff640 1 -- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc06dc00 msgr2=0x7f5cc4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdbfff640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc06dc00 0x7f5cc4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdbfff640 1 -- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cc4003f00 msgr2=0x7f5cc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdbfff640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cc4003f00 0x7f5cc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdbfff640 1 -- 172.21.15.99:0/4153892874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4003530 con 0x7f5cc4004d10 2024-01-19T05:18:45.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.444+0000 7f5cdaffd640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cc4003f00 0x7f5cc40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:45.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5cdbfff640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cc4004d10 0x7f5cc4005190 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00a850 tx=0x7f5ccc01fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a6d2fc4a313fe9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:45.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0aa690 con 0x7f5cc4004d10 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0aa810 con 0x7f5cc4004d10 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5cda7fc640 1 -- 172.21.15.99:0/4153892874 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0aac00 con 0x7f5cc4004d10 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 -- 172.21.15.99:0/4153892874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cc4004d10 msgr2=0x7f5cc4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 --2- 172.21.15.99:0/4153892874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cc4004d10 0x7f5cc4005190 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00a850 tx=0x7f5ccc01fa60 comp rx=0 tx=0).stop 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5cdbfff640 1 -- 172.21.15.99:0/4153892874 reap_dead start 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 -- 172.21.15.99:0/4153892874 shutdown_connections 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 -- 172.21.15.99:0/4153892874 >> 172.21.15.99:0/4153892874 conn(0x7f5cdc066d70 msgr2=0x7f5cdc0ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 -- 172.21.15.99:0/4153892874 shutdown_connections 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 -- 172.21.15.99:0/4153892874 wait complete. 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 Processor -- start 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 -- start start 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cdc1472c0 0x7f5cdc1dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.448+0000 7f5ce1b20640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc1476a0 0x7f5cdc1dd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5ce1b20640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cdc1d9810 0x7f5cdc1d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5ce1b20640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b3e90 con 0x7f5cdc1472c0 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5ce1b20640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc146440 con 0x7f5cdc1d9810 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5ce1b20640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc1466e0 con 0x7f5cdc1476a0 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cdc1472c0 0x7f5cdc1dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cdc1472c0 0x7f5cdc1dcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48364/0 (socket says 172.21.15.99:48364) 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 -- 172.21.15.99:0/3702490441 learned_addr learned my addr 172.21.15.99:0/3702490441 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdaffd640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc1476a0 0x7f5cdc1dd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 -- 172.21.15.99:0/3702490441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc1476a0 msgr2=0x7f5cdc1dd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc1476a0 0x7f5cdc1dd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 -- 172.21.15.99:0/3702490441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cdc1d9810 msgr2=0x7f5cdc1d9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cdc1d9810 0x7f5cdc1d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 -- 172.21.15.99:0/3702490441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc147ba0 con 0x7f5cdc1472c0 2024-01-19T05:18:45.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdb7fe640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cdc1472c0 0x7f5cdc1dcdc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40115e0 tx=0x7f5cd4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:45.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cc3fff640 1 -- 172.21.15.99:0/3702490441 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4015870 con 0x7f5cdc1472c0 2024-01-19T05:18:45.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cc3fff640 1 -- 172.21.15.99:0/3702490441 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd40159d0 con 0x7f5cdc1472c0 2024-01-19T05:18:45.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc145840 con 0x7f5cdc1472c0 2024-01-19T05:18:45.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cc3fff640 1 -- 172.21.15.99:0/3702490441 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4015d40 con 0x7f5cdc1472c0 2024-01-19T05:18:45.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc1da3b0 con 0x7f5cdc1472c0 2024-01-19T05:18:45.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc1468a0 con 0x7f5cdc1472c0 2024-01-19T05:18:45.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cc3fff640 1 -- 172.21.15.99:0/3702490441 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5cd4026420 con 0x7f5cdc1472c0 2024-01-19T05:18:45.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cc3fff640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5cc8066500 0x7f5cc80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:45.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cc3fff640 1 -- 172.21.15.99:0/3702490441 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5cd4084420 con 0x7f5cdc1472c0 2024-01-19T05:18:45.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdaffd640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5cc8066500 0x7f5cc80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:45.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.452+0000 7f5cdaffd640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5cc8066500 0x7f5cc80689c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b8070 tx=0x7f5cd0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:45.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.456+0000 7f5cc3fff640 1 -- 172.21.15.99:0/3702490441 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5cd4051a10 con 0x7f5cdc1472c0 2024-01-19T05:18:45.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:45.616+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5cdc1da690 con 0x7f5cdc1472c0 2024-01-19T05:18:46.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.292+0000 7f5cc3fff640 1 -- 172.21.15.99:0/3702490441 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v27) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5cd4055030 con 0x7f5cdc1472c0 2024-01-19T05:18:46.291 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-01-19T05:18:46.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5cc8066500 msgr2=0x7f5cc80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:46.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5cc8066500 0x7f5cc80689c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b8070 tx=0x7f5cd0008040 comp rx=0 tx=0).stop 2024-01-19T05:18:46.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cdc1472c0 msgr2=0x7f5cdc1dcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:46.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cdc1472c0 0x7f5cdc1dcdc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40115e0 tx=0x7f5cd4011aa0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 shutdown_connections 2024-01-19T05:18:46.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5cc8066500 0x7f5cc80689c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5cdc1d9810 0x7f5cdc1d9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5cdc1476a0 0x7f5cdc1dd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 --2- 172.21.15.99:0/3702490441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cdc1472c0 0x7f5cdc1dcdc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.296+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 >> 172.21.15.99:0/3702490441 conn(0x7f5cdc066d70 msgr2=0x7f5cdc0b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:46.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.300+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 shutdown_connections 2024-01-19T05:18:46.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.304+0000 7f5ce1b20640 1 -- 172.21.15.99:0/3702490441 wait complete. 2024-01-19T05:18:46.334 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-19T05:18:46.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa2e8d640 1 Processor -- start 2024-01-19T05:18:46.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa2e8d640 1 -- start start 2024-01-19T05:18:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa2e8d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa9c1464c0 0x7faa9c146950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa2e8d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faa9c13fcc0 0x7faa9c1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa2e8d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9c0b29b0 con 0x7faa9c0b9220 2024-01-19T05:18:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa2e8d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9c0afda0 con 0x7faa9c1464c0 2024-01-19T05:18:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa2e8d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9c146e90 con 0x7faa9c13fcc0 2024-01-19T05:18:46.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faa9bfff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa9c1464c0 0x7faa9c146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa0c29640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faa9c0b9220 0x7faa9c0b1540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42930/0 (socket says 172.21.15.99:42930) 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa0c29640 1 -- 172.21.15.99:0/757081209 learned_addr learned my addr 172.21.15.99:0/757081209 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa142a640 1 --2- 172.21.15.99:0/757081209 >> v2:172.21.15.157:3300/0 conn(0x7faa9c13fcc0 0x7faa9c1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faa9bfff640 1 -- 172.21.15.99:0/757081209 >> v2:172.21.15.157:3300/0 conn(0x7faa9c13fcc0 msgr2=0x7faa9c1400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faa9bfff640 1 --2- 172.21.15.99:0/757081209 >> v2:172.21.15.157:3300/0 conn(0x7faa9c13fcc0 0x7faa9c1400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faa9bfff640 1 -- 172.21.15.99:0/757081209 >> v1:172.21.15.99:6789/0 conn(0x7faa9c0b9220 legacy=0x7faa9c0b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faa9bfff640 1 -- 172.21.15.99:0/757081209 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c0b1c50 con 0x7faa9c1464c0 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faaa142a640 1 --2- 172.21.15.99:0/757081209 >> v2:172.21.15.157:3300/0 conn(0x7faa9c13fcc0 0x7faa9c1400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:46.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.452+0000 7faa9b7fe640 1 -- 172.21.15.99:0/757081209 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109692438 0 0) 0x7faa9c0b29b0 con 0x7faa9c0b9220 2024-01-19T05:18:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.456+0000 7faa9bfff640 1 --2- 172.21.15.99:0/757081209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c146950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0aff40 tx=0x7faa9001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c384b1976efe09 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:46.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.456+0000 7faa9b7fe640 1 -- 172.21.15.99:0/757081209 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa900ac410 con 0x7faa9c1464c0 2024-01-19T05:18:46.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.456+0000 7faa9b7fe640 1 -- 172.21.15.99:0/757081209 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa900ac570 con 0x7faa9c1464c0 2024-01-19T05:18:46.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.456+0000 7faa9b7fe640 1 -- 172.21.15.99:0/757081209 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa900ac900 con 0x7faa9c1464c0 2024-01-19T05:18:46.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- 172.21.15.99:0/757081209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 msgr2=0x7faa9c146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:46.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/757081209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c146950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0aff40 tx=0x7faa9001c3b0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- 172.21.15.99:0/757081209 shutdown_connections 2024-01-19T05:18:46.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/757081209 >> v2:172.21.15.157:3300/0 conn(0x7faa9c13fcc0 0x7faa9c1400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/757081209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c146950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- 172.21.15.99:0/757081209 >> 172.21.15.99:0/757081209 conn(0x7faa9c06adf0 msgr2=0x7faa9c0b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:46.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- 172.21.15.99:0/757081209 shutdown_connections 2024-01-19T05:18:46.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- 172.21.15.99:0/757081209 wait complete. 2024-01-19T05:18:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 Processor -- start 2024-01-19T05:18:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- start start 2024-01-19T05:18:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa9c0b9220 0x7faa9c14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa9c13fcc0 0x7faa9c1de440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c13ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:46.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c13b160 con 0x7faa9c1464c0 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c13a790 con 0x7faa9c13fcc0 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c13be80 con 0x7faa9c0b9220 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c13ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c13ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48372/0 (socket says 172.21.15.99:48372) 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 -- 172.21.15.99:0/592223976 learned_addr learned my addr 172.21.15.99:0/592223976 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa0c29640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa9c0b9220 0x7faa9c14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faa9bfff640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa9c13fcc0 0x7faa9c1de440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 -- 172.21.15.99:0/592223976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa9c0b9220 msgr2=0x7faa9c14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa9c0b9220 0x7faa9c14c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 -- 172.21.15.99:0/592223976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa9c13fcc0 msgr2=0x7faa9c1de440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa9c13fcc0 0x7faa9c1de440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 -- 172.21.15.99:0/592223976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90009420 con 0x7faa9c1464c0 2024-01-19T05:18:46.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa142a640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c13ac20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00c820 tx=0x7faa8c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:46.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faa997fa640 1 -- 172.21.15.99:0/592223976 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c007a30 con 0x7faa9c1464c0 2024-01-19T05:18:46.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faa997fa640 1 -- 172.21.15.99:0/592223976 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8c007bd0 con 0x7faa9c1464c0 2024-01-19T05:18:46.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9c13c0f0 con 0x7faa9c1464c0 2024-01-19T05:18:46.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faa997fa640 1 -- 172.21.15.99:0/592223976 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00ce10 con 0x7faa9c1464c0 2024-01-19T05:18:46.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9c0b7e90 con 0x7faa9c1464c0 2024-01-19T05:18:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.460+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9c0696e0 con 0x7faa9c1464c0 2024-01-19T05:18:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.464+0000 7faa997fa640 1 -- 172.21.15.99:0/592223976 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faa8c0113f0 con 0x7faa9c1464c0 2024-01-19T05:18:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.464+0000 7faa997fa640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7faa88066500 0x7faa880689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.464+0000 7faa997fa640 1 -- 172.21.15.99:0/592223976 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5609+0+0 (secure 0 0 0) 0x7faa8c083f70 con 0x7faa9c1464c0 2024-01-19T05:18:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.464+0000 7faaa0c29640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7faa88066500 0x7faa880689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:46.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.464+0000 7faaa0c29640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7faa88066500 0x7faa880689c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa94007fd0 tx=0x7faa94007ee0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.468+0000 7faa997fa640 1 -- 172.21.15.99:0/592223976 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faa8c0b54d0 con 0x7faa9c1464c0 2024-01-19T05:18:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:46.660+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7faa9c13a8d0 con 0x7faa9c1464c0 2024-01-19T05:18:47.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.328+0000 7faa997fa640 1 -- 172.21.15.99:0/592223976 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7faa8c054d90 con 0x7faa9c1464c0 2024-01-19T05:18:47.332 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 4 and data pool 5 2024-01-19T05:18:47.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.340+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7faa88066500 msgr2=0x7faa880689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.340+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7faa88066500 0x7faa880689c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa94007fd0 tx=0x7faa94007ee0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.340+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 msgr2=0x7faa9c13ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.340+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c13ac20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00c820 tx=0x7faa8c00cce0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.360+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 shutdown_connections 2024-01-19T05:18:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.360+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7faa88066500 0x7faa880689c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.360+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa9c1464c0 0x7faa9c13ac20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.360+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa9c13fcc0 0x7faa9c1de440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.360+0000 7faaa2e8d640 1 --2- 172.21.15.99:0/592223976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faa9c0b9220 0x7faa9c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.360+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 >> 172.21.15.99:0/592223976 conn(0x7faa9c06adf0 msgr2=0x7faa9c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:47.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.360+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 shutdown_connections 2024-01-19T05:18:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.360+0000 7faaa2e8d640 1 -- 172.21.15.99:0/592223976 wait complete. 2024-01-19T05:18:47.384 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:47.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b4b17b640 1 Processor -- start 2024-01-19T05:18:47.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b4b17b640 1 -- start start 2024-01-19T05:18:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b4b17b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7b4406a940 0x7f7b4409e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b4b17b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7b4409d9f0 0x7f7b4413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b4b17b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b440b4c10 con 0x7f7b4409d590 2024-01-19T05:18:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b4b17b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b440b4900 con 0x7f7b4406a940 2024-01-19T05:18:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b4b17b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4409ddd0 con 0x7f7b4409d9f0 2024-01-19T05:18:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b48f17640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7b4406a940 0x7f7b4409e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b43fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7b4409d590 0x7f7b4413e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42936/0 (socket says 172.21.15.99:42936) 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b43fff640 1 -- 172.21.15.99:0/987187771 learned_addr learned my addr 172.21.15.99:0/987187771 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b437fe640 1 -- 172.21.15.99:0/987187771 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442090428 0 0) 0x7f7b440b4c10 con 0x7f7b4409d590 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b437fe640 1 -- 172.21.15.99:0/987187771 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b2c003530 con 0x7f7b4409d590 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b49718640 1 --2- 172.21.15.99:0/987187771 >> v2:172.21.15.157:3300/0 conn(0x7f7b4409d9f0 0x7f7b4413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b48f17640 1 -- 172.21.15.99:0/987187771 >> v2:172.21.15.157:3300/0 conn(0x7f7b4409d9f0 msgr2=0x7f7b4413ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b48f17640 1 --2- 172.21.15.99:0/987187771 >> v2:172.21.15.157:3300/0 conn(0x7f7b4409d9f0 0x7f7b4413ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b48f17640 1 -- 172.21.15.99:0/987187771 >> v1:172.21.15.99:6789/0 conn(0x7f7b4409d590 legacy=0x7f7b4413e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b48f17640 1 -- 172.21.15.99:0/987187771 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4409cbe0 con 0x7f7b4406a940 2024-01-19T05:18:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.500+0000 7f7b49718640 1 --2- 172.21.15.99:0/987187771 >> v2:172.21.15.157:3300/0 conn(0x7f7b4409d9f0 0x7f7b4413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:47.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b48f17640 1 --2- 172.21.15.99:0/987187771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4406a940 0x7f7b4409e190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7b4406dc20 tx=0x7f7b3801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f581cb6662fd73 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:47.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b437fe640 1 -- 172.21.15.99:0/987187771 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b380ab600 con 0x7f7b4406a940 2024-01-19T05:18:47.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b437fe640 1 -- 172.21.15.99:0/987187771 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b380a7050 con 0x7f7b4406a940 2024-01-19T05:18:47.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b437fe640 1 -- 172.21.15.99:0/987187771 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b380ab980 con 0x7f7b4406a940 2024-01-19T05:18:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- 172.21.15.99:0/987187771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4406a940 msgr2=0x7f7b4409e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/987187771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4406a940 0x7f7b4409e190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7b4406dc20 tx=0x7f7b3801c340 comp rx=0 tx=0).stop 2024-01-19T05:18:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- 172.21.15.99:0/987187771 shutdown_connections 2024-01-19T05:18:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/987187771 >> v2:172.21.15.157:3300/0 conn(0x7f7b4409d9f0 0x7f7b4413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/987187771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4406a940 0x7f7b4409e190 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- 172.21.15.99:0/987187771 >> 172.21.15.99:0/987187771 conn(0x7f7b44066ef0 msgr2=0x7f7b440b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- 172.21.15.99:0/987187771 shutdown_connections 2024-01-19T05:18:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- 172.21.15.99:0/987187771 wait complete. 2024-01-19T05:18:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 Processor -- start 2024-01-19T05:18:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- start start 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b4406a940 0x7f7b4413cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4409d590 0x7f7b441e2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b4409d9f0 0x7f7b44136240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440b00c0 con 0x7f7b4409d590 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b441e20a0 con 0x7f7b4409d9f0 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b4b17b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4406ffb0 con 0x7f7b4406a940 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4409d590 0x7f7b441e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4409d590 0x7f7b441e2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48390/0 (socket says 172.21.15.99:48390) 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 -- 172.21.15.99:0/2185808408 learned_addr learned my addr 172.21.15.99:0/2185808408 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 -- 172.21.15.99:0/2185808408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b4406a940 msgr2=0x7f7b4413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b48f17640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b4406a940 0x7f7b4413cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b49718640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b4409d9f0 0x7f7b44136240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b4406a940 0x7f7b4413cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 -- 172.21.15.99:0/2185808408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b4409d9f0 msgr2=0x7f7b44136240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b4409d9f0 0x7f7b44136240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 -- 172.21.15.99:0/2185808408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38009420 con 0x7f7b4409d590 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.504+0000 7f7b43fff640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4409d590 0x7f7b441e2530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c480 tx=0x7f7b3400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b417fa640 1 -- 172.21.15.99:0/2185808408 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34005cf0 con 0x7f7b4409d590 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b417fa640 1 -- 172.21.15.99:0/2185808408 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34005e50 con 0x7f7b4409d590 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b44070db0 con 0x7f7b4409d590 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b417fa640 1 -- 172.21.15.99:0/2185808408 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34007290 con 0x7f7b4409d590 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4406fcd0 con 0x7f7b4409d590 2024-01-19T05:18:47.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b441e2250 con 0x7f7b4409d590 2024-01-19T05:18:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b417fa640 1 -- 172.21.15.99:0/2185808408 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7b340073f0 con 0x7f7b4409d590 2024-01-19T05:18:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b417fa640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7b30066500 0x7f7b300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b417fa640 1 -- 172.21.15.99:0/2185808408 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b34083440 con 0x7f7b4409d590 2024-01-19T05:18:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b48f17640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7b30066500 0x7f7b300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.508+0000 7f7b48f17640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7b30066500 0x7f7b300689c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b4406db60 tx=0x7f7b38008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:47.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.512+0000 7f7b417fa640 1 -- 172.21.15.99:0/2185808408 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7b441e2250 con 0x7f7b4409d590 2024-01-19T05:18:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.668+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b441e2250 con 0x7f7b4409d590 2024-01-19T05:18:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b417fa640 1 -- 172.21.15.99:0/2185808408 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+16547 (secure 0 0 0) 0x7f7b441e2250 con 0x7f7b4409d590 2024-01-19T05:18:47.670 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:47.670 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":28,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:46.663158+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:44.862843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:45.655715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:47.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7b30066500 msgr2=0x7f7b300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7b30066500 0x7f7b300689c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b4406db60 tx=0x7f7b38008040 comp rx=0 tx=0).stop 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4409d590 msgr2=0x7f7b441e2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4409d590 0x7f7b441e2530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c480 tx=0x7f7b3400c940 comp rx=0 tx=0).stop 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 shutdown_connections 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7b30066500 0x7f7b300689c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b4409d9f0 0x7f7b44136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b4409d590 0x7f7b441e2530 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 --2- 172.21.15.99:0/2185808408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b4406a940 0x7f7b4413cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 >> 172.21.15.99:0/2185808408 conn(0x7f7b44066ef0 msgr2=0x7f7b441425e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 shutdown_connections 2024-01-19T05:18:47.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.672+0000 7f7b4b17b640 1 -- 172.21.15.99:0/2185808408 wait complete. 2024-01-19T05:18:47.690 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:47.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.804+0000 7f58091f7640 1 Processor -- start 2024-01-19T05:18:47.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.804+0000 7f58091f7640 1 -- start start 2024-01-19T05:18:47.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f58040b1870 0x7f5804143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5804144000 0x7f580414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58041444b0 con 0x7f58040b2ce0 2024-01-19T05:18:47.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5804141000 con 0x7f58040b1870 2024-01-19T05:18:47.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580406f620 con 0x7f5804144000 2024-01-19T05:18:47.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f580259c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f58040b1870 0x7f5804143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f5802d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f58040b2ce0 0x7f5804071f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42950/0 (socket says 172.21.15.99:42950) 2024-01-19T05:18:47.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f5802d9d640 1 -- 172.21.15.99:0/3940835626 learned_addr learned my addr 172.21.15.99:0/3940835626 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:47.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f580259c640 1 -- 172.21.15.99:0/3940835626 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5804144000 msgr2=0x7f580414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:47.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f580259c640 1 --2- 172.21.15.99:0/3940835626 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5804144000 0x7f580414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f580259c640 1 -- 172.21.15.99:0/3940835626 >> v1:172.21.15.99:6789/0 conn(0x7f58040b2ce0 legacy=0x7f5804071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f5801d9b640 1 -- 172.21.15.99:0/3940835626 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610192554 0 0) 0x7f58041444b0 con 0x7f58040b2ce0 2024-01-19T05:18:47.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f580259c640 1 -- 172.21.15.99:0/3940835626 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804143610 con 0x7f58040b1870 2024-01-19T05:18:47.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f580259c640 1 --2- 172.21.15.99:0/3940835626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58040b1870 0x7f5804143ac0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009d90 tx=0x7f57f401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea655a599eb32ad server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:47.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f5801d9b640 1 -- 172.21.15.99:0/3940835626 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40a5a10 con 0x7f58040b1870 2024-01-19T05:18:47.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f5801d9b640 1 -- 172.21.15.99:0/3940835626 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f40a5b70 con 0x7f58040b1870 2024-01-19T05:18:47.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f5801d9b640 1 -- 172.21.15.99:0/3940835626 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40ad440 con 0x7f58040b1870 2024-01-19T05:18:47.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 -- 172.21.15.99:0/3940835626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58040b1870 msgr2=0x7f5804143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 --2- 172.21.15.99:0/3940835626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58040b1870 0x7f5804143ac0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009d90 tx=0x7f57f401c950 comp rx=0 tx=0).stop 2024-01-19T05:18:47.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 -- 172.21.15.99:0/3940835626 shutdown_connections 2024-01-19T05:18:47.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 --2- 172.21.15.99:0/3940835626 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5804144000 0x7f580414dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 --2- 172.21.15.99:0/3940835626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58040b1870 0x7f5804143ac0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 -- 172.21.15.99:0/3940835626 >> 172.21.15.99:0/3940835626 conn(0x7f58040b8080 msgr2=0x7f58040b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:47.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 -- 172.21.15.99:0/3940835626 shutdown_connections 2024-01-19T05:18:47.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.808+0000 7f58091f7640 1 -- 172.21.15.99:0/3940835626 wait complete. 2024-01-19T05:18:47.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 Processor -- start 2024-01-19T05:18:47.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 -- start start 2024-01-19T05:18:47.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58040b2ce0 0x7f580413bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5804144000 0x7f58041df610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5804140120 0x7f580413ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580413c200 con 0x7f5804144000 2024-01-19T05:18:47.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040a8e10 con 0x7f5804140120 2024-01-19T05:18:47.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58040ae330 con 0x7f58040b2ce0 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5804144000 0x7f58041df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5804144000 0x7f58041df610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48406/0 (socket says 172.21.15.99:48406) 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 -- 172.21.15.99:0/1314599741 learned_addr learned my addr 172.21.15.99:0/1314599741 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580359e640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5804140120 0x7f580413ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f5802d9d640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58040b2ce0 0x7f580413bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 -- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58040b2ce0 msgr2=0x7f580413bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58040b2ce0 0x7f580413bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 -- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5804140120 msgr2=0x7f580413ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5804140120 0x7f580413ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 -- 172.21.15.99:0/1314599741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4009a70 con 0x7f5804144000 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f5802d9d640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58040b2ce0 0x7f580413bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580359e640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5804140120 0x7f580413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f580259c640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5804144000 0x7f58041df610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009d90 tx=0x7f57f40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f57fb7fe640 1 -- 172.21.15.99:0/1314599741 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40b7610 con 0x7f5804144000 2024-01-19T05:18:47.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f57fb7fe640 1 -- 172.21.15.99:0/1314599741 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f40b7770 con 0x7f5804144000 2024-01-19T05:18:47.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580413c900 con 0x7f5804144000 2024-01-19T05:18:47.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f57fb7fe640 1 -- 172.21.15.99:0/1314599741 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40b7b20 con 0x7f5804144000 2024-01-19T05:18:47.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58041dee10 con 0x7f5804144000 2024-01-19T05:18:47.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58040696e0 con 0x7f5804144000 2024-01-19T05:18:47.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.812+0000 7f57fb7fe640 1 -- 172.21.15.99:0/1314599741 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f57f40b4050 con 0x7f5804144000 2024-01-19T05:18:47.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.816+0000 7f57fb7fe640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f57e4066530 0x7f57e40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:47.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.816+0000 7f57fb7fe640 1 -- 172.21.15.99:0/1314599741 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57f411f1a0 con 0x7f5804144000 2024-01-19T05:18:47.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.816+0000 7f5802d9d640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f57e4066530 0x7f57e40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:47.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.816+0000 7f5802d9d640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f57e4066530 0x7f57e40689f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f57fc007fd0 tx=0x7f57fc007c20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:47.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.820+0000 7f57fb7fe640 1 -- 172.21.15.99:0/1314599741 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f57f40ec590 con 0x7f5804144000 2024-01-19T05:18:47.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.976+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58040a9080 con 0x7f5804144000 2024-01-19T05:18:47.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.976+0000 7f57fb7fe640 1 -- 172.21.15.99:0/1314599741 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+16547 (secure 0 0 0) 0x7f57f40efbb0 con 0x7f5804144000 2024-01-19T05:18:47.978 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:47.979 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":28,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:46.663158+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:44.862843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:45.655715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:47.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f57e4066530 msgr2=0x7f57e40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f57e4066530 0x7f57e40689f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f57fc007fd0 tx=0x7f57fc007c20 comp rx=0 tx=0).stop 2024-01-19T05:18:47.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5804144000 msgr2=0x7f58041df610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:47.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5804144000 0x7f58041df610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009d90 tx=0x7f57f40196f0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 shutdown_connections 2024-01-19T05:18:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f57e4066530 0x7f57e40689f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5804140120 0x7f580413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5804144000 0x7f58041df610 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 --2- 172.21.15.99:0/1314599741 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f58040b2ce0 0x7f580413bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 >> 172.21.15.99:0/1314599741 conn(0x7f58040b8080 msgr2=0x7f58041425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 shutdown_connections 2024-01-19T05:18:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:47.980+0000 7f58091f7640 1 -- 172.21.15.99:0/1314599741 wait complete. 2024-01-19T05:18:47.997 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-19T05:18:48.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.104+0000 7f5120ef6640 1 Processor -- start 2024-01-19T05:18:48.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.104+0000 7f5120ef6640 1 -- start start 2024-01-19T05:18:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f511c150190 0x7f511c152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c0b5130 con 0x7f511c0b9970 2024-01-19T05:18:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c0707c0 con 0x7f511c0aff70 2024-01-19T05:18:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0b9d50 con 0x7f511c150190 2024-01-19T05:18:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511a59c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f511c0b9970 0x7f511c0b4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42964/0 (socket says 172.21.15.99:42964) 2024-01-19T05:18:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511a59c640 1 -- 172.21.15.99:0/2053270759 learned_addr learned my addr 172.21.15.99:0/2053270759 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128507916 0 0) 0x7f511c0b5130 con 0x7f511c0b9970 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f511c150190 0x7f511c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5104003530 con 0x7f511c0b9970 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575212756 0 0) 0x7f5104003530 con 0x7f511c0b9970 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f511c150190 msgr2=0x7f511c152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f511c150190 0x7f511c152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 >> v1:172.21.15.157:6789/0 conn(0x7f511c0aff70 legacy=0x7f511c140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c070200 con 0x7f511c0b9970 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f510c001680 con 0x7f511c0b9970 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 >> v1:172.21.15.99:6789/0 conn(0x7f511c0b9970 legacy=0x7f511c0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51040039b0 0x7f5104003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f511c150190 0x7f51040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004d10 0x7f5104005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0b9d50 con 0x7f5104004d10 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510400ba40 con 0x7f51040039b0 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510400bc00 con 0x7f511c150190 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004d10 0x7f5104005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511a59c640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51040039b0 0x7f5104003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5119d9b640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f511c150190 0x7f51040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 -- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f511c150190 msgr2=0x7f51040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f511c150190 0x7f51040047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 -- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51040039b0 msgr2=0x7f5104003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f51040039b0 0x7f5104003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 -- 172.21.15.99:0/2053270759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104003530 con 0x7f5104004d10 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004d10 0x7f5104005190 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f511c147a00 tx=0x7f511401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb06255eb4e9377e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140a5c70 con 0x7f5104004d10 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511400f040 con 0x7f5104004d10 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511959a640 1 -- 172.21.15.99:0/2053270759 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140ad440 con 0x7f5104004d10 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 -- 172.21.15.99:0/2053270759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004d10 msgr2=0x7f5104005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 --2- 172.21.15.99:0/2053270759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5104004d10 0x7f5104005190 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f511c147a00 tx=0x7f511401cba0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f511ad9d640 1 -- 172.21.15.99:0/2053270759 reap_dead start 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 -- 172.21.15.99:0/2053270759 shutdown_connections 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 -- 172.21.15.99:0/2053270759 >> 172.21.15.99:0/2053270759 conn(0x7f511c0669f0 msgr2=0x7f511c0b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.108+0000 7f5120ef6640 1 -- 172.21.15.99:0/2053270759 shutdown_connections 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 -- 172.21.15.99:0/2053270759 wait complete. 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 Processor -- start 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 -- start start 2024-01-19T05:18:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5104004d10 0x7f511c139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f511c0ae640 0x7f511c145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c136f50 0x7f511c1373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c144ba0 con 0x7f511c136f50 2024-01-19T05:18:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0aeaa0 con 0x7f511c0ae640 2024-01-19T05:18:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c136b90 con 0x7f5104004d10 2024-01-19T05:18:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c136f50 0x7f511c1373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c136f50 0x7f511c1373d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48426/0 (socket says 172.21.15.99:48426) 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 -- 172.21.15.99:0/1925487055 learned_addr learned my addr 172.21.15.99:0/1925487055 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511a59c640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5104004d10 0x7f511c139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 -- 172.21.15.99:0/1925487055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5104004d10 msgr2=0x7f511c139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5104004d10 0x7f511c139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 -- 172.21.15.99:0/1925487055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f511c0ae640 msgr2=0x7f511c145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5119d9b640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f511c0ae640 0x7f511c145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f511c0ae640 0x7f511c145f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 -- 172.21.15.99:0/1925487055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c1464b0 con 0x7f511c136f50 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f511ad9d640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c136f50 0x7f511c1373d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5114002240 tx=0x7f5114009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f510affd640 1 -- 172.21.15.99:0/1925487055 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140ad880 con 0x7f511c136f50 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f510affd640 1 -- 172.21.15.99:0/1925487055 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140ad9e0 con 0x7f511c136f50 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c1393f0 con 0x7f511c136f50 2024-01-19T05:18:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f510affd640 1 -- 172.21.15.99:0/1925487055 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140add90 con 0x7f511c136f50 2024-01-19T05:18:48.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c0af2e0 con 0x7f511c136f50 2024-01-19T05:18:48.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.112+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c067bf0 con 0x7f511c136f50 2024-01-19T05:18:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.116+0000 7f510affd640 1 -- 172.21.15.99:0/1925487055 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f51140b4040 con 0x7f511c136f50 2024-01-19T05:18:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.116+0000 7f510affd640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f50fc066530 0x7f50fc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.116+0000 7f510affd640 1 -- 172.21.15.99:0/1925487055 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f511411f4d0 con 0x7f511c136f50 2024-01-19T05:18:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.116+0000 7f511a59c640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f50fc066530 0x7f50fc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.116+0000 7f511a59c640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f50fc066530 0x7f50fc0689f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f510c005a40 tx=0x7f510c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.116+0000 7f510affd640 1 -- 172.21.15.99:0/1925487055 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f51140ec7c0 con 0x7f511c136f50 2024-01-19T05:18:48.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.292+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f511c0696e0 con 0x7f511c136f50 2024-01-19T05:18:48.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.332+0000 7f510affd640 1 -- 172.21.15.99:0/1925487055 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f51140efde0 con 0x7f511c136f50 2024-01-19T05:18:48.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f50fc066530 msgr2=0x7f50fc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f50fc066530 0x7f50fc0689f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f510c005a40 tx=0x7f510c009040 comp rx=0 tx=0).stop 2024-01-19T05:18:48.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c136f50 msgr2=0x7f511c1373d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c136f50 0x7f511c1373d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5114002240 tx=0x7f5114009750 comp rx=0 tx=0).stop 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 shutdown_connections 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f50fc066530 0x7f50fc0689f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c136f50 0x7f511c1373d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f511c0ae640 0x7f511c145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 --2- 172.21.15.99:0/1925487055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5104004d10 0x7f511c139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 >> 172.21.15.99:0/1925487055 conn(0x7f511c0669f0 msgr2=0x7f511c13c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 shutdown_connections 2024-01-19T05:18:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.340+0000 7f5120ef6640 1 -- 172.21.15.99:0/1925487055 wait complete. 2024-01-19T05:18:48.355 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-19T05:18:48.355 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-19T05:18:48.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f88853c6640 1 Processor -- start 2024-01-19T05:18:48.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f88853c6640 1 -- start start 2024-01-19T05:18:48.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f88853c6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 0x7f888006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f88853c6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8880144c70 0x7f88801450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f88853c6640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8880070680 con 0x7f8880071de0 2024-01-19T05:18:48.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f88853c6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8880070410 con 0x7f8880144c70 2024-01-19T05:18:48.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f88853c6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8880144790 con 0x7f88800b19f0 2024-01-19T05:18:48.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f887f7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8880071de0 0x7f8880072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42976/0 (socket says 172.21.15.99:42976) 2024-01-19T05:18:48.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f887f7fe640 1 -- 172.21.15.99:0/3908530033 learned_addr learned my addr 172.21.15.99:0/3908530033 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:48.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f887effd640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 0x7f888006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f887e7fc640 1 --2- 172.21.15.99:0/3908530033 >> v2:172.21.15.157:3300/0 conn(0x7f8880144c70 0x7f88801450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782657863 0 0) 0x7f8880070680 con 0x7f8880071de0 2024-01-19T05:18:48.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.476+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8868003530 con 0x7f8880071de0 2024-01-19T05:18:48.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 265166008 0 0) 0x7f8868003530 con 0x7f8880071de0 2024-01-19T05:18:48.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 msgr2=0x7f888006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:48.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 0x7f888006ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 >> v2:172.21.15.157:3300/0 conn(0x7f8880144c70 msgr2=0x7f88801450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:48.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 --2- 172.21.15.99:0/3908530033 >> v2:172.21.15.157:3300/0 conn(0x7f8880144c70 0x7f88801450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888006f2b0 con 0x7f8880071de0 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f8878001a00 con 0x7f8880071de0 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 >> v1:172.21.15.99:6789/0 conn(0x7f8880071de0 legacy=0x7f8880072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8868003980 0x7f8868003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f8868004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 0x7f8868005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8880070410 con 0x7f88680047d0 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8880144790 con 0x7f8868003980 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886800b990 con 0x7f88800b19f0 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887e7fc640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f8868004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887effd640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8868003980 0x7f8868003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887f7fe640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 0x7f8868005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887e7fc640 1 -- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 msgr2=0x7f8868005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887e7fc640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 0x7f8868005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887e7fc640 1 -- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8868003980 msgr2=0x7f8868003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887e7fc640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8868003980 0x7f8868003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887e7fc640 1 -- 172.21.15.99:0/3908530033 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868003530 con 0x7f88680047d0 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887f7fe640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88800b19f0 0x7f8868005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887e7fc640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f8868004c50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8874009b10 tx=0x7f887401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3218b13f1eb7d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88740a55b0 con 0x7f88680047d0 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88740a5710 con 0x7f88680047d0 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887dffb640 1 -- 172.21.15.99:0/3908530033 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88740a5ac0 con 0x7f88680047d0 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f88853c6640 1 -- 172.21.15.99:0/3908530033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 msgr2=0x7f8868004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f88853c6640 1 --2- 172.21.15.99:0/3908530033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f8868004c50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8874009b10 tx=0x7f887401ca40 comp rx=0 tx=0).stop 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f887f7fe640 1 -- 172.21.15.99:0/3908530033 reap_dead start 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f88853c6640 1 -- 172.21.15.99:0/3908530033 shutdown_connections 2024-01-19T05:18:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f88853c6640 1 -- 172.21.15.99:0/3908530033 >> 172.21.15.99:0/3908530033 conn(0x7f88800b8080 msgr2=0x7f88800b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f88853c6640 1 -- 172.21.15.99:0/3908530033 shutdown_connections 2024-01-19T05:18:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.480+0000 7f88853c6640 1 -- 172.21.15.99:0/3908530033 wait complete. 2024-01-19T05:18:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 Processor -- start 2024-01-19T05:18:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 -- start start 2024-01-19T05:18:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f888014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f888013e110 0x7f88801dcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88801e0e00 0x7f888013b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888014d760 con 0x7f88680047d0 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88801e0360 con 0x7f88801e0e00 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88801dd190 con 0x7f888013e110 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f888014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f888014b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48436/0 (socket says 172.21.15.99:48436) 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 -- 172.21.15.99:0/1346714680 learned_addr learned my addr 172.21.15.99:0/1346714680 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887f7fe640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88801e0e00 0x7f888013b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887e7fc640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f888013e110 0x7f88801dcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 -- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f888013e110 msgr2=0x7f88801dcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f888013e110 0x7f88801dcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 -- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88801e0e00 msgr2=0x7f888013b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88801e0e00 0x7f888013b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 -- 172.21.15.99:0/1346714680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88801e0600 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887f7fe640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88801e0e00 0x7f888013b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f887effd640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f888014b0d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88700115e0 tx=0x7f8870011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88677fe640 1 -- 172.21.15.99:0/1346714680 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000f8f0 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88677fe640 1 -- 172.21.15.99:0/1346714680 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887000fa50 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88801e08e0 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88677fe640 1 -- 172.21.15.99:0/1346714680 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000fdc0 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88800ae6d0 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88801e01c0 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.484+0000 7f88677fe640 1 -- 172.21.15.99:0/1346714680 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8870015460 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.488+0000 7f88677fe640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f886c066500 0x7f886c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.488+0000 7f88677fe640 1 -- 172.21.15.99:0/1346714680 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8870084680 con 0x7f88680047d0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.488+0000 7f887e7fc640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f886c066500 0x7f886c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.488+0000 7f887e7fc640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f886c066500 0x7f886c0689c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f88740af000 tx=0x7f88740046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.492+0000 7f88677fe640 1 -- 172.21.15.99:0/1346714680 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f88801e01c0 con 0x7f88680047d0 2024-01-19T05:18:48.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:48.668+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f88801e01c0 con 0x7f88680047d0 2024-01-19T05:18:49.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.516+0000 7f88677fe640 1 -- 172.21.15.99:0/1346714680 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f88801e01c0 con 0x7f88680047d0 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f886c066500 msgr2=0x7f886c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f886c066500 0x7f886c0689c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f88740af000 tx=0x7f88740046d0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 msgr2=0x7f888014b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f888014b0d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88700115e0 tx=0x7f8870011aa0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 shutdown_connections 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f886c066500 0x7f886c0689c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88801e0e00 0x7f888013b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f888013e110 0x7f88801dcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 --2- 172.21.15.99:0/1346714680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88680047d0 0x7f888014b0d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 >> 172.21.15.99:0/1346714680 conn(0x7f88800b8080 msgr2=0x7f88800735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:49.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 shutdown_connections 2024-01-19T05:18:49.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.520+0000 7f88853c6640 1 -- 172.21.15.99:0/1346714680 wait complete. 2024-01-19T05:18:49.541 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-19T05:18:49.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:49.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.660+0000 7f6881dfb640 1 Processor -- start 2024-01-19T05:18:49.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.660+0000 7f6881dfb640 1 -- start start 2024-01-19T05:18:49.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f6881dfb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c09cc30 0x7f687c06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f6881dfb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f687c06d470 0x7f687c151160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f6881dfb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c14a860 con 0x7f687c06ddf0 2024-01-19T05:18:49.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f6881dfb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c06d8f0 con 0x7f687c06d470 2024-01-19T05:18:49.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f6881dfb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c06e1d0 con 0x7f687c09cc30 2024-01-19T05:18:49.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687bfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f687c06d470 0x7f687c151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:49.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687affd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c09cc30 0x7f687c06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:49.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687b7fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f687c06ddf0 0x7f687c1468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:58754/0 (socket says 172.21.15.99:58754) 2024-01-19T05:18:49.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687b7fe640 1 -- 172.21.15.99:0/818027854 learned_addr learned my addr 172.21.15.99:0/818027854 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:49.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687bfff640 1 -- 172.21.15.99:0/818027854 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c09cc30 msgr2=0x7f687c06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:49.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687bfff640 1 --2- 172.21.15.99:0/818027854 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c09cc30 0x7f687c06cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687bfff640 1 -- 172.21.15.99:0/818027854 >> v1:172.21.15.157:6789/0 conn(0x7f687c06ddf0 legacy=0x7f687c1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687bfff640 1 -- 172.21.15.99:0/818027854 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c14acf0 con 0x7f687c06d470 2024-01-19T05:18:49.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687affd640 1 --2- 172.21.15.99:0/818027854 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c09cc30 0x7f687c06cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:49.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.664+0000 7f687bfff640 1 --2- 172.21.15.99:0/818027854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06d470 0x7f687c151160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68740097c0 tx=0x7f687401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ba85d9846918c9c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:49.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687a7fc640 1 -- 172.21.15.99:0/818027854 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740ab600 con 0x7f687c06d470 2024-01-19T05:18:49.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687a7fc640 1 -- 172.21.15.99:0/818027854 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68740a7050 con 0x7f687c06d470 2024-01-19T05:18:49.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687a7fc640 1 -- 172.21.15.99:0/818027854 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740ab980 con 0x7f687c06d470 2024-01-19T05:18:49.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- 172.21.15.99:0/818027854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06d470 msgr2=0x7f687c151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 --2- 172.21.15.99:0/818027854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06d470 0x7f687c151160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68740097c0 tx=0x7f687401c330 comp rx=0 tx=0).stop 2024-01-19T05:18:49.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- 172.21.15.99:0/818027854 shutdown_connections 2024-01-19T05:18:49.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 --2- 172.21.15.99:0/818027854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06d470 0x7f687c151160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 --2- 172.21.15.99:0/818027854 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c09cc30 0x7f687c06cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- 172.21.15.99:0/818027854 >> 172.21.15.99:0/818027854 conn(0x7f687c0ba100 msgr2=0x7f687c0ba510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:49.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- 172.21.15.99:0/818027854 shutdown_connections 2024-01-19T05:18:49.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- 172.21.15.99:0/818027854 wait complete. 2024-01-19T05:18:49.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 Processor -- start 2024-01-19T05:18:49.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- start start 2024-01-19T05:18:49.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c06d470 0x7f687c147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06ddf0 0x7f687c13df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f687c09cc30 0x7f687c144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c144860 con 0x7f687c09cc30 2024-01-19T05:18:49.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1465b0 con 0x7f687c06ddf0 2024-01-19T05:18:49.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1480b0 con 0x7f687c06d470 2024-01-19T05:18:49.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f687c09cc30 0x7f687c144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:49.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f687c09cc30 0x7f687c144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48444/0 (socket says 172.21.15.99:48444) 2024-01-19T05:18:49.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 -- 172.21.15.99:0/1514366550 learned_addr learned my addr 172.21.15.99:0/1514366550 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687b7fe640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c06d470 0x7f687c147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687affd640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06ddf0 0x7f687c13df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 -- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c06d470 msgr2=0x7f687c147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c06d470 0x7f687c147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 -- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06ddf0 msgr2=0x7f687c13df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06ddf0 0x7f687c13df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 -- 172.21.15.99:0/1514366550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6864009420 con 0x7f687c09cc30 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687b7fe640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c06d470 0x7f687c147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f687bfff640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f687c09cc30 0x7f687c144fa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f68740ae040 tx=0x7f68740190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6873fff640 1 -- 172.21.15.99:0/1514366550 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874006e20 con 0x7f687c09cc30 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6873fff640 1 -- 172.21.15.99:0/1514366550 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68740b4410 con 0x7f687c09cc30 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6874009420 con 0x7f687c09cc30 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6873fff640 1 -- 172.21.15.99:0/1514366550 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740b47a0 con 0x7f687c09cc30 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.668+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c13d700 con 0x7f687c09cc30 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.672+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c067bf0 con 0x7f687c09cc30 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.672+0000 7f6873fff640 1 -- 172.21.15.99:0/1514366550 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f68740b2040 con 0x7f687c09cc30 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.672+0000 7f6873fff640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f685c066500 0x7f685c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.672+0000 7f6873fff640 1 -- 172.21.15.99:0/1514366550 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f687411dfe0 con 0x7f687c09cc30 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.672+0000 7f687b7fe640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f685c066500 0x7f685c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:49.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.672+0000 7f687b7fe640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f685c066500 0x7f685c0689c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f687c13e6c0 tx=0x7f686c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:49.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.676+0000 7f6873fff640 1 -- 172.21.15.99:0/1514366550 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f68740eb270 con 0x7f687c09cc30 2024-01-19T05:18:49.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.852+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f687c0b1370 con 0x7f687c09cc30 2024-01-19T05:18:49.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.852+0000 7f6873fff640 1 -- 172.21.15.99:0/1514366550 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3353 (secure 0 0 0) 0x7f68740b0d30 con 0x7f687c09cc30 2024-01-19T05:18:49.854 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:49.854 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/84065038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":84065038},{"type":"v1","addr":"172.21.15.157:6833","nonce":84065038}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:46.663899+0000","modified":"2024-01-19T05:18:48.672449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/3566081214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3566081214},{"type":"v1","addr":"172.21.15.99:6835","nonce":3566081214}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-19T05:18:49.854 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 13 2024-01-19T05:18:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f685c066500 msgr2=0x7f685c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f685c066500 0x7f685c0689c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f687c13e6c0 tx=0x7f686c009040 comp rx=0 tx=0).stop 2024-01-19T05:18:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f687c09cc30 msgr2=0x7f687c144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f687c09cc30 0x7f687c144fa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f68740ae040 tx=0x7f68740190d0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 shutdown_connections 2024-01-19T05:18:49.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f685c066500 0x7f685c0689c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f687c09cc30 0x7f687c144fa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f687c06ddf0 0x7f687c13df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 --2- 172.21.15.99:0/1514366550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f687c06d470 0x7f687c147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 >> 172.21.15.99:0/1514366550 conn(0x7f687c0ba100 msgr2=0x7f687c0b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:49.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 shutdown_connections 2024-01-19T05:18:49.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.856+0000 7f6881dfb640 1 -- 172.21.15.99:0/1514366550 wait complete. 2024-01-19T05:18:49.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5f605c640 1 Processor -- start 2024-01-19T05:18:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5f605c640 1 -- start start 2024-01-19T05:18:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5f605c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd5f006ebe0 0x7fd5f0071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5f605c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f0072320 0x7fd5f014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5f605c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f006f070 con 0x7fd5f00b19f0 2024-01-19T05:18:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5f605c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f0070680 con 0x7fd5f006ebe0 2024-01-19T05:18:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5f605c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0070410 con 0x7fd5f0072320 2024-01-19T05:18:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5e7fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd5f006ebe0 0x7fd5f0071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:49.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5ef7fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd5f00b19f0 0x7fd5f0144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:58768/0 (socket says 172.21.15.99:58768) 2024-01-19T05:18:49.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5e7fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd5f006ebe0 0x7fd5f0071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:44314/0 (socket says 172.21.15.99:44314) 2024-01-19T05:18:49.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5effff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f0072320 0x7fd5f014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:49.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5e7fff640 1 -- 172.21.15.99:0/2857542624 learned_addr learned my addr 172.21.15.99:0/2857542624 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:49.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5e7fff640 1 -- 172.21.15.99:0/2857542624 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f0072320 msgr2=0x7fd5f014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:49.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5e7fff640 1 --2- 172.21.15.99:0/2857542624 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f0072320 0x7fd5f014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5e7fff640 1 -- 172.21.15.99:0/2857542624 >> v1:172.21.15.157:6789/0 conn(0x7fd5f00b19f0 legacy=0x7fd5f0144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5e7fff640 1 -- 172.21.15.99:0/2857542624 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0144790 con 0x7fd5f006ebe0 2024-01-19T05:18:49.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.992+0000 7fd5effff640 1 --2- 172.21.15.99:0/2857542624 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f0072320 0x7fd5f014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:49.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 --2- 172.21.15.99:0/2857542624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f006ebe0 0x7fd5f0071de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009870 tx=0x7fd5d801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb09d1b41729cf51 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:49.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5eeffd640 1 -- 172.21.15.99:0/2857542624 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80a6040 con 0x7fd5f006ebe0 2024-01-19T05:18:49.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5eeffd640 1 -- 172.21.15.99:0/2857542624 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d80aa600 con 0x7fd5f006ebe0 2024-01-19T05:18:49.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5eeffd640 1 -- 172.21.15.99:0/2857542624 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80aa990 con 0x7fd5f006ebe0 2024-01-19T05:18:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- 172.21.15.99:0/2857542624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f006ebe0 msgr2=0x7fd5f0071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 --2- 172.21.15.99:0/2857542624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f006ebe0 0x7fd5f0071de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009870 tx=0x7fd5d801c480 comp rx=0 tx=0).stop 2024-01-19T05:18:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- 172.21.15.99:0/2857542624 shutdown_connections 2024-01-19T05:18:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 --2- 172.21.15.99:0/2857542624 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f0072320 0x7fd5f014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 --2- 172.21.15.99:0/2857542624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f006ebe0 0x7fd5f0071de0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- 172.21.15.99:0/2857542624 >> 172.21.15.99:0/2857542624 conn(0x7fd5f00b8080 msgr2=0x7fd5f00b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- 172.21.15.99:0/2857542624 shutdown_connections 2024-01-19T05:18:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- 172.21.15.99:0/2857542624 wait complete. 2024-01-19T05:18:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 Processor -- start 2024-01-19T05:18:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- start start 2024-01-19T05:18:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f006ebe0 0x7fd5f0134b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f0072320 0x7fd5f01dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f00b19f0 0x7fd5f01322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f013a890 con 0x7fd5f0072320 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01e0c10 con 0x7fd5f00b19f0 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5f605c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0133480 con 0x7fd5f006ebe0 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f0072320 0x7fd5f01dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f0072320 0x7fd5f01dcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48458/0 (socket says 172.21.15.99:48458) 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 -- 172.21.15.99:0/152770702 learned_addr learned my addr 172.21.15.99:0/152770702 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5ef7fe640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f006ebe0 0x7fd5f0134b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5effff640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f00b19f0 0x7fd5f01322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 -- 172.21.15.99:0/152770702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f006ebe0 msgr2=0x7fd5f0134b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f006ebe0 0x7fd5f0134b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 -- 172.21.15.99:0/152770702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f00b19f0 msgr2=0x7fd5f01322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f00b19f0 0x7fd5f01322d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:49.996+0000 7fd5e7fff640 1 -- 172.21.15.99:0/152770702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8009a70 con 0x7fd5f0072320 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5e7fff640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f0072320 0x7fd5f01dcd50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd5d801a0b0 tx=0x7fd5d801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5ecff9640 1 -- 172.21.15.99:0/152770702 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80b3600 con 0x7fd5f0072320 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5ecff9640 1 -- 172.21.15.99:0/152770702 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d80b3780 con 0x7fd5f0072320 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d80094d0 con 0x7fd5f0072320 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5ecff9640 1 -- 172.21.15.99:0/152770702 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80b3b30 con 0x7fd5f0072320 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f01e0670 con 0x7fd5f0072320 2024-01-19T05:18:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f01e0dc0 con 0x7fd5f0072320 2024-01-19T05:18:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5ecff9640 1 -- 172.21.15.99:0/152770702 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd5d80b3c90 con 0x7fd5f0072320 2024-01-19T05:18:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5ecff9640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd5d0066530 0x7fd5d00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5ecff9640 1 -- 172.21.15.99:0/152770702 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5d811e760 con 0x7fd5f0072320 2024-01-19T05:18:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5ef7fe640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd5d0066530 0x7fd5d00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.000+0000 7fd5ef7fe640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd5d0066530 0x7fd5d00689f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0000f70 tx=0x7fd5e0007cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.004+0000 7fd5ecff9640 1 -- 172.21.15.99:0/152770702 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd5f01e0dc0 con 0x7fd5f0072320 2024-01-19T05:18:50.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.164+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5f01e0dc0 con 0x7fd5f0072320 2024-01-19T05:18:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5ecff9640 1 -- 172.21.15.99:0/152770702 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16534 (secure 0 0 0) 0x7fd5f01e0dc0 con 0x7fd5f0072320 2024-01-19T05:18:50.168 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:50.168 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:48.330234+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:44.862843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:45.655715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:18:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd5d0066530 msgr2=0x7fd5d00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd5d0066530 0x7fd5d00689f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0000f70 tx=0x7fd5e0007cf0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f0072320 msgr2=0x7fd5f01dcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f0072320 0x7fd5f01dcd50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd5d801a0b0 tx=0x7fd5d801acc0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 shutdown_connections 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd5d0066530 0x7fd5d00689f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f00b19f0 0x7fd5f01322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f0072320 0x7fd5f01dcd50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.168+0000 7fd5f605c640 1 --2- 172.21.15.99:0/152770702 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd5f006ebe0 0x7fd5f0134b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.172+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 >> 172.21.15.99:0/152770702 conn(0x7fd5f00b8080 msgr2=0x7fd5f01425f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.172+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 shutdown_connections 2024-01-19T05:18:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.172+0000 7fd5f605c640 1 -- 172.21.15.99:0/152770702 wait complete. 2024-01-19T05:18:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-19T05:18:50.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:50.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f3d77640 1 Processor -- start 2024-01-19T05:18:50.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f3d77640 1 -- start start 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f3d77640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec06a940 0x7fa8ec0af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f3d77640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8ec146ec0 0x7fa8ec147330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f3d77640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec0b0270 con 0x7fa8ec09bc20 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f3d77640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ec09e5b0 con 0x7fa8ec146ec0 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f3d77640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec146a60 con 0x7fa8ec06a940 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f2314640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8ec146ec0 0x7fa8ec147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f2314640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8ec146ec0 0x7fa8ec147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48474/0 (socket says 172.21.15.99:48474) 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f2314640 1 -- 172.21.15.99:0/819383157 learned_addr learned my addr 172.21.15.99:0/819383157 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f1b13640 1 --2- 172.21.15.99:0/819383157 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec06a940 0x7fa8ec0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f2314640 1 -- 172.21.15.99:0/819383157 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec06a940 msgr2=0x7fa8ec0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:50.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f2314640 1 --2- 172.21.15.99:0/819383157 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec06a940 0x7fa8ec0af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f2314640 1 -- 172.21.15.99:0/819383157 >> v1:172.21.15.157:6789/0 conn(0x7fa8ec09bc20 legacy=0x7fa8ec14a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f2314640 1 -- 172.21.15.99:0/819383157 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec06ad20 con 0x7fa8ec146ec0 2024-01-19T05:18:50.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.296+0000 7fa8f2314640 1 --2- 172.21.15.99:0/819383157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec146ec0 0x7fa8ec147330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009e50 tx=0x7fa8e401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5cc17049cef85d server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f0b11640 1 -- 172.21.15.99:0/819383157 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40a57b0 con 0x7fa8ec146ec0 2024-01-19T05:18:50.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f0b11640 1 -- 172.21.15.99:0/819383157 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e40a5910 con 0x7fa8ec146ec0 2024-01-19T05:18:50.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f0b11640 1 -- 172.21.15.99:0/819383157 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40a5ca0 con 0x7fa8ec146ec0 2024-01-19T05:18:50.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- 172.21.15.99:0/819383157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec146ec0 msgr2=0x7fa8ec147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/819383157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec146ec0 0x7fa8ec147330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009e50 tx=0x7fa8e401c8f0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- 172.21.15.99:0/819383157 shutdown_connections 2024-01-19T05:18:50.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/819383157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec146ec0 0x7fa8ec147330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/819383157 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec06a940 0x7fa8ec0af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- 172.21.15.99:0/819383157 >> 172.21.15.99:0/819383157 conn(0x7fa8ec066ef0 msgr2=0x7fa8ec0b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:50.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- 172.21.15.99:0/819383157 shutdown_connections 2024-01-19T05:18:50.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- 172.21.15.99:0/819383157 wait complete. 2024-01-19T05:18:50.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 Processor -- start 2024-01-19T05:18:50.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- start start 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec06a940 0x7fa8ec09b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec09bc20 0x7fa8ec09d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec146ec0 0x7fa8ec1e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec072570 con 0x7fa8ec06a940 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec144100 con 0x7fa8ec09bc20 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec143440 con 0x7fa8ec146ec0 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec06a940 0x7fa8ec09b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec06a940 0x7fa8ec09b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48480/0 (socket says 172.21.15.99:48480) 2024-01-19T05:18:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 -- 172.21.15.99:0/3271260366 learned_addr learned my addr 172.21.15.99:0/3271260366 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1312640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec09bc20 0x7fa8ec09d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f2314640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec146ec0 0x7fa8ec1e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 -- 172.21.15.99:0/3271260366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec146ec0 msgr2=0x7fa8ec1e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec146ec0 0x7fa8ec1e2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 -- 172.21.15.99:0/3271260366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec09bc20 msgr2=0x7fa8ec09d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec09bc20 0x7fa8ec09d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 -- 172.21.15.99:0/3271260366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4009b30 con 0x7fa8ec06a940 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f1b13640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec06a940 0x7fa8ec09b680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800d5f0 tx=0x7fa8e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8e27fc640 1 -- 172.21.15.99:0/3271260366 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80125f0 con 0x7fa8ec06a940 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec143720 con 0x7fa8ec06a940 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8e27fc640 1 -- 172.21.15.99:0/3271260366 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e8012750 con 0x7fa8ec06a940 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8e27fc640 1 -- 172.21.15.99:0/3271260366 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8012b00 con 0x7fa8ec06a940 2024-01-19T05:18:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.300+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec072290 con 0x7fa8ec06a940 2024-01-19T05:18:50.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.304+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec0696e0 con 0x7fa8ec06a940 2024-01-19T05:18:50.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.304+0000 7fa8e27fc640 1 -- 172.21.15.99:0/3271260366 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa8e8012c60 con 0x7fa8ec06a940 2024-01-19T05:18:50.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.304+0000 7fa8e27fc640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8d0066500 0x7fa8d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.304+0000 7fa8e27fc640 1 -- 172.21.15.99:0/3271260366 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8e8084400 con 0x7fa8ec06a940 2024-01-19T05:18:50.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.304+0000 7fa8f1312640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8d0066500 0x7fa8d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.304+0000 7fa8f1312640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8d0066500 0x7fa8d00689c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0b3650 tx=0x7fa8dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.308+0000 7fa8e27fc640 1 -- 172.21.15.99:0/3271260366 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa8e80516b0 con 0x7fa8ec06a940 2024-01-19T05:18:50.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.452+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8ec153b20 con 0x7fa8d0066500 2024-01-19T05:18:50.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8e27fc640 1 -- 172.21.15.99:0/3271260366 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252097 (secure 0 0 0) 0x7fa8dc0050d0 con 0x7fa8d0066500 2024-01-19T05:18:50.469 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:50.470 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:50.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8d0066500 msgr2=0x7fa8d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8d0066500 0x7fa8d00689c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0b3650 tx=0x7fa8dc009040 comp rx=0 tx=0).stop 2024-01-19T05:18:50.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec06a940 msgr2=0x7fa8ec09b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec06a940 0x7fa8ec09b680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800d5f0 tx=0x7fa8e800dab0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 shutdown_connections 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8d0066500 0x7fa8d00689c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec146ec0 0x7fa8ec1e2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec09bc20 0x7fa8ec09d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 --2- 172.21.15.99:0/3271260366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ec06a940 0x7fa8ec09b680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.468+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 >> 172.21.15.99:0/3271260366 conn(0x7fa8ec066ef0 msgr2=0x7fa8ec144ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.472+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 shutdown_connections 2024-01-19T05:18:50.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.472+0000 7fa8f3d77640 1 -- 172.21.15.99:0/3271260366 wait complete. 2024-01-19T05:18:50.485 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-01-19T05:18:49.356128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236144,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738576,"statfs":{"total":773094113280,"available":772852301824,"internally_reserved":0,"allocated":3383296,"data_stored":1971368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.064895"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.294881+0000","last_change":"2024-01-19T05:18:45.294881+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.294881+0000","last_undegraded":"2024-01-19T05:18:45.294881+0000","last_fullsized":"2024-01-19T05:18:45.294881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297369+0000","last_change":"2024-01-19T05:18:45.297369+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297369+0000","last_undegraded":"2024-01-19T05:18:45.297369+0000","last_fullsized":"2024-01-19T05:18:45.297369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300639+0000","last_change":"2024-01-19T05:18:45.300639+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300639+0000","last_undegraded":"2024-01-19T05:18:45.300639+0000","last_fullsized":"2024-01-19T05:18:45.300639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.303548+0000","last_change":"2024-01-19T05:18:45.303548+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.303548+0000","last_undegraded":"2024-01-19T05:18:45.303548+0000","last_fullsized":"2024-01-19T05:18:45.303548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300617+0000","last_change":"2024-01-19T05:18:45.300617+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300617+0000","last_undegraded":"2024-01-19T05:18:45.300617+0000","last_fullsized":"2024-01-19T05:18:45.300617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297859+0000","last_change":"2024-01-19T05:18:45.297859+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297859+0000","last_undegraded":"2024-01-19T05:18:45.297859+0000","last_fullsized":"2024-01-19T05:18:45.297859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300617+0000","last_change":"2024-01-19T05:18:45.300617+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300617+0000","last_undegraded":"2024-01-19T05:18:45.300617+0000","last_fullsized":"2024-01-19T05:18:45.300617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297131+0000","last_change":"2024-01-19T05:18:45.297131+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297131+0000","last_undegraded":"2024-01-19T05:18:45.297131+0000","last_fullsized":"2024-01-19T05:18:45.297131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.293980+0000","last_change":"2024-01-19T05:18:45.293980+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.293980+0000","last_undegraded":"2024-01-19T05:18:45.293980+0000","last_fullsized":"2024-01-19T05:18:45.293980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296690+0000","last_change":"2024-01-19T05:18:45.296690+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296690+0000","last_undegraded":"2024-01-19T05:18:45.296690+0000","last_fullsized":"2024-01-19T05:18:45.296690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300631+0000","last_change":"2024-01-19T05:18:45.300631+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300631+0000","last_undegraded":"2024-01-19T05:18:45.300631+0000","last_fullsized":"2024-01-19T05:18:45.300631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299761+0000","last_change":"2024-01-19T05:18:45.299761+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299761+0000","last_undegraded":"2024-01-19T05:18:45.299761+0000","last_fullsized":"2024-01-19T05:18:45.299761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296715+0000","last_change":"2024-01-19T05:18:45.296715+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296715+0000","last_undegraded":"2024-01-19T05:18:45.296715+0000","last_fullsized":"2024-01-19T05:18:45.296715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296723+0000","last_change":"2024-01-19T05:18:45.296723+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296723+0000","last_undegraded":"2024-01-19T05:18:45.296723+0000","last_fullsized":"2024-01-19T05:18:45.296723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300048+0000","last_change":"2024-01-19T05:18:45.300048+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300048+0000","last_undegraded":"2024-01-19T05:18:45.300048+0000","last_fullsized":"2024-01-19T05:18:45.300048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300718+0000","last_change":"2024-01-19T05:18:45.300718+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300718+0000","last_undegraded":"2024-01-19T05:18:45.300718+0000","last_fullsized":"2024-01-19T05:18:45.300718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.302209+0000","last_change":"2024-01-19T05:18:45.302209+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.302209+0000","last_undegraded":"2024-01-19T05:18:45.302209+0000","last_fullsized":"2024-01-19T05:18:45.302209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.301745+0000","last_change":"2024-01-19T05:18:45.301745+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.301745+0000","last_undegraded":"2024-01-19T05:18:45.301745+0000","last_fullsized":"2024-01-19T05:18:45.301745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.294508+0000","last_change":"2024-01-19T05:18:45.294508+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.294508+0000","last_undegraded":"2024-01-19T05:18:45.294508+0000","last_fullsized":"2024-01-19T05:18:45.294508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.301918+0000","last_change":"2024-01-19T05:18:45.301918+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.301918+0000","last_undegraded":"2024-01-19T05:18:45.301918+0000","last_fullsized":"2024-01-19T05:18:45.301918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.293990+0000","last_change":"2024-01-19T05:18:45.293990+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.293990+0000","last_undegraded":"2024-01-19T05:18:45.293990+0000","last_fullsized":"2024-01-19T05:18:45.293990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.298936+0000","last_change":"2024-01-19T05:18:45.298936+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.298936+0000","last_undegraded":"2024-01-19T05:18:45.298936+0000","last_fullsized":"2024-01-19T05:18:45.298936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299243+0000","last_change":"2024-01-19T05:18:45.299243+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299243+0000","last_undegraded":"2024-01-19T05:18:45.299243+0000","last_fullsized":"2024-01-19T05:18:45.299243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299285+0000","last_change":"2024-01-19T05:18:45.299285+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299285+0000","last_undegraded":"2024-01-19T05:18:45.299285+0000","last_fullsized":"2024-01-19T05:18:45.299285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300631+0000","last_change":"2024-01-19T05:18:45.300631+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300631+0000","last_undegraded":"2024-01-19T05:18:45.300631+0000","last_fullsized":"2024-01-19T05:18:45.300631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.295605+0000","last_change":"2024-01-19T05:18:45.295605+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.295605+0000","last_undegraded":"2024-01-19T05:18:45.295605+0000","last_fullsized":"2024-01-19T05:18:45.295605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296044+0000","last_change":"2024-01-19T05:18:45.296044+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296044+0000","last_undegraded":"2024-01-19T05:18:45.296044+0000","last_fullsized":"2024-01-19T05:18:45.296044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-19T05:18:41.345414+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:41.345414+0000","last_peered":"2024-01-19T05:18:41.345414+0000","last_clean":"2024-01-19T05:18:41.345414+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:41.345414+0000","last_undegraded":"2024-01-19T05:18:41.345414+0000","last_fullsized":"2024-01-19T05:18:41.345414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":689197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":689197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:50.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:50.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.636+0000 7fc017f01640 1 Processor -- start 2024-01-19T05:18:50.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.636+0000 7fc017f01640 1 -- start start 2024-01-19T05:18:50.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc017f01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01006a940 0x7fc0100af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc017f01640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc01009bc20 0x7fc01014a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc017f01640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc01014abd0 0x7fc010146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc017f01640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0100b0270 con 0x7fc01014abd0 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc017f01640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01009e5b0 con 0x7fc01009bc20 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc017f01640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc010146a60 con 0x7fc01006a940 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc01014abd0 0x7fc010146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc01014abd0 0x7fc010146ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48490/0 (socket says 172.21.15.99:48490) 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 -- 172.21.15.99:0/1721044980 learned_addr learned my addr 172.21.15.99:0/1721044980 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01549c640 1 --2- 172.21.15.99:0/1721044980 >> v2:172.21.15.157:3300/0 conn(0x7fc01009bc20 0x7fc01014a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc015c9d640 1 --2- 172.21.15.99:0/1721044980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01006a940 0x7fc0100af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 -- 172.21.15.99:0/1721044980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01006a940 msgr2=0x7fc0100af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 --2- 172.21.15.99:0/1721044980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01006a940 0x7fc0100af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 -- 172.21.15.99:0/1721044980 >> v2:172.21.15.157:3300/0 conn(0x7fc01009bc20 msgr2=0x7fc01014a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 --2- 172.21.15.99:0/1721044980 >> v2:172.21.15.157:3300/0 conn(0x7fc01009bc20 0x7fc01014a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 -- 172.21.15.99:0/1721044980 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01006ad20 con 0x7fc01014abd0 2024-01-19T05:18:50.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc01649e640 1 --2- 172.21.15.99:0/1721044980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01014abd0 0x7fc010146ec0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc01006af10 tx=0x7fc00801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b0360a929a673 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc014c9b640 1 -- 172.21.15.99:0/1721044980 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0080a5730 con 0x7fc01014abd0 2024-01-19T05:18:50.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc014c9b640 1 -- 172.21.15.99:0/1721044980 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0080a5890 con 0x7fc01014abd0 2024-01-19T05:18:50.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.640+0000 7fc014c9b640 1 -- 172.21.15.99:0/1721044980 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0080a5c20 con 0x7fc01014abd0 2024-01-19T05:18:50.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- 172.21.15.99:0/1721044980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01014abd0 msgr2=0x7fc010146ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 --2- 172.21.15.99:0/1721044980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01014abd0 0x7fc010146ec0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc01006af10 tx=0x7fc00801c8b0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- 172.21.15.99:0/1721044980 shutdown_connections 2024-01-19T05:18:50.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 --2- 172.21.15.99:0/1721044980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01014abd0 0x7fc010146ec0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 --2- 172.21.15.99:0/1721044980 >> v2:172.21.15.157:3300/0 conn(0x7fc01009bc20 0x7fc01014a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 --2- 172.21.15.99:0/1721044980 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01006a940 0x7fc0100af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- 172.21.15.99:0/1721044980 >> 172.21.15.99:0/1721044980 conn(0x7fc010066ef0 msgr2=0x7fc0100b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:50.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- 172.21.15.99:0/1721044980 shutdown_connections 2024-01-19T05:18:50.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- 172.21.15.99:0/1721044980 wait complete. 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 Processor -- start 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- start start 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01006a940 0x7fc01013d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01009bc20 0x7fc010148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01014abd0 0x7fc010148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01013e2a0 con 0x7fc01006a940 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010072370 con 0x7fc01009bc20 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01006fd70 con 0x7fc01014abd0 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01006a940 0x7fc01013d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01006a940 0x7fc01013d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48500/0 (socket says 172.21.15.99:48500) 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 -- 172.21.15.99:0/1770807756 learned_addr learned my addr 172.21.15.99:0/1770807756 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 -- 172.21.15.99:0/1770807756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01014abd0 msgr2=0x7fc010148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01014abd0 0x7fc010148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 -- 172.21.15.99:0/1770807756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01009bc20 msgr2=0x7fc010148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01009bc20 0x7fc010148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 -- 172.21.15.99:0/1770807756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008009b30 con 0x7fc01006a940 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc015c9d640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01006a940 0x7fc01013d750 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c7f0 tx=0x7fc00c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc0067fc640 1 -- 172.21.15.99:0/1770807756 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c004220 con 0x7fc01006a940 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc0067fc640 1 -- 172.21.15.99:0/1770807756 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c0043a0 con 0x7fc01006a940 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc0067fc640 1 -- 172.21.15.99:0/1770807756 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c004510 con 0x7fc01006a940 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc010070050 con 0x7fc01006a940 2024-01-19T05:18:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0101484e0 con 0x7fc01006a940 2024-01-19T05:18:50.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.644+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc010147fe0 con 0x7fc01006a940 2024-01-19T05:18:50.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.648+0000 7fc0067fc640 1 -- 172.21.15.99:0/1770807756 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc00c003860 con 0x7fc01006a940 2024-01-19T05:18:50.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.648+0000 7fc0067fc640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbff4066500 0x7fbff40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.648+0000 7fc01549c640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbff4066500 0x7fbff40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.648+0000 7fc0067fc640 1 -- 172.21.15.99:0/1770807756 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc00c083bd0 con 0x7fc01006a940 2024-01-19T05:18:50.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.648+0000 7fc01549c640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbff4066500 0x7fbff40689c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc000006b20 tx=0x7fc000008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.652+0000 7fc0067fc640 1 -- 172.21.15.99:0/1770807756 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc010147fe0 con 0x7fc01006a940 2024-01-19T05:18:50.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.792+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc010147fe0 con 0x7fbff4066500 2024-01-19T05:18:50.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.800+0000 7fc0067fc640 1 -- 172.21.15.99:0/1770807756 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252097 (secure 0 0 0) 0x7fc010147fe0 con 0x7fbff4066500 2024-01-19T05:18:50.801 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbff4066500 msgr2=0x7fbff40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbff4066500 0x7fbff40689c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc000006b20 tx=0x7fc000008040 comp rx=0 tx=0).stop 2024-01-19T05:18:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01006a940 msgr2=0x7fc01013d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01006a940 0x7fc01013d750 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c7f0 tx=0x7fc00c00ccb0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 shutdown_connections 2024-01-19T05:18:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbff4066500 0x7fbff40689c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc01014abd0 0x7fc010148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc01009bc20 0x7fc010148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 --2- 172.21.15.99:0/1770807756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc01006a940 0x7fc01013d750 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 >> 172.21.15.99:0/1770807756 conn(0x7fc010066ef0 msgr2=0x7fc0100af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:50.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 shutdown_connections 2024-01-19T05:18:50.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.804+0000 7fc017f01640 1 -- 172.21.15.99:0/1770807756 wait complete. 2024-01-19T05:18:50.818 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-01-19T05:18:49.356128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236144,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738576,"statfs":{"total":773094113280,"available":772852301824,"internally_reserved":0,"allocated":3383296,"data_stored":1971368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.064895"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.294881+0000","last_change":"2024-01-19T05:18:45.294881+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.294881+0000","last_undegraded":"2024-01-19T05:18:45.294881+0000","last_fullsized":"2024-01-19T05:18:45.294881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297369+0000","last_change":"2024-01-19T05:18:45.297369+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297369+0000","last_undegraded":"2024-01-19T05:18:45.297369+0000","last_fullsized":"2024-01-19T05:18:45.297369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300639+0000","last_change":"2024-01-19T05:18:45.300639+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300639+0000","last_undegraded":"2024-01-19T05:18:45.300639+0000","last_fullsized":"2024-01-19T05:18:45.300639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.303548+0000","last_change":"2024-01-19T05:18:45.303548+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.303548+0000","last_undegraded":"2024-01-19T05:18:45.303548+0000","last_fullsized":"2024-01-19T05:18:45.303548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300617+0000","last_change":"2024-01-19T05:18:45.300617+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300617+0000","last_undegraded":"2024-01-19T05:18:45.300617+0000","last_fullsized":"2024-01-19T05:18:45.300617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297859+0000","last_change":"2024-01-19T05:18:45.297859+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297859+0000","last_undegraded":"2024-01-19T05:18:45.297859+0000","last_fullsized":"2024-01-19T05:18:45.297859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300617+0000","last_change":"2024-01-19T05:18:45.300617+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300617+0000","last_undegraded":"2024-01-19T05:18:45.300617+0000","last_fullsized":"2024-01-19T05:18:45.300617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297131+0000","last_change":"2024-01-19T05:18:45.297131+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297131+0000","last_undegraded":"2024-01-19T05:18:45.297131+0000","last_fullsized":"2024-01-19T05:18:45.297131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.293980+0000","last_change":"2024-01-19T05:18:45.293980+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.293980+0000","last_undegraded":"2024-01-19T05:18:45.293980+0000","last_fullsized":"2024-01-19T05:18:45.293980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296690+0000","last_change":"2024-01-19T05:18:45.296690+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296690+0000","last_undegraded":"2024-01-19T05:18:45.296690+0000","last_fullsized":"2024-01-19T05:18:45.296690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300631+0000","last_change":"2024-01-19T05:18:45.300631+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300631+0000","last_undegraded":"2024-01-19T05:18:45.300631+0000","last_fullsized":"2024-01-19T05:18:45.300631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299761+0000","last_change":"2024-01-19T05:18:45.299761+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299761+0000","last_undegraded":"2024-01-19T05:18:45.299761+0000","last_fullsized":"2024-01-19T05:18:45.299761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296715+0000","last_change":"2024-01-19T05:18:45.296715+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296715+0000","last_undegraded":"2024-01-19T05:18:45.296715+0000","last_fullsized":"2024-01-19T05:18:45.296715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296723+0000","last_change":"2024-01-19T05:18:45.296723+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296723+0000","last_undegraded":"2024-01-19T05:18:45.296723+0000","last_fullsized":"2024-01-19T05:18:45.296723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300048+0000","last_change":"2024-01-19T05:18:45.300048+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300048+0000","last_undegraded":"2024-01-19T05:18:45.300048+0000","last_fullsized":"2024-01-19T05:18:45.300048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300718+0000","last_change":"2024-01-19T05:18:45.300718+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300718+0000","last_undegraded":"2024-01-19T05:18:45.300718+0000","last_fullsized":"2024-01-19T05:18:45.300718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.302209+0000","last_change":"2024-01-19T05:18:45.302209+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.302209+0000","last_undegraded":"2024-01-19T05:18:45.302209+0000","last_fullsized":"2024-01-19T05:18:45.302209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.301745+0000","last_change":"2024-01-19T05:18:45.301745+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.301745+0000","last_undegraded":"2024-01-19T05:18:45.301745+0000","last_fullsized":"2024-01-19T05:18:45.301745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.294508+0000","last_change":"2024-01-19T05:18:45.294508+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.294508+0000","last_undegraded":"2024-01-19T05:18:45.294508+0000","last_fullsized":"2024-01-19T05:18:45.294508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.301918+0000","last_change":"2024-01-19T05:18:45.301918+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.301918+0000","last_undegraded":"2024-01-19T05:18:45.301918+0000","last_fullsized":"2024-01-19T05:18:45.301918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.293990+0000","last_change":"2024-01-19T05:18:45.293990+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.293990+0000","last_undegraded":"2024-01-19T05:18:45.293990+0000","last_fullsized":"2024-01-19T05:18:45.293990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.298936+0000","last_change":"2024-01-19T05:18:45.298936+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.298936+0000","last_undegraded":"2024-01-19T05:18:45.298936+0000","last_fullsized":"2024-01-19T05:18:45.298936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299243+0000","last_change":"2024-01-19T05:18:45.299243+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299243+0000","last_undegraded":"2024-01-19T05:18:45.299243+0000","last_fullsized":"2024-01-19T05:18:45.299243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299285+0000","last_change":"2024-01-19T05:18:45.299285+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299285+0000","last_undegraded":"2024-01-19T05:18:45.299285+0000","last_fullsized":"2024-01-19T05:18:45.299285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300631+0000","last_change":"2024-01-19T05:18:45.300631+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300631+0000","last_undegraded":"2024-01-19T05:18:45.300631+0000","last_fullsized":"2024-01-19T05:18:45.300631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.295605+0000","last_change":"2024-01-19T05:18:45.295605+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.295605+0000","last_undegraded":"2024-01-19T05:18:45.295605+0000","last_fullsized":"2024-01-19T05:18:45.295605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296044+0000","last_change":"2024-01-19T05:18:45.296044+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296044+0000","last_undegraded":"2024-01-19T05:18:45.296044+0000","last_fullsized":"2024-01-19T05:18:45.296044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-19T05:18:41.345414+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:41.345414+0000","last_peered":"2024-01-19T05:18:41.345414+0000","last_clean":"2024-01-19T05:18:41.345414+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:41.345414+0000","last_undegraded":"2024-01-19T05:18:41.345414+0000","last_fullsized":"2024-01-19T05:18:41.345414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":689197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":689197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:50.821 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:50.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.972+0000 7f4671aac640 1 Processor -- start 2024-01-19T05:18:50.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.972+0000 7f4671aac640 1 -- start start 2024-01-19T05:18:50.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.972+0000 7f4671aac640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 0x7f466c071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f4671aac640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f466c1441d0 0x7f466c072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f4671aac640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c06f620 con 0x7f466c0b1870 2024-01-19T05:18:50.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f4671aac640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c141000 con 0x7f466c1441d0 2024-01-19T05:18:50.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f4671aac640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c143610 con 0x7f466c0b2ce0 2024-01-19T05:18:50.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466affd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f466c0b1870 0x7f466c143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42980/0 (socket says 172.21.15.99:42980) 2024-01-19T05:18:50.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466affd640 1 -- 172.21.15.99:0/4261560435 learned_addr learned my addr 172.21.15.99:0/4261560435 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 --2- 172.21.15.99:0/4261560435 >> v2:172.21.15.157:3300/0 conn(0x7f466c1441d0 0x7f466c072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358146703 0 0) 0x7f466c06f620 con 0x7f466c0b1870 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466b7fe640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 0x7f466c071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4654003530 con 0x7f466c0b1870 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 530176009 0 0) 0x7f4654003530 con 0x7f466c0b1870 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 msgr2=0x7f466c071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 0x7f466c071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 >> v2:172.21.15.157:3300/0 conn(0x7f466c1441d0 msgr2=0x7f466c072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 --2- 172.21.15.99:0/4261560435 >> v2:172.21.15.157:3300/0 conn(0x7f466c1441d0 0x7f466c072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c0b30c0 con 0x7f466c0b1870 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f465c001680 con 0x7f466c0b1870 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 --2- 172.21.15.99:0/4261560435 >> v2:172.21.15.157:3300/0 conn(0x7f466c1441d0 0x7f466c072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 >> v1:172.21.15.99:6789/0 conn(0x7f466c0b1870 legacy=0x7f466c143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4654003980 0x7f4654003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 0x7f46540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4654004d10 0x7f4654005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c141000 con 0x7f4654004d10 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c143610 con 0x7f4654003980 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465400ba40 con 0x7f466c0b2ce0 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4654004d10 0x7f4654005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466b7fe640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4654003980 0x7f4654003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466affd640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 0x7f46540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 -- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 msgr2=0x7f46540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 0x7f46540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 -- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4654003980 msgr2=0x7f4654003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4654003980 0x7f4654003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 -- 172.21.15.99:0/4261560435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654003530 con 0x7f4654004d10 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466b7fe640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4654003980 0x7f4654003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466affd640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f466c0b2ce0 0x7f46540047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:50.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466bfff640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4654004d10 0x7f4654005190 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46640073e0 tx=0x7f466401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea97d48981d0065 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640a5de0 con 0x7f4654004d10 2024-01-19T05:18:50.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46640ad440 con 0x7f4654004d10 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f466a7fc640 1 -- 172.21.15.99:0/4261560435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640ad7b0 con 0x7f4654004d10 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.976+0000 7f4671aac640 1 -- 172.21.15.99:0/4261560435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4654004d10 msgr2=0x7f4654005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 --2- 172.21.15.99:0/4261560435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4654004d10 0x7f4654005190 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46640073e0 tx=0x7f466401cee0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 -- 172.21.15.99:0/4261560435 reap_dead start 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- 172.21.15.99:0/4261560435 shutdown_connections 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- 172.21.15.99:0/4261560435 >> 172.21.15.99:0/4261560435 conn(0x7f466c0b8080 msgr2=0x7f466c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- 172.21.15.99:0/4261560435 shutdown_connections 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- 172.21.15.99:0/4261560435 wait complete. 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 Processor -- start 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- start start 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4654004d10 0x7f466c0b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f466c1cd8f0 0x7f466c1cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f466c06fa40 0x7f466c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1dce70 con 0x7f466c06fa40 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1cd460 con 0x7f466c1cd8f0 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1ce270 con 0x7f4654004d10 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f466c06fa40 0x7f466c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f466c06fa40 0x7f466c06fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48526/0 (socket says 172.21.15.99:48526) 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 -- 172.21.15.99:0/3262800051 learned_addr learned my addr 172.21.15.99:0/3262800051 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466affd640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f466c1cd8f0 0x7f466c1cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 -- 172.21.15.99:0/3262800051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4654004d10 msgr2=0x7f466c0b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4654004d10 0x7f466c0b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 -- 172.21.15.99:0/3262800051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f466c1cd8f0 msgr2=0x7f466c1cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f466c1cd8f0 0x7f466c1cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 -- 172.21.15.99:0/3262800051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c1cef40 con 0x7f466c06fa40 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f466bfff640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f466c06fa40 0x7f466c06fe80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f46640b0040 tx=0x7f4654005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4653fff640 1 -- 172.21.15.99:0/3262800051 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640ad9f0 con 0x7f466c06fa40 2024-01-19T05:18:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4653fff640 1 -- 172.21.15.99:0/3262800051 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46640adb70 con 0x7f466c06fa40 2024-01-19T05:18:50.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c1ccb20 con 0x7f466c06fa40 2024-01-19T05:18:50.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4653fff640 1 -- 172.21.15.99:0/3262800051 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640b6460 con 0x7f466c06fa40 2024-01-19T05:18:50.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c1cf220 con 0x7f466c06fa40 2024-01-19T05:18:50.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c0696e0 con 0x7f466c06fa40 2024-01-19T05:18:50.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.980+0000 7f4653fff640 1 -- 172.21.15.99:0/3262800051 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f46640b4070 con 0x7f466c06fa40 2024-01-19T05:18:50.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.984+0000 7f4653fff640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4658066500 0x7f46580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:50.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.984+0000 7f4653fff640 1 -- 172.21.15.99:0/3262800051 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f466411e600 con 0x7f466c06fa40 2024-01-19T05:18:50.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.984+0000 7f466b7fe640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4658066500 0x7f46580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:50.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.984+0000 7f466b7fe640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4658066500 0x7f46580689c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4660006aa0 tx=0x7f4660006a30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:50.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:50.988+0000 7f4653fff640 1 -- 172.21.15.99:0/3262800051 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f46640eb930 con 0x7f466c06fa40 2024-01-19T05:18:51.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.128+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f466c0b46a0 con 0x7f4658066500 2024-01-19T05:18:51.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.140+0000 7f4653fff640 1 -- 172.21.15.99:0/3262800051 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252097 (secure 0 0 0) 0x7f46600094f0 con 0x7f4658066500 2024-01-19T05:18:51.141 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:51.143 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4658066500 msgr2=0x7f46580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4658066500 0x7f46580689c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4660006aa0 tx=0x7f4660006a30 comp rx=0 tx=0).stop 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f466c06fa40 msgr2=0x7f466c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f466c06fa40 0x7f466c06fe80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f46640b0040 tx=0x7f4654005800 comp rx=0 tx=0).stop 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 shutdown_connections 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4658066500 0x7f46580689c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f466c06fa40 0x7f466c06fe80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f466c1cd8f0 0x7f466c1cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 --2- 172.21.15.99:0/3262800051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4654004d10 0x7f466c0b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 >> 172.21.15.99:0/3262800051 conn(0x7f466c0b8080 msgr2=0x7f466c140650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 shutdown_connections 2024-01-19T05:18:51.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.144+0000 7f4671aac640 1 -- 172.21.15.99:0/3262800051 wait complete. 2024-01-19T05:18:51.151 INFO:tasks.ceph.mds.a.smithi099.stderr:2024-01-19T05:18:51.152+0000 7f0621130640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T05:18:51.158 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-01-19T05:18:49.356128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236144,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738576,"statfs":{"total":773094113280,"available":772852301824,"internally_reserved":0,"allocated":3383296,"data_stored":1971368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.064895"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.294881+0000","last_change":"2024-01-19T05:18:45.294881+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.294881+0000","last_undegraded":"2024-01-19T05:18:45.294881+0000","last_fullsized":"2024-01-19T05:18:45.294881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297369+0000","last_change":"2024-01-19T05:18:45.297369+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297369+0000","last_undegraded":"2024-01-19T05:18:45.297369+0000","last_fullsized":"2024-01-19T05:18:45.297369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300639+0000","last_change":"2024-01-19T05:18:45.300639+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300639+0000","last_undegraded":"2024-01-19T05:18:45.300639+0000","last_fullsized":"2024-01-19T05:18:45.300639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.303548+0000","last_change":"2024-01-19T05:18:45.303548+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.303548+0000","last_undegraded":"2024-01-19T05:18:45.303548+0000","last_fullsized":"2024-01-19T05:18:45.303548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300617+0000","last_change":"2024-01-19T05:18:45.300617+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300617+0000","last_undegraded":"2024-01-19T05:18:45.300617+0000","last_fullsized":"2024-01-19T05:18:45.300617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297859+0000","last_change":"2024-01-19T05:18:45.297859+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297859+0000","last_undegraded":"2024-01-19T05:18:45.297859+0000","last_fullsized":"2024-01-19T05:18:45.297859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300617+0000","last_change":"2024-01-19T05:18:45.300617+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300617+0000","last_undegraded":"2024-01-19T05:18:45.300617+0000","last_fullsized":"2024-01-19T05:18:45.300617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.297131+0000","last_change":"2024-01-19T05:18:45.297131+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.297131+0000","last_undegraded":"2024-01-19T05:18:45.297131+0000","last_fullsized":"2024-01-19T05:18:45.297131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.293980+0000","last_change":"2024-01-19T05:18:45.293980+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.293980+0000","last_undegraded":"2024-01-19T05:18:45.293980+0000","last_fullsized":"2024-01-19T05:18:45.293980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296690+0000","last_change":"2024-01-19T05:18:45.296690+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296690+0000","last_undegraded":"2024-01-19T05:18:45.296690+0000","last_fullsized":"2024-01-19T05:18:45.296690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300631+0000","last_change":"2024-01-19T05:18:45.300631+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300631+0000","last_undegraded":"2024-01-19T05:18:45.300631+0000","last_fullsized":"2024-01-19T05:18:45.300631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299761+0000","last_change":"2024-01-19T05:18:45.299761+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299761+0000","last_undegraded":"2024-01-19T05:18:45.299761+0000","last_fullsized":"2024-01-19T05:18:45.299761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296715+0000","last_change":"2024-01-19T05:18:45.296715+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296715+0000","last_undegraded":"2024-01-19T05:18:45.296715+0000","last_fullsized":"2024-01-19T05:18:45.296715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296723+0000","last_change":"2024-01-19T05:18:45.296723+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296723+0000","last_undegraded":"2024-01-19T05:18:45.296723+0000","last_fullsized":"2024-01-19T05:18:45.296723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300048+0000","last_change":"2024-01-19T05:18:45.300048+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300048+0000","last_undegraded":"2024-01-19T05:18:45.300048+0000","last_fullsized":"2024-01-19T05:18:45.300048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300718+0000","last_change":"2024-01-19T05:18:45.300718+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300718+0000","last_undegraded":"2024-01-19T05:18:45.300718+0000","last_fullsized":"2024-01-19T05:18:45.300718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.302209+0000","last_change":"2024-01-19T05:18:45.302209+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.302209+0000","last_undegraded":"2024-01-19T05:18:45.302209+0000","last_fullsized":"2024-01-19T05:18:45.302209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.301745+0000","last_change":"2024-01-19T05:18:45.301745+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.301745+0000","last_undegraded":"2024-01-19T05:18:45.301745+0000","last_fullsized":"2024-01-19T05:18:45.301745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.294508+0000","last_change":"2024-01-19T05:18:45.294508+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.294508+0000","last_undegraded":"2024-01-19T05:18:45.294508+0000","last_fullsized":"2024-01-19T05:18:45.294508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.301918+0000","last_change":"2024-01-19T05:18:45.301918+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.301918+0000","last_undegraded":"2024-01-19T05:18:45.301918+0000","last_fullsized":"2024-01-19T05:18:45.301918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.293990+0000","last_change":"2024-01-19T05:18:45.293990+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.293990+0000","last_undegraded":"2024-01-19T05:18:45.293990+0000","last_fullsized":"2024-01-19T05:18:45.293990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.298936+0000","last_change":"2024-01-19T05:18:45.298936+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.298936+0000","last_undegraded":"2024-01-19T05:18:45.298936+0000","last_fullsized":"2024-01-19T05:18:45.298936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299243+0000","last_change":"2024-01-19T05:18:45.299243+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299243+0000","last_undegraded":"2024-01-19T05:18:45.299243+0000","last_fullsized":"2024-01-19T05:18:45.299243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:45.286222+0000","last_change":"2024-01-19T05:18:45.286222+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.286222+0000","last_undegraded":"2024-01-19T05:18:45.286222+0000","last_fullsized":"2024-01-19T05:18:45.286222+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.299285+0000","last_change":"2024-01-19T05:18:45.299285+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.299285+0000","last_undegraded":"2024-01-19T05:18:45.299285+0000","last_fullsized":"2024-01-19T05:18:45.299285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.300631+0000","last_change":"2024-01-19T05:18:45.300631+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.300631+0000","last_undegraded":"2024-01-19T05:18:45.300631+0000","last_fullsized":"2024-01-19T05:18:45.300631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.295605+0000","last_change":"2024-01-19T05:18:45.295605+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.295605+0000","last_undegraded":"2024-01-19T05:18:45.295605+0000","last_fullsized":"2024-01-19T05:18:45.295605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-19T05:18:46.289275+0000","last_change":"2024-01-19T05:18:46.289275+0000","last_active":"2024-01-19T05:18:46.289275+0000","last_peered":"2024-01-19T05:18:46.289275+0000","last_clean":"2024-01-19T05:18:46.289275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:46.289275+0000","last_undegraded":"2024-01-19T05:18:46.289275+0000","last_fullsized":"2024-01-19T05:18:46.289275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":26,"state":"creating+peering","last_fresh":"2024-01-19T05:18:45.296044+0000","last_change":"2024-01-19T05:18:45.296044+0000","last_active":"2024-01-19T05:18:45.286222+0000","last_peered":"2024-01-19T05:18:45.286222+0000","last_clean":"2024-01-19T05:18:45.286222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-19T05:18:45.296044+0000","last_undegraded":"2024-01-19T05:18:45.296044+0000","last_fullsized":"2024-01-19T05:18:45.296044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-19T05:18:41.345414+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:41.345414+0000","last_peered":"2024-01-19T05:18:41.345414+0000","last_clean":"2024-01-19T05:18:41.345414+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:41.345414+0000","last_undegraded":"2024-01-19T05:18:41.345414+0000","last_fullsized":"2024-01-19T05:18:41.345414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":689197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":98829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":689197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:51.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-01-19T05:18:51.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-01-19T05:18:51.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-01-19T05:18:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-01-19T05:18:51.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-01-19T05:18:51.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.294881+0000', 'last_change': '2024-01-19T05:18:45.294881+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.294881+0000', 'last_undegraded': '2024-01-19T05:18:45.294881+0000', 'last_fullsized': '2024-01-19T05:18:45.294881+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-01-19T05:18:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:45.286222+0000', 'last_change': '2024-01-19T05:18:45.286222+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.286222+0000', 'last_undegraded': '2024-01-19T05:18:45.286222+0000', 'last_fullsized': '2024-01-19T05:18:45.286222+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.297369+0000', 'last_change': '2024-01-19T05:18:45.297369+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.297369+0000', 'last_undegraded': '2024-01-19T05:18:45.297369+0000', 'last_fullsized': '2024-01-19T05:18:45.297369+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.300639+0000', 'last_change': '2024-01-19T05:18:45.300639+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.300639+0000', 'last_undegraded': '2024-01-19T05:18:45.300639+0000', 'last_fullsized': '2024-01-19T05:18:45.300639+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.303548+0000', 'last_change': '2024-01-19T05:18:45.303548+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.303548+0000', 'last_undegraded': '2024-01-19T05:18:45.303548+0000', 'last_fullsized': '2024-01-19T05:18:45.303548+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.300617+0000', 'last_change': '2024-01-19T05:18:45.300617+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.300617+0000', 'last_undegraded': '2024-01-19T05:18:45.300617+0000', 'last_fullsized': '2024-01-19T05:18:45.300617+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.297859+0000', 'last_change': '2024-01-19T05:18:45.297859+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.297859+0000', 'last_undegraded': '2024-01-19T05:18:45.297859+0000', 'last_fullsized': '2024-01-19T05:18:45.297859+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-01-19T05:18:51.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.300617+0000', 'last_change': '2024-01-19T05:18:45.300617+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.300617+0000', 'last_undegraded': '2024-01-19T05:18:45.300617+0000', 'last_fullsized': '2024-01-19T05:18:45.300617+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.297131+0000', 'last_change': '2024-01-19T05:18:45.297131+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.297131+0000', 'last_undegraded': '2024-01-19T05:18:45.297131+0000', 'last_fullsized': '2024-01-19T05:18:45.297131+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:45.286222+0000', 'last_change': '2024-01-19T05:18:45.286222+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.286222+0000', 'last_undegraded': '2024-01-19T05:18:45.286222+0000', 'last_fullsized': '2024-01-19T05:18:45.286222+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-01-19T05:18:51.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.293980+0000', 'last_change': '2024-01-19T05:18:45.293980+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.293980+0000', 'last_undegraded': '2024-01-19T05:18:45.293980+0000', 'last_fullsized': '2024-01-19T05:18:45.293980+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.296690+0000', 'last_change': '2024-01-19T05:18:45.296690+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.296690+0000', 'last_undegraded': '2024-01-19T05:18:45.296690+0000', 'last_fullsized': '2024-01-19T05:18:45.296690+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.300631+0000', 'last_change': '2024-01-19T05:18:45.300631+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.300631+0000', 'last_undegraded': '2024-01-19T05:18:45.300631+0000', 'last_fullsized': '2024-01-19T05:18:45.300631+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.299761+0000', 'last_change': '2024-01-19T05:18:45.299761+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.299761+0000', 'last_undegraded': '2024-01-19T05:18:45.299761+0000', 'last_fullsized': '2024-01-19T05:18:45.299761+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.296715+0000', 'last_change': '2024-01-19T05:18:45.296715+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.296715+0000', 'last_undegraded': '2024-01-19T05:18:45.296715+0000', 'last_fullsized': '2024-01-19T05:18:45.296715+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.296723+0000', 'last_change': '2024-01-19T05:18:45.296723+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.296723+0000', 'last_undegraded': '2024-01-19T05:18:45.296723+0000', 'last_fullsized': '2024-01-19T05:18:45.296723+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-19T05:18:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.300048+0000', 'last_change': '2024-01-19T05:18:45.300048+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.300048+0000', 'last_undegraded': '2024-01-19T05:18:45.300048+0000', 'last_fullsized': '2024-01-19T05:18:45.300048+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.300718+0000', 'last_change': '2024-01-19T05:18:45.300718+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.300718+0000', 'last_undegraded': '2024-01-19T05:18:45.300718+0000', 'last_fullsized': '2024-01-19T05:18:45.300718+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-01-19T05:18:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.302209+0000', 'last_change': '2024-01-19T05:18:45.302209+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.302209+0000', 'last_undegraded': '2024-01-19T05:18:45.302209+0000', 'last_fullsized': '2024-01-19T05:18:45.302209+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.301745+0000', 'last_change': '2024-01-19T05:18:45.301745+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.301745+0000', 'last_undegraded': '2024-01-19T05:18:45.301745+0000', 'last_fullsized': '2024-01-19T05:18:45.301745+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:45.286222+0000', 'last_change': '2024-01-19T05:18:45.286222+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.286222+0000', 'last_undegraded': '2024-01-19T05:18:45.286222+0000', 'last_fullsized': '2024-01-19T05:18:45.286222+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.294508+0000', 'last_change': '2024-01-19T05:18:45.294508+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.294508+0000', 'last_undegraded': '2024-01-19T05:18:45.294508+0000', 'last_fullsized': '2024-01-19T05:18:45.294508+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.301918+0000', 'last_change': '2024-01-19T05:18:45.301918+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.301918+0000', 'last_undegraded': '2024-01-19T05:18:45.301918+0000', 'last_fullsized': '2024-01-19T05:18:45.301918+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.293990+0000', 'last_change': '2024-01-19T05:18:45.293990+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.293990+0000', 'last_undegraded': '2024-01-19T05:18:45.293990+0000', 'last_fullsized': '2024-01-19T05:18:45.293990+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-01-19T05:18:51.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.298936+0000', 'last_change': '2024-01-19T05:18:45.298936+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.298936+0000', 'last_undegraded': '2024-01-19T05:18:45.298936+0000', 'last_fullsized': '2024-01-19T05:18:45.298936+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:45.286222+0000', 'last_change': '2024-01-19T05:18:45.286222+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.286222+0000', 'last_undegraded': '2024-01-19T05:18:45.286222+0000', 'last_fullsized': '2024-01-19T05:18:45.286222+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.299243+0000', 'last_change': '2024-01-19T05:18:45.299243+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.299243+0000', 'last_undegraded': '2024-01-19T05:18:45.299243+0000', 'last_fullsized': '2024-01-19T05:18:45.299243+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T05:18:51.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:45.286222+0000', 'last_change': '2024-01-19T05:18:45.286222+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.286222+0000', 'last_undegraded': '2024-01-19T05:18:45.286222+0000', 'last_fullsized': '2024-01-19T05:18:45.286222+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.299285+0000', 'last_change': '2024-01-19T05:18:45.299285+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.299285+0000', 'last_undegraded': '2024-01-19T05:18:45.299285+0000', 'last_fullsized': '2024-01-19T05:18:45.299285+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.300631+0000', 'last_change': '2024-01-19T05:18:45.300631+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.300631+0000', 'last_undegraded': '2024-01-19T05:18:45.300631+0000', 'last_fullsized': '2024-01-19T05:18:45.300631+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-19T05:18:51.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-01-19T05:18:51.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-01-19T05:18:51.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.295605+0000', 'last_change': '2024-01-19T05:18:45.295605+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.295605+0000', 'last_undegraded': '2024-01-19T05:18:45.295605+0000', 'last_fullsized': '2024-01-19T05:18:45.295605+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-19T05:18:51.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-01-19T05:18:51.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-19T05:18:46.289275+0000', 'last_change': '2024-01-19T05:18:46.289275+0000', 'last_active': '2024-01-19T05:18:46.289275+0000', 'last_peered': '2024-01-19T05:18:46.289275+0000', 'last_clean': '2024-01-19T05:18:46.289275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:46.289275+0000', 'last_undegraded': '2024-01-19T05:18:46.289275+0000', 'last_fullsized': '2024-01-19T05:18:46.289275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:46.289275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-19T05:18:51.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-01-19T05:18:51.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 26, 'state': 'creating+peering', 'last_fresh': '2024-01-19T05:18:45.296044+0000', 'last_change': '2024-01-19T05:18:45.296044+0000', 'last_active': '2024-01-19T05:18:45.286222+0000', 'last_peered': '2024-01-19T05:18:45.286222+0000', 'last_clean': '2024-01-19T05:18:45.286222+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-19T05:18:45.296044+0000', 'last_undegraded': '2024-01-19T05:18:45.296044+0000', 'last_fullsized': '2024-01-19T05:18:45.296044+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'last_clean_scrub_stamp': '2024-01-19T05:18:45.286222+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-19T05:18:51.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-19T05:18:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f600e0be640 1 Processor -- start 2024-01-19T05:18:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f600e0be640 1 -- start start 2024-01-19T05:18:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f600e0be640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f600806ebe0 0x7f6008071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f600e0be640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6008072320 0x7f600814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f600e0be640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600806f070 con 0x7f60080b19f0 2024-01-19T05:18:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f600e0be640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008070680 con 0x7f6008072320 2024-01-19T05:18:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f600e0be640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6008070410 con 0x7f600806ebe0 2024-01-19T05:18:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f6007fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6008072320 0x7f600814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f6007fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6008072320 0x7f600814ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48532/0 (socket says 172.21.15.99:48532) 2024-01-19T05:18:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f6007fff640 1 -- 172.21.15.99:0/1520069983 learned_addr learned my addr 172.21.15.99:0/1520069983 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f6006ffd640 1 --2- 172.21.15.99:0/1520069983 >> v2:172.21.15.157:3300/0 conn(0x7f600806ebe0 0x7f6008071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f6007fff640 1 -- 172.21.15.99:0/1520069983 >> v2:172.21.15.157:3300/0 conn(0x7f600806ebe0 msgr2=0x7f6008071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f6007fff640 1 --2- 172.21.15.99:0/1520069983 >> v2:172.21.15.157:3300/0 conn(0x7f600806ebe0 0x7f6008071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f6007fff640 1 -- 172.21.15.99:0/1520069983 >> v1:172.21.15.157:6789/0 conn(0x7f60080b19f0 legacy=0x7f6008144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.320+0000 7f6007fff640 1 -- 172.21.15.99:0/1520069983 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008144790 con 0x7f6008072320 2024-01-19T05:18:51.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f6007fff640 1 --2- 172.21.15.99:0/1520069983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008072320 0x7f600814ee90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6008072cc0 tx=0x7f600001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a33ce74b5d27e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:51.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f60067fc640 1 -- 172.21.15.99:0/1520069983 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60000a57f0 con 0x7f6008072320 2024-01-19T05:18:51.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f60067fc640 1 -- 172.21.15.99:0/1520069983 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60000a5950 con 0x7f6008072320 2024-01-19T05:18:51.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f60067fc640 1 -- 172.21.15.99:0/1520069983 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60000a5ce0 con 0x7f6008072320 2024-01-19T05:18:51.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 -- 172.21.15.99:0/1520069983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008072320 msgr2=0x7f600814ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 --2- 172.21.15.99:0/1520069983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008072320 0x7f600814ee90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6008072cc0 tx=0x7f600001c910 comp rx=0 tx=0).stop 2024-01-19T05:18:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 -- 172.21.15.99:0/1520069983 shutdown_connections 2024-01-19T05:18:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 --2- 172.21.15.99:0/1520069983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008072320 0x7f600814ee90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 --2- 172.21.15.99:0/1520069983 >> v2:172.21.15.157:3300/0 conn(0x7f600806ebe0 0x7f6008071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 -- 172.21.15.99:0/1520069983 >> 172.21.15.99:0/1520069983 conn(0x7f60080b8080 msgr2=0x7f60080b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 -- 172.21.15.99:0/1520069983 shutdown_connections 2024-01-19T05:18:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 -- 172.21.15.99:0/1520069983 wait complete. 2024-01-19T05:18:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 Processor -- start 2024-01-19T05:18:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.324+0000 7f600e0be640 1 -- start start 2024-01-19T05:18:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f600806ebe0 0x7f6008136dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008072320 0x7f600813ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60080b19f0 0x7f600813f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600813fa90 con 0x7f60080b19f0 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6008141800 con 0x7f6008072320 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600813d1a0 con 0x7f600806ebe0 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60080b19f0 0x7f600813f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60080b19f0 0x7f600813f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48534/0 (socket says 172.21.15.99:48534) 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 -- 172.21.15.99:0/3619023562 learned_addr learned my addr 172.21.15.99:0/3619023562 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6006ffd640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008072320 0x7f600813ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f60077fe640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f600806ebe0 0x7f6008136dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 -- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f600806ebe0 msgr2=0x7f6008136dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f600806ebe0 0x7f6008136dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 -- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008072320 msgr2=0x7f600813ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008072320 0x7f600813ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 -- 172.21.15.99:0/3619023562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000009b30 con 0x7f60080b19f0 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6006ffd640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008072320 0x7f600813ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:51.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f60077fe640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f600806ebe0 0x7f6008136dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f6007fff640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60080b19f0 0x7f600813f120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6000019520 tx=0x7f60000196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f5feffff640 1 -- 172.21.15.99:0/3619023562 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60000b8670 con 0x7f60080b19f0 2024-01-19T05:18:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f5feffff640 1 -- 172.21.15.99:0/3619023562 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60000b87d0 con 0x7f60080b19f0 2024-01-19T05:18:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600813f720 con 0x7f60080b19f0 2024-01-19T05:18:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f5feffff640 1 -- 172.21.15.99:0/3619023562 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60000b8b60 con 0x7f60080b19f0 2024-01-19T05:18:51.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6008071de0 con 0x7f60080b19f0 2024-01-19T05:18:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60081dcc30 con 0x7f60080b19f0 2024-01-19T05:18:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f5feffff640 1 -- 172.21.15.99:0/3619023562 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f60000b8cc0 con 0x7f60080b19f0 2024-01-19T05:18:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f5feffff640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5ff4066530 0x7f5ff40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f5feffff640 1 -- 172.21.15.99:0/3619023562 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f600011ed80 con 0x7f60080b19f0 2024-01-19T05:18:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f60077fe640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5ff4066530 0x7f5ff40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.328+0000 7f60077fe640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5ff4066530 0x7f5ff40689f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8001650 tx=0x7f5ff8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:51.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.332+0000 7f5feffff640 1 -- 172.21.15.99:0/3619023562 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f60000ec140 con 0x7f60080b19f0 2024-01-19T05:18:51.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f60080696e0 con 0x7f60080b19f0 2024-01-19T05:18:51.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f5feffff640 1 -- 172.21.15.99:0/3619023562 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1302 (secure 0 0 0) 0x7f60000ef760 con 0x7f60080b19f0 2024-01-19T05:18:51.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:51.551 INFO:teuthology.orchestra.run.smithi099.stdout:{"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":72,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":29,"num_osds":8,"num_up_osds":8,"osd_up_since":1705641469,"num_in_osds":8,"osd_in_since":1705641461,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":246513664,"bytes_avail":772847599616,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4977}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-01-19T05:18:51.356948+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-19T05:18:51.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5ff4066530 msgr2=0x7f5ff40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5ff4066530 0x7f5ff40689f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8001650 tx=0x7f5ff8009040 comp rx=0 tx=0).stop 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60080b19f0 msgr2=0x7f600813f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60080b19f0 0x7f600813f120 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6000019520 tx=0x7f60000196b0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 shutdown_connections 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5ff4066530 0x7f5ff40689f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60080b19f0 0x7f600813f120 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6008072320 0x7f600813ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 --2- 172.21.15.99:0/3619023562 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f600806ebe0 0x7f6008136dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 >> 172.21.15.99:0/3619023562 conn(0x7f60080b8080 msgr2=0x7f60080735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 shutdown_connections 2024-01-19T05:18:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.552+0000 7f600e0be640 1 -- 172.21.15.99:0/3619023562 wait complete. 2024-01-19T05:18:51.570 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-19T05:18:51.570 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:51.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd918d57640 1 Processor -- start 2024-01-19T05:18:51.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd918d57640 1 -- start start 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd918d57640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd9140b19f0 0x7fd91406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd918d57640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd914144c70 0x7fd9141450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd918d57640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd914070680 con 0x7fd914071de0 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd918d57640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd914070410 con 0x7fd9140b19f0 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd918d57640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd914144790 con 0x7fd914144c70 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd91259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd9140b19f0 0x7fd91406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd911d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd914144c70 0x7fd9141450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd912d9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd914071de0 0x7fd914072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:58806/0 (socket says 172.21.15.99:58806) 2024-01-19T05:18:51.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd912d9d640 1 -- 172.21.15.99:0/1860803278 learned_addr learned my addr 172.21.15.99:0/1860803278 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:51.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd91259c640 1 -- 172.21.15.99:0/1860803278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd914144c70 msgr2=0x7fd9141450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:51.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd91259c640 1 --2- 172.21.15.99:0/1860803278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd914144c70 0x7fd9141450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd91259c640 1 -- 172.21.15.99:0/1860803278 >> v1:172.21.15.157:6789/0 conn(0x7fd914071de0 legacy=0x7fd914072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.680+0000 7fd91259c640 1 -- 172.21.15.99:0/1860803278 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91406f2b0 con 0x7fd9140b19f0 2024-01-19T05:18:51.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 --2- 172.21.15.99:0/1860803278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9140b19f0 0x7fd91406ebe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd9040097c0 tx=0x7fd90401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58e22eb56f49c2bc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:51.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91159a640 1 -- 172.21.15.99:0/1860803278 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904004230 con 0x7fd9140b19f0 2024-01-19T05:18:51.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91159a640 1 -- 172.21.15.99:0/1860803278 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9040a7050 con 0x7fd9140b19f0 2024-01-19T05:18:51.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91159a640 1 -- 172.21.15.99:0/1860803278 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904003620 con 0x7fd9140b19f0 2024-01-19T05:18:51.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- 172.21.15.99:0/1860803278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9140b19f0 msgr2=0x7fd91406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 --2- 172.21.15.99:0/1860803278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9140b19f0 0x7fd91406ebe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd9040097c0 tx=0x7fd90401c3f0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- 172.21.15.99:0/1860803278 shutdown_connections 2024-01-19T05:18:51.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 --2- 172.21.15.99:0/1860803278 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd914144c70 0x7fd9141450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 --2- 172.21.15.99:0/1860803278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9140b19f0 0x7fd91406ebe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- 172.21.15.99:0/1860803278 >> 172.21.15.99:0/1860803278 conn(0x7fd9140b8080 msgr2=0x7fd9140b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:51.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- 172.21.15.99:0/1860803278 shutdown_connections 2024-01-19T05:18:51.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- 172.21.15.99:0/1860803278 wait complete. 2024-01-19T05:18:51.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 Processor -- start 2024-01-19T05:18:51.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- start start 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd914071de0 0x7fd91413c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9140b19f0 0x7fd9141372c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914144c70 0x7fd9141e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd914137b20 con 0x7fd914071de0 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91413d490 con 0x7fd914144c70 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd918d57640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91413f260 con 0x7fd9140b19f0 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd914071de0 0x7fd91413c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd914071de0 0x7fd91413c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48540/0 (socket says 172.21.15.99:48540) 2024-01-19T05:18:51.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 -- 172.21.15.99:0/3416571976 learned_addr learned my addr 172.21.15.99:0/3416571976 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd911d9b640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9140b19f0 0x7fd9141372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd912d9d640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914144c70 0x7fd9141e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 -- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9140b19f0 msgr2=0x7fd9141372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9140b19f0 0x7fd9141372c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 -- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914144c70 msgr2=0x7fd9141e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914144c70 0x7fd9141e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd91259c640 1 -- 172.21.15.99:0/3416571976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd904009420 con 0x7fd914071de0 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.684+0000 7fd911d9b640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9140b19f0 0x7fd9141372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd91259c640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd914071de0 0x7fd91413c420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd9040ae040 tx=0x7fd904019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd902ffd640 1 -- 172.21.15.99:0/3416571976 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904003b70 con 0x7fd914071de0 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd902ffd640 1 -- 172.21.15.99:0/3416571976 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd904003cd0 con 0x7fd914071de0 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91413ea60 con 0x7fd914071de0 2024-01-19T05:18:51.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd902ffd640 1 -- 172.21.15.99:0/3416571976 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9040ab660 con 0x7fd914071de0 2024-01-19T05:18:51.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91413b600 con 0x7fd914071de0 2024-01-19T05:18:51.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91413e8c0 con 0x7fd914071de0 2024-01-19T05:18:51.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd902ffd640 1 -- 172.21.15.99:0/3416571976 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd9040b2040 con 0x7fd914071de0 2024-01-19T05:18:51.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd902ffd640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8f4066500 0x7fd8f40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:51.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd902ffd640 1 -- 172.21.15.99:0/3416571976 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd90411dda0 con 0x7fd914071de0 2024-01-19T05:18:51.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd911d9b640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8f4066500 0x7fd8f40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:51.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.688+0000 7fd911d9b640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8f4066500 0x7fd8f40689c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9141e1620 tx=0x7fd908008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:51.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.692+0000 7fd902ffd640 1 -- 172.21.15.99:0/3416571976 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd91413e8c0 con 0x7fd914071de0 2024-01-19T05:18:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.840+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd91406edf0 con 0x7fd8f4066500 2024-01-19T05:18:51.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.852+0000 7fd902ffd640 1 -- 172.21.15.99:0/3416571976 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264626 (secure 0 0 0) 0x7fd91406edf0 con 0x7fd8f4066500 2024-01-19T05:18:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:51.855 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8f4066500 msgr2=0x7fd8f40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8f4066500 0x7fd8f40689c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9141e1620 tx=0x7fd908008040 comp rx=0 tx=0).stop 2024-01-19T05:18:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd914071de0 msgr2=0x7fd91413c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd914071de0 0x7fd91413c420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd9040ae040 tx=0x7fd904019190 comp rx=0 tx=0).stop 2024-01-19T05:18:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 shutdown_connections 2024-01-19T05:18:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8f4066500 0x7fd8f40689c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914144c70 0x7fd9141e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd9140b19f0 0x7fd9141372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 --2- 172.21.15.99:0/3416571976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd914071de0 0x7fd91413c420 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:51.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 >> 172.21.15.99:0/3416571976 conn(0x7fd9140b8080 msgr2=0x7fd91413a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:51.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 shutdown_connections 2024-01-19T05:18:51.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:51.856+0000 7fd918d57640 1 -- 172.21.15.99:0/3416571976 wait complete. 2024-01-19T05:18:51.870 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-01-19T05:18:51.356734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240736,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733984,"statfs":{"total":773094113280,"available":772847599616,"internally_reserved":0,"allocated":3842048,"data_stored":2177460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001345"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.343339+0000","last_change":"2024-01-19T05:18:47.356994+0000","last_active":"2024-01-19T05:18:48.343339+0000","last_peered":"2024-01-19T05:18:48.343339+0000","last_clean":"2024-01-19T05:18:48.343339+0000","last_became_active":"2024-01-19T05:18:47.356397+0000","last_became_peered":"2024-01-19T05:18:47.356397+0000","last_unstale":"2024-01-19T05:18:48.343339+0000","last_undegraded":"2024-01-19T05:18:48.343339+0000","last_fullsized":"2024-01-19T05:18:48.343339+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:07.575090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342182+0000","last_change":"2024-01-19T05:18:47.361721+0000","last_active":"2024-01-19T05:18:48.342182+0000","last_peered":"2024-01-19T05:18:48.342182+0000","last_clean":"2024-01-19T05:18:48.342182+0000","last_became_active":"2024-01-19T05:18:47.360669+0000","last_became_peered":"2024-01-19T05:18:47.360669+0000","last_unstale":"2024-01-19T05:18:48.342182+0000","last_undegraded":"2024-01-19T05:18:48.342182+0000","last_fullsized":"2024-01-19T05:18:48.342182+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:12.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921606+0000","last_change":"2024-01-19T05:18:47.347089+0000","last_active":"2024-01-19T05:18:48.921606+0000","last_peered":"2024-01-19T05:18:48.921606+0000","last_clean":"2024-01-19T05:18:48.921606+0000","last_became_active":"2024-01-19T05:18:47.346472+0000","last_became_peered":"2024-01-19T05:18:47.346472+0000","last_unstale":"2024-01-19T05:18:48.921606+0000","last_undegraded":"2024-01-19T05:18:48.921606+0000","last_fullsized":"2024-01-19T05:18:48.921606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:49:03.050028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828452+0000","last_change":"2024-01-19T05:18:47.378978+0000","last_active":"2024-01-19T05:18:48.828452+0000","last_peered":"2024-01-19T05:18:48.828452+0000","last_clean":"2024-01-19T05:18:48.828452+0000","last_became_active":"2024-01-19T05:18:47.378517+0000","last_became_peered":"2024-01-19T05:18:47.378517+0000","last_unstale":"2024-01-19T05:18:48.828452+0000","last_undegraded":"2024-01-19T05:18:48.828452+0000","last_fullsized":"2024-01-19T05:18:48.828452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:10:11.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341940+0000","last_change":"2024-01-19T05:18:47.352475+0000","last_active":"2024-01-19T05:18:48.341940+0000","last_peered":"2024-01-19T05:18:48.341940+0000","last_clean":"2024-01-19T05:18:48.341940+0000","last_became_active":"2024-01-19T05:18:47.352220+0000","last_became_peered":"2024-01-19T05:18:47.352220+0000","last_unstale":"2024-01-19T05:18:48.341940+0000","last_undegraded":"2024-01-19T05:18:48.341940+0000","last_fullsized":"2024-01-19T05:18:48.341940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:07.074519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341426+0000","last_change":"2024-01-19T05:18:47.361688+0000","last_active":"2024-01-19T05:18:48.341426+0000","last_peered":"2024-01-19T05:18:48.341426+0000","last_clean":"2024-01-19T05:18:48.341426+0000","last_became_active":"2024-01-19T05:18:47.359832+0000","last_became_peered":"2024-01-19T05:18:47.359832+0000","last_unstale":"2024-01-19T05:18:48.341426+0000","last_undegraded":"2024-01-19T05:18:48.341426+0000","last_fullsized":"2024-01-19T05:18:48.341426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:49:03.050028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454584+0000","last_change":"2024-01-19T05:18:47.364864+0000","last_active":"2024-01-19T05:18:48.454584+0000","last_peered":"2024-01-19T05:18:48.454584+0000","last_clean":"2024-01-19T05:18:48.454584+0000","last_became_active":"2024-01-19T05:18:47.361274+0000","last_became_peered":"2024-01-19T05:18:47.361274+0000","last_unstale":"2024-01-19T05:18:48.454584+0000","last_undegraded":"2024-01-19T05:18:48.454584+0000","last_fullsized":"2024-01-19T05:18:48.454584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:50.265741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454156+0000","last_change":"2024-01-19T05:18:47.370612+0000","last_active":"2024-01-19T05:18:48.454156+0000","last_peered":"2024-01-19T05:18:48.454156+0000","last_clean":"2024-01-19T05:18:48.454156+0000","last_became_active":"2024-01-19T05:18:47.342665+0000","last_became_peered":"2024-01-19T05:18:47.342665+0000","last_unstale":"2024-01-19T05:18:48.454156+0000","last_undegraded":"2024-01-19T05:18:48.454156+0000","last_fullsized":"2024-01-19T05:18:48.454156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:42:44.642617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.421477+0000","last_change":"2024-01-19T05:18:47.384795+0000","last_active":"2024-01-19T05:18:48.421477+0000","last_peered":"2024-01-19T05:18:48.421477+0000","last_clean":"2024-01-19T05:18:48.421477+0000","last_became_active":"2024-01-19T05:18:47.384076+0000","last_became_peered":"2024-01-19T05:18:47.384076+0000","last_unstale":"2024-01-19T05:18:48.421477+0000","last_undegraded":"2024-01-19T05:18:48.421477+0000","last_fullsized":"2024-01-19T05:18:48.421477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:08.042636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828842+0000","last_change":"2024-01-19T05:18:47.353322+0000","last_active":"2024-01-19T05:18:48.828842+0000","last_peered":"2024-01-19T05:18:48.828842+0000","last_clean":"2024-01-19T05:18:48.828842+0000","last_became_active":"2024-01-19T05:18:47.353019+0000","last_became_peered":"2024-01-19T05:18:47.353019+0000","last_unstale":"2024-01-19T05:18:48.828842+0000","last_undegraded":"2024-01-19T05:18:48.828842+0000","last_fullsized":"2024-01-19T05:18:48.828842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:22.652535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.455116+0000","last_change":"2024-01-19T05:18:47.340924+0000","last_active":"2024-01-19T05:18:48.455116+0000","last_peered":"2024-01-19T05:18:48.455116+0000","last_clean":"2024-01-19T05:18:48.455116+0000","last_became_active":"2024-01-19T05:18:47.340062+0000","last_became_peered":"2024-01-19T05:18:47.340062+0000","last_unstale":"2024-01-19T05:18:48.455116+0000","last_undegraded":"2024-01-19T05:18:48.455116+0000","last_fullsized":"2024-01-19T05:18:48.455116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:30:36.095975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921521+0000","last_change":"2024-01-19T05:18:47.355413+0000","last_active":"2024-01-19T05:18:48.921521+0000","last_peered":"2024-01-19T05:18:48.921521+0000","last_clean":"2024-01-19T05:18:48.921521+0000","last_became_active":"2024-01-19T05:18:47.354687+0000","last_became_peered":"2024-01-19T05:18:47.354687+0000","last_unstale":"2024-01-19T05:18:48.921521+0000","last_undegraded":"2024-01-19T05:18:48.921521+0000","last_fullsized":"2024-01-19T05:18:48.921521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:27:38.933913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342017+0000","last_change":"2024-01-19T05:18:47.332704+0000","last_active":"2024-01-19T05:18:48.342017+0000","last_peered":"2024-01-19T05:18:48.342017+0000","last_clean":"2024-01-19T05:18:48.342017+0000","last_became_active":"2024-01-19T05:18:47.332387+0000","last_became_peered":"2024-01-19T05:18:47.332387+0000","last_unstale":"2024-01-19T05:18:48.342017+0000","last_undegraded":"2024-01-19T05:18:48.342017+0000","last_fullsized":"2024-01-19T05:18:48.342017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:55:20.448095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341550+0000","last_change":"2024-01-19T05:18:47.351032+0000","last_active":"2024-01-19T05:18:48.341550+0000","last_peered":"2024-01-19T05:18:48.341550+0000","last_clean":"2024-01-19T05:18:48.341550+0000","last_became_active":"2024-01-19T05:18:47.349517+0000","last_became_peered":"2024-01-19T05:18:47.349517+0000","last_unstale":"2024-01-19T05:18:48.341550+0000","last_undegraded":"2024-01-19T05:18:48.341550+0000","last_fullsized":"2024-01-19T05:18:48.341550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:14:38.070895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921134+0000","last_change":"2024-01-19T05:18:47.359495+0000","last_active":"2024-01-19T05:18:48.921134+0000","last_peered":"2024-01-19T05:18:48.921134+0000","last_clean":"2024-01-19T05:18:48.921134+0000","last_became_active":"2024-01-19T05:18:47.356897+0000","last_became_peered":"2024-01-19T05:18:47.356897+0000","last_unstale":"2024-01-19T05:18:48.921134+0000","last_undegraded":"2024-01-19T05:18:48.921134+0000","last_fullsized":"2024-01-19T05:18:48.921134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:58.555110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454958+0000","last_change":"2024-01-19T05:18:47.373476+0000","last_active":"2024-01-19T05:18:48.454958+0000","last_peered":"2024-01-19T05:18:48.454958+0000","last_clean":"2024-01-19T05:18:48.454958+0000","last_became_active":"2024-01-19T05:18:47.372744+0000","last_became_peered":"2024-01-19T05:18:47.372744+0000","last_unstale":"2024-01-19T05:18:48.454958+0000","last_undegraded":"2024-01-19T05:18:48.454958+0000","last_fullsized":"2024-01-19T05:18:48.454958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:48:11.050965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.455220+0000","last_change":"2024-01-19T05:18:47.360441+0000","last_active":"2024-01-19T05:18:48.455220+0000","last_peered":"2024-01-19T05:18:48.455220+0000","last_clean":"2024-01-19T05:18:48.455220+0000","last_became_active":"2024-01-19T05:18:47.359787+0000","last_became_peered":"2024-01-19T05:18:47.359787+0000","last_unstale":"2024-01-19T05:18:48.455220+0000","last_undegraded":"2024-01-19T05:18:48.455220+0000","last_fullsized":"2024-01-19T05:18:48.455220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:12.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342246+0000","last_change":"2024-01-19T05:18:47.359867+0000","last_active":"2024-01-19T05:18:48.342246+0000","last_peered":"2024-01-19T05:18:48.342246+0000","last_clean":"2024-01-19T05:18:48.342246+0000","last_became_active":"2024-01-19T05:18:47.353362+0000","last_became_peered":"2024-01-19T05:18:47.353362+0000","last_unstale":"2024-01-19T05:18:48.342246+0000","last_undegraded":"2024-01-19T05:18:48.342246+0000","last_fullsized":"2024-01-19T05:18:48.342246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:59.630917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342428+0000","last_change":"2024-01-19T05:18:47.359897+0000","last_active":"2024-01-19T05:18:48.342428+0000","last_peered":"2024-01-19T05:18:48.342428+0000","last_clean":"2024-01-19T05:18:48.342428+0000","last_became_active":"2024-01-19T05:18:47.353308+0000","last_became_peered":"2024-01-19T05:18:47.353308+0000","last_unstale":"2024-01-19T05:18:48.342428+0000","last_undegraded":"2024-01-19T05:18:48.342428+0000","last_fullsized":"2024-01-19T05:18:48.342428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:47:35.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341827+0000","last_change":"2024-01-19T05:18:47.350455+0000","last_active":"2024-01-19T05:18:48.341827+0000","last_peered":"2024-01-19T05:18:48.341827+0000","last_clean":"2024-01-19T05:18:48.341827+0000","last_became_active":"2024-01-19T05:18:47.350243+0000","last_became_peered":"2024-01-19T05:18:47.350243+0000","last_unstale":"2024-01-19T05:18:48.341827+0000","last_undegraded":"2024-01-19T05:18:48.341827+0000","last_fullsized":"2024-01-19T05:18:48.341827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:45.426277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420754+0000","last_change":"2024-01-19T05:18:47.384150+0000","last_active":"2024-01-19T05:18:48.420754+0000","last_peered":"2024-01-19T05:18:48.420754+0000","last_clean":"2024-01-19T05:18:48.420754+0000","last_became_active":"2024-01-19T05:18:47.383651+0000","last_became_peered":"2024-01-19T05:18:47.383651+0000","last_unstale":"2024-01-19T05:18:48.420754+0000","last_undegraded":"2024-01-19T05:18:48.420754+0000","last_fullsized":"2024-01-19T05:18:48.420754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:17:47.619046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420919+0000","last_change":"2024-01-19T05:18:47.376638+0000","last_active":"2024-01-19T05:18:48.420919+0000","last_peered":"2024-01-19T05:18:48.420919+0000","last_clean":"2024-01-19T05:18:48.420919+0000","last_became_active":"2024-01-19T05:18:47.376030+0000","last_became_peered":"2024-01-19T05:18:47.376030+0000","last_unstale":"2024-01-19T05:18:48.420919+0000","last_undegraded":"2024-01-19T05:18:48.420919+0000","last_fullsized":"2024-01-19T05:18:48.420919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:34.529608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921317+0000","last_change":"2024-01-19T05:18:47.366501+0000","last_active":"2024-01-19T05:18:48.921317+0000","last_peered":"2024-01-19T05:18:48.921317+0000","last_clean":"2024-01-19T05:18:48.921317+0000","last_became_active":"2024-01-19T05:18:47.366217+0000","last_became_peered":"2024-01-19T05:18:47.366217+0000","last_unstale":"2024-01-19T05:18:48.921317+0000","last_undegraded":"2024-01-19T05:18:48.921317+0000","last_fullsized":"2024-01-19T05:18:48.921317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:02:13.097874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921032+0000","last_change":"2024-01-19T05:18:47.351269+0000","last_active":"2024-01-19T05:18:48.921032+0000","last_peered":"2024-01-19T05:18:48.921032+0000","last_clean":"2024-01-19T05:18:48.921032+0000","last_became_active":"2024-01-19T05:18:47.350600+0000","last_became_peered":"2024-01-19T05:18:47.350600+0000","last_unstale":"2024-01-19T05:18:48.921032+0000","last_undegraded":"2024-01-19T05:18:48.921032+0000","last_fullsized":"2024-01-19T05:18:48.921032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:21.691525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828942+0000","last_change":"2024-01-19T05:18:47.343140+0000","last_active":"2024-01-19T05:18:48.828942+0000","last_peered":"2024-01-19T05:18:48.828942+0000","last_clean":"2024-01-19T05:18:48.828942+0000","last_became_active":"2024-01-19T05:18:47.342811+0000","last_became_peered":"2024-01-19T05:18:47.342811+0000","last_unstale":"2024-01-19T05:18:48.828942+0000","last_undegraded":"2024-01-19T05:18:48.828942+0000","last_fullsized":"2024-01-19T05:18:48.828942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:42:44.642617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342336+0000","last_change":"2024-01-19T05:18:47.371456+0000","last_active":"2024-01-19T05:18:48.342336+0000","last_peered":"2024-01-19T05:18:48.342336+0000","last_clean":"2024-01-19T05:18:48.342336+0000","last_became_active":"2024-01-19T05:18:47.370969+0000","last_became_peered":"2024-01-19T05:18:47.370969+0000","last_unstale":"2024-01-19T05:18:48.342336+0000","last_undegraded":"2024-01-19T05:18:48.342336+0000","last_fullsized":"2024-01-19T05:18:48.342336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:59:48.604458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828975+0000","last_change":"2024-01-19T05:18:47.378888+0000","last_active":"2024-01-19T05:18:48.828975+0000","last_peered":"2024-01-19T05:18:48.828975+0000","last_clean":"2024-01-19T05:18:48.828975+0000","last_became_active":"2024-01-19T05:18:47.378444+0000","last_became_peered":"2024-01-19T05:18:47.378444+0000","last_unstale":"2024-01-19T05:18:48.828975+0000","last_undegraded":"2024-01-19T05:18:48.828975+0000","last_fullsized":"2024-01-19T05:18:48.828975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:21.691525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921690+0000","last_change":"2024-01-19T05:18:47.347904+0000","last_active":"2024-01-19T05:18:48.921690+0000","last_peered":"2024-01-19T05:18:48.921690+0000","last_clean":"2024-01-19T05:18:48.921690+0000","last_became_active":"2024-01-19T05:18:47.346067+0000","last_became_peered":"2024-01-19T05:18:47.346067+0000","last_unstale":"2024-01-19T05:18:48.921690+0000","last_undegraded":"2024-01-19T05:18:48.921690+0000","last_fullsized":"2024-01-19T05:18:48.921690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:14:38.070895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420867+0000","last_change":"2024-01-19T05:18:47.375647+0000","last_active":"2024-01-19T05:18:48.420867+0000","last_peered":"2024-01-19T05:18:48.420867+0000","last_clean":"2024-01-19T05:18:48.420867+0000","last_became_active":"2024-01-19T05:18:47.368485+0000","last_became_peered":"2024-01-19T05:18:47.368485+0000","last_unstale":"2024-01-19T05:18:48.420867+0000","last_undegraded":"2024-01-19T05:18:48.420867+0000","last_fullsized":"2024-01-19T05:18:48.420867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:58:28.301294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454854+0000","last_change":"2024-01-19T05:18:47.365964+0000","last_active":"2024-01-19T05:18:48.454854+0000","last_peered":"2024-01-19T05:18:48.454854+0000","last_clean":"2024-01-19T05:18:48.454854+0000","last_became_active":"2024-01-19T05:18:47.365216+0000","last_became_peered":"2024-01-19T05:18:47.365216+0000","last_unstale":"2024-01-19T05:18:48.454854+0000","last_undegraded":"2024-01-19T05:18:48.454854+0000","last_fullsized":"2024-01-19T05:18:48.454854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:14:38.070895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342926+0000","last_change":"2024-01-19T05:18:47.336966+0000","last_active":"2024-01-19T05:18:48.342926+0000","last_peered":"2024-01-19T05:18:48.342926+0000","last_clean":"2024-01-19T05:18:48.342926+0000","last_became_active":"2024-01-19T05:18:47.335998+0000","last_became_peered":"2024-01-19T05:18:47.335998+0000","last_unstale":"2024-01-19T05:18:48.342926+0000","last_undegraded":"2024-01-19T05:18:48.342926+0000","last_fullsized":"2024-01-19T05:18:48.342926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:19.180566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454279+0000","last_change":"2024-01-19T05:18:47.379129+0000","last_active":"2024-01-19T05:18:48.454279+0000","last_peered":"2024-01-19T05:18:48.454279+0000","last_clean":"2024-01-19T05:18:48.454279+0000","last_became_active":"2024-01-19T05:18:47.378541+0000","last_became_peered":"2024-01-19T05:18:47.378541+0000","last_unstale":"2024-01-19T05:18:48.454279+0000","last_undegraded":"2024-01-19T05:18:48.454279+0000","last_fullsized":"2024-01-19T05:18:48.454279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:21.691525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921705+0000","last_change":"2024-01-19T05:18:47.363386+0000","last_active":"2024-01-19T05:18:48.921705+0000","last_peered":"2024-01-19T05:18:48.921705+0000","last_clean":"2024-01-19T05:18:48.921705+0000","last_became_active":"2024-01-19T05:18:47.363012+0000","last_became_peered":"2024-01-19T05:18:47.363012+0000","last_unstale":"2024-01-19T05:18:48.921705+0000","last_undegraded":"2024-01-19T05:18:48.921705+0000","last_fullsized":"2024-01-19T05:18:48.921705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:10:07.628689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.370394+0000","last_change":"2024-01-19T05:18:46.336756+0000","last_active":"2024-01-19T05:18:47.370394+0000","last_peered":"2024-01-19T05:18:47.370394+0000","last_clean":"2024-01-19T05:18:47.370394+0000","last_became_active":"2024-01-19T05:18:46.336052+0000","last_became_peered":"2024-01-19T05:18:46.336052+0000","last_unstale":"2024-01-19T05:18:47.370394+0000","last_undegraded":"2024-01-19T05:18:47.370394+0000","last_fullsized":"2024-01-19T05:18:47.370394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:35:33.866174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.343424+0000","last_change":"2024-01-19T05:18:47.387944+0000","last_active":"2024-01-19T05:18:48.343424+0000","last_peered":"2024-01-19T05:18:48.343424+0000","last_clean":"2024-01-19T05:18:48.343424+0000","last_became_active":"2024-01-19T05:18:47.387099+0000","last_became_peered":"2024-01-19T05:18:47.387099+0000","last_unstale":"2024-01-19T05:18:48.343424+0000","last_undegraded":"2024-01-19T05:18:48.343424+0000","last_fullsized":"2024-01-19T05:18:48.343424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:29.882025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921785+0000","last_change":"2024-01-19T05:18:46.337013+0000","last_active":"2024-01-19T05:18:48.921785+0000","last_peered":"2024-01-19T05:18:48.921785+0000","last_clean":"2024-01-19T05:18:48.921785+0000","last_became_active":"2024-01-19T05:18:46.336748+0000","last_became_peered":"2024-01-19T05:18:46.336748+0000","last_unstale":"2024-01-19T05:18:48.921785+0000","last_undegraded":"2024-01-19T05:18:48.921785+0000","last_fullsized":"2024-01-19T05:18:48.921785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:57.794705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.421348+0000","last_change":"2024-01-19T05:18:47.376474+0000","last_active":"2024-01-19T05:18:48.421348+0000","last_peered":"2024-01-19T05:18:48.421348+0000","last_clean":"2024-01-19T05:18:48.421348+0000","last_became_active":"2024-01-19T05:18:47.375822+0000","last_became_peered":"2024-01-19T05:18:47.375822+0000","last_unstale":"2024-01-19T05:18:48.421348+0000","last_undegraded":"2024-01-19T05:18:48.421348+0000","last_fullsized":"2024-01-19T05:18:48.421348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:10:11.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.368338+0000","last_change":"2024-01-19T05:18:46.312714+0000","last_active":"2024-01-19T05:18:47.368338+0000","last_peered":"2024-01-19T05:18:47.368338+0000","last_clean":"2024-01-19T05:18:47.368338+0000","last_became_active":"2024-01-19T05:18:46.312361+0000","last_became_peered":"2024-01-19T05:18:46.312361+0000","last_unstale":"2024-01-19T05:18:47.368338+0000","last_undegraded":"2024-01-19T05:18:47.368338+0000","last_fullsized":"2024-01-19T05:18:47.368338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.878972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.829143+0000","last_change":"2024-01-19T05:18:47.367903+0000","last_active":"2024-01-19T05:18:48.829143+0000","last_peered":"2024-01-19T05:18:48.829143+0000","last_clean":"2024-01-19T05:18:48.829143+0000","last_became_active":"2024-01-19T05:18:47.367633+0000","last_became_peered":"2024-01-19T05:18:47.367633+0000","last_unstale":"2024-01-19T05:18:48.829143+0000","last_undegraded":"2024-01-19T05:18:48.829143+0000","last_fullsized":"2024-01-19T05:18:48.829143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:58.555110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.346024+0000","last_change":"2024-01-19T05:18:46.317178+0000","last_active":"2024-01-19T05:18:47.346024+0000","last_peered":"2024-01-19T05:18:47.346024+0000","last_clean":"2024-01-19T05:18:47.346024+0000","last_became_active":"2024-01-19T05:18:46.316584+0000","last_became_peered":"2024-01-19T05:18:46.316584+0000","last_unstale":"2024-01-19T05:18:47.346024+0000","last_undegraded":"2024-01-19T05:18:47.346024+0000","last_fullsized":"2024-01-19T05:18:47.346024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:45.015876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454521+0000","last_change":"2024-01-19T05:18:47.387815+0000","last_active":"2024-01-19T05:18:48.454521+0000","last_peered":"2024-01-19T05:18:48.454521+0000","last_clean":"2024-01-19T05:18:48.454521+0000","last_became_active":"2024-01-19T05:18:47.387034+0000","last_became_peered":"2024-01-19T05:18:47.387034+0000","last_unstale":"2024-01-19T05:18:48.454521+0000","last_undegraded":"2024-01-19T05:18:48.454521+0000","last_fullsized":"2024-01-19T05:18:48.454521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:07.690039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.389496+0000","last_change":"2024-01-19T05:18:46.322418+0000","last_active":"2024-01-19T05:18:47.389496+0000","last_peered":"2024-01-19T05:18:47.389496+0000","last_clean":"2024-01-19T05:18:47.389496+0000","last_became_active":"2024-01-19T05:18:46.321434+0000","last_became_peered":"2024-01-19T05:18:46.321434+0000","last_unstale":"2024-01-19T05:18:47.389496+0000","last_undegraded":"2024-01-19T05:18:47.389496+0000","last_fullsized":"2024-01-19T05:18:47.389496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:34:49.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921289+0000","last_change":"2024-01-19T05:18:47.345439+0000","last_active":"2024-01-19T05:18:48.921289+0000","last_peered":"2024-01-19T05:18:48.921289+0000","last_clean":"2024-01-19T05:18:48.921289+0000","last_became_active":"2024-01-19T05:18:47.344754+0000","last_became_peered":"2024-01-19T05:18:47.344754+0000","last_unstale":"2024-01-19T05:18:48.921289+0000","last_undegraded":"2024-01-19T05:18:48.921289+0000","last_fullsized":"2024-01-19T05:18:48.921289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:07.690039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.388456+0000","last_change":"2024-01-19T05:18:46.321982+0000","last_active":"2024-01-19T05:18:47.388456+0000","last_peered":"2024-01-19T05:18:47.388456+0000","last_clean":"2024-01-19T05:18:47.388456+0000","last_became_active":"2024-01-19T05:18:46.321109+0000","last_became_peered":"2024-01-19T05:18:46.321109+0000","last_unstale":"2024-01-19T05:18:47.388456+0000","last_undegraded":"2024-01-19T05:18:47.388456+0000","last_fullsized":"2024-01-19T05:18:47.388456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:57.794705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420504+0000","last_change":"2024-01-19T05:18:47.368995+0000","last_active":"2024-01-19T05:18:48.420504+0000","last_peered":"2024-01-19T05:18:48.420504+0000","last_clean":"2024-01-19T05:18:48.420504+0000","last_became_active":"2024-01-19T05:18:47.368178+0000","last_became_peered":"2024-01-19T05:18:47.368178+0000","last_unstale":"2024-01-19T05:18:48.420504+0000","last_undegraded":"2024-01-19T05:18:48.420504+0000","last_fullsized":"2024-01-19T05:18:48.420504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:10:07.628689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.348799+0000","last_change":"2024-01-19T05:18:46.310539+0000","last_active":"2024-01-19T05:18:47.348799+0000","last_peered":"2024-01-19T05:18:47.348799+0000","last_clean":"2024-01-19T05:18:47.348799+0000","last_became_active":"2024-01-19T05:18:46.310156+0000","last_became_peered":"2024-01-19T05:18:46.310156+0000","last_unstale":"2024-01-19T05:18:47.348799+0000","last_undegraded":"2024-01-19T05:18:47.348799+0000","last_fullsized":"2024-01-19T05:18:47.348799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:11:55.108079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828064+0000","last_change":"2024-01-19T05:18:47.347703+0000","last_active":"2024-01-19T05:18:48.828064+0000","last_peered":"2024-01-19T05:18:48.828064+0000","last_clean":"2024-01-19T05:18:48.828064+0000","last_became_active":"2024-01-19T05:18:47.347395+0000","last_became_peered":"2024-01-19T05:18:47.347395+0000","last_unstale":"2024-01-19T05:18:48.828064+0000","last_undegraded":"2024-01-19T05:18:48.828064+0000","last_fullsized":"2024-01-19T05:18:48.828064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:34.529608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.376650+0000","last_change":"2024-01-19T05:18:46.316444+0000","last_active":"2024-01-19T05:18:47.376650+0000","last_peered":"2024-01-19T05:18:47.376650+0000","last_clean":"2024-01-19T05:18:47.376650+0000","last_became_active":"2024-01-19T05:18:46.315699+0000","last_became_peered":"2024-01-19T05:18:46.315699+0000","last_unstale":"2024-01-19T05:18:47.376650+0000","last_undegraded":"2024-01-19T05:18:47.376650+0000","last_fullsized":"2024-01-19T05:18:47.376650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:44.423224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921979+0000","last_change":"2024-01-19T05:18:47.357252+0000","last_active":"2024-01-19T05:18:48.921979+0000","last_peered":"2024-01-19T05:18:48.921979+0000","last_clean":"2024-01-19T05:18:48.921979+0000","last_became_active":"2024-01-19T05:18:47.356422+0000","last_became_peered":"2024-01-19T05:18:47.356422+0000","last_unstale":"2024-01-19T05:18:48.921979+0000","last_undegraded":"2024-01-19T05:18:48.921979+0000","last_fullsized":"2024-01-19T05:18:48.921979+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:48:11.050965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.351603+0000","last_change":"2024-01-19T05:18:46.340343+0000","last_active":"2024-01-19T05:18:47.351603+0000","last_peered":"2024-01-19T05:18:47.351603+0000","last_clean":"2024-01-19T05:18:47.351603+0000","last_became_active":"2024-01-19T05:18:46.340065+0000","last_became_peered":"2024-01-19T05:18:46.340065+0000","last_unstale":"2024-01-19T05:18:47.351603+0000","last_undegraded":"2024-01-19T05:18:47.351603+0000","last_fullsized":"2024-01-19T05:18:47.351603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:58:27.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342381+0000","last_change":"2024-01-19T05:18:47.360560+0000","last_active":"2024-01-19T05:18:48.342381+0000","last_peered":"2024-01-19T05:18:48.342381+0000","last_clean":"2024-01-19T05:18:48.342381+0000","last_became_active":"2024-01-19T05:18:47.360261+0000","last_became_peered":"2024-01-19T05:18:47.360261+0000","last_unstale":"2024-01-19T05:18:48.342381+0000","last_undegraded":"2024-01-19T05:18:48.342381+0000","last_fullsized":"2024-01-19T05:18:48.342381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:16.579968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.922002+0000","last_change":"2024-01-19T05:18:46.315379+0000","last_active":"2024-01-19T05:18:48.922002+0000","last_peered":"2024-01-19T05:18:48.922002+0000","last_clean":"2024-01-19T05:18:48.922002+0000","last_became_active":"2024-01-19T05:18:46.314403+0000","last_became_peered":"2024-01-19T05:18:46.314403+0000","last_unstale":"2024-01-19T05:18:48.922002+0000","last_undegraded":"2024-01-19T05:18:48.922002+0000","last_fullsized":"2024-01-19T05:18:48.922002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:01:21.099063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341793+0000","last_change":"2024-01-19T05:18:47.370656+0000","last_active":"2024-01-19T05:18:48.341793+0000","last_peered":"2024-01-19T05:18:48.341793+0000","last_clean":"2024-01-19T05:18:48.341793+0000","last_became_active":"2024-01-19T05:18:47.370372+0000","last_became_peered":"2024-01-19T05:18:47.370372+0000","last_unstale":"2024-01-19T05:18:48.341793+0000","last_undegraded":"2024-01-19T05:18:48.341793+0000","last_fullsized":"2024-01-19T05:18:48.341793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:30:36.095975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.370805+0000","last_change":"2024-01-19T05:18:46.339958+0000","last_active":"2024-01-19T05:18:47.370805+0000","last_peered":"2024-01-19T05:18:47.370805+0000","last_clean":"2024-01-19T05:18:47.370805+0000","last_became_active":"2024-01-19T05:18:46.339320+0000","last_became_peered":"2024-01-19T05:18:46.339320+0000","last_unstale":"2024-01-19T05:18:47.370805+0000","last_undegraded":"2024-01-19T05:18:47.370805+0000","last_fullsized":"2024-01-19T05:18:47.370805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:06.572037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921541+0000","last_change":"2024-01-19T05:18:47.350096+0000","last_active":"2024-01-19T05:18:48.921541+0000","last_peered":"2024-01-19T05:18:48.921541+0000","last_clean":"2024-01-19T05:18:48.921541+0000","last_became_active":"2024-01-19T05:18:47.347177+0000","last_became_peered":"2024-01-19T05:18:47.347177+0000","last_unstale":"2024-01-19T05:18:48.921541+0000","last_undegraded":"2024-01-19T05:18:48.921541+0000","last_fullsized":"2024-01-19T05:18:48.921541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:50.265741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.392174+0000","last_change":"2024-01-19T05:18:46.315459+0000","last_active":"2024-01-19T05:18:47.392174+0000","last_peered":"2024-01-19T05:18:47.392174+0000","last_clean":"2024-01-19T05:18:47.392174+0000","last_became_active":"2024-01-19T05:18:46.315170+0000","last_became_peered":"2024-01-19T05:18:46.315170+0000","last_unstale":"2024-01-19T05:18:47.392174+0000","last_undegraded":"2024-01-19T05:18:47.392174+0000","last_fullsized":"2024-01-19T05:18:47.392174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:17:46.615993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828116+0000","last_change":"2024-01-19T05:18:47.352536+0000","last_active":"2024-01-19T05:18:48.828116+0000","last_peered":"2024-01-19T05:18:48.828116+0000","last_clean":"2024-01-19T05:18:48.828116+0000","last_became_active":"2024-01-19T05:18:47.352271+0000","last_became_peered":"2024-01-19T05:18:47.352271+0000","last_unstale":"2024-01-19T05:18:48.828116+0000","last_undegraded":"2024-01-19T05:18:48.828116+0000","last_fullsized":"2024-01-19T05:18:48.828116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:47.348700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.390157+0000","last_change":"2024-01-19T05:18:46.316085+0000","last_active":"2024-01-19T05:18:47.390157+0000","last_peered":"2024-01-19T05:18:47.390157+0000","last_clean":"2024-01-19T05:18:47.390157+0000","last_became_active":"2024-01-19T05:18:46.315358+0000","last_became_peered":"2024-01-19T05:18:46.315358+0000","last_unstale":"2024-01-19T05:18:47.390157+0000","last_undegraded":"2024-01-19T05:18:47.390157+0000","last_fullsized":"2024-01-19T05:18:47.390157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:00.099255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341766+0000","last_change":"2024-01-19T05:18:47.362018+0000","last_active":"2024-01-19T05:18:48.341766+0000","last_peered":"2024-01-19T05:18:48.341766+0000","last_clean":"2024-01-19T05:18:48.341766+0000","last_became_active":"2024-01-19T05:18:47.360598+0000","last_became_peered":"2024-01-19T05:18:47.360598+0000","last_unstale":"2024-01-19T05:18:48.341766+0000","last_undegraded":"2024-01-19T05:18:48.341766+0000","last_fullsized":"2024-01-19T05:18:48.341766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:48:11.050965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.321465+0000","last_change":"2024-01-19T05:18:46.312783+0000","last_active":"2024-01-19T05:18:47.321465+0000","last_peered":"2024-01-19T05:18:47.321465+0000","last_clean":"2024-01-19T05:18:47.321465+0000","last_became_active":"2024-01-19T05:18:46.312300+0000","last_became_peered":"2024-01-19T05:18:46.312300+0000","last_unstale":"2024-01-19T05:18:47.321465+0000","last_undegraded":"2024-01-19T05:18:47.321465+0000","last_fullsized":"2024-01-19T05:18:47.321465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:35:33.866174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454563+0000","last_change":"2024-01-19T05:18:47.383022+0000","last_active":"2024-01-19T05:18:48.454563+0000","last_peered":"2024-01-19T05:18:48.454563+0000","last_clean":"2024-01-19T05:18:48.454563+0000","last_became_active":"2024-01-19T05:18:47.382228+0000","last_became_peered":"2024-01-19T05:18:47.382228+0000","last_unstale":"2024-01-19T05:18:48.454563+0000","last_undegraded":"2024-01-19T05:18:48.454563+0000","last_fullsized":"2024-01-19T05:18:48.454563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:27:38.933913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.348963+0000","last_change":"2024-01-19T05:18:46.337884+0000","last_active":"2024-01-19T05:18:47.348963+0000","last_peered":"2024-01-19T05:18:47.348963+0000","last_clean":"2024-01-19T05:18:47.348963+0000","last_became_active":"2024-01-19T05:18:46.337610+0000","last_became_peered":"2024-01-19T05:18:46.337610+0000","last_unstale":"2024-01-19T05:18:47.348963+0000","last_undegraded":"2024-01-19T05:18:47.348963+0000","last_fullsized":"2024-01-19T05:18:47.348963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:02:12.094820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.343087+0000","last_change":"2024-01-19T05:18:47.377128+0000","last_active":"2024-01-19T05:18:48.343087+0000","last_peered":"2024-01-19T05:18:48.343087+0000","last_clean":"2024-01-19T05:18:48.343087+0000","last_became_active":"2024-01-19T05:18:47.376543+0000","last_became_peered":"2024-01-19T05:18:47.376543+0000","last_unstale":"2024-01-19T05:18:48.343087+0000","last_undegraded":"2024-01-19T05:18:48.343087+0000","last_fullsized":"2024-01-19T05:18:48.343087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:11:56.111132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.370250+0000","last_change":"2024-01-19T05:18:46.313279+0000","last_active":"2024-01-19T05:18:47.370250+0000","last_peered":"2024-01-19T05:18:47.370250+0000","last_clean":"2024-01-19T05:18:47.370250+0000","last_became_active":"2024-01-19T05:18:46.312912+0000","last_became_peered":"2024-01-19T05:18:46.312912+0000","last_unstale":"2024-01-19T05:18:47.370250+0000","last_undegraded":"2024-01-19T05:18:47.370250+0000","last_fullsized":"2024-01-19T05:18:47.370250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:18.177513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.421107+0000","last_change":"2024-01-19T05:18:47.385361+0000","last_active":"2024-01-19T05:18:48.421107+0000","last_peered":"2024-01-19T05:18:48.421107+0000","last_clean":"2024-01-19T05:18:48.421107+0000","last_became_active":"2024-01-19T05:18:47.384866+0000","last_became_peered":"2024-01-19T05:18:47.384866+0000","last_unstale":"2024-01-19T05:18:48.421107+0000","last_undegraded":"2024-01-19T05:18:48.421107+0000","last_fullsized":"2024-01-19T05:18:48.421107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:47.348700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.352926+0000","last_change":"2024-01-19T05:18:46.315098+0000","last_active":"2024-01-19T05:18:47.352926+0000","last_peered":"2024-01-19T05:18:47.352926+0000","last_clean":"2024-01-19T05:18:47.352926+0000","last_became_active":"2024-01-19T05:18:46.314855+0000","last_became_peered":"2024-01-19T05:18:46.314855+0000","last_unstale":"2024-01-19T05:18:47.352926+0000","last_undegraded":"2024-01-19T05:18:47.352926+0000","last_fullsized":"2024-01-19T05:18:47.352926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:01:21.099063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921984+0000","last_change":"2024-01-19T05:18:47.386905+0000","last_active":"2024-01-19T05:18:48.921984+0000","last_peered":"2024-01-19T05:18:48.921984+0000","last_clean":"2024-01-19T05:18:48.921984+0000","last_became_active":"2024-01-19T05:18:47.386057+0000","last_became_peered":"2024-01-19T05:18:47.386057+0000","last_unstale":"2024-01-19T05:18:48.921984+0000","last_undegraded":"2024-01-19T05:18:48.921984+0000","last_fullsized":"2024-01-19T05:18:48.921984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:30:36.095975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.390073+0000","last_change":"2024-01-19T05:18:46.322547+0000","last_active":"2024-01-19T05:18:47.390073+0000","last_peered":"2024-01-19T05:18:47.390073+0000","last_clean":"2024-01-19T05:18:47.390073+0000","last_became_active":"2024-01-19T05:18:46.321947+0000","last_became_peered":"2024-01-19T05:18:46.321947+0000","last_unstale":"2024-01-19T05:18:47.390073+0000","last_undegraded":"2024-01-19T05:18:47.390073+0000","last_fullsized":"2024-01-19T05:18:47.390073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:59.768298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828493+0000","last_change":"2024-01-19T05:18:47.378910+0000","last_active":"2024-01-19T05:18:48.828493+0000","last_peered":"2024-01-19T05:18:48.828493+0000","last_clean":"2024-01-19T05:18:48.828493+0000","last_became_active":"2024-01-19T05:18:47.378444+0000","last_became_peered":"2024-01-19T05:18:47.378444+0000","last_unstale":"2024-01-19T05:18:48.828493+0000","last_undegraded":"2024-01-19T05:18:48.828493+0000","last_fullsized":"2024-01-19T05:18:48.828493+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:08.042636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.386261+0000","last_change":"2024-01-19T05:18:46.314755+0000","last_active":"2024-01-19T05:18:47.386261+0000","last_peered":"2024-01-19T05:18:47.386261+0000","last_clean":"2024-01-19T05:18:47.386261+0000","last_became_active":"2024-01-19T05:18:46.313921+0000","last_became_peered":"2024-01-19T05:18:46.313921+0000","last_unstale":"2024-01-19T05:18:47.386261+0000","last_undegraded":"2024-01-19T05:18:47.386261+0000","last_fullsized":"2024-01-19T05:18:47.386261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:01:21.099063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342459+0000","last_change":"2024-01-19T05:18:47.342045+0000","last_active":"2024-01-19T05:18:48.342459+0000","last_peered":"2024-01-19T05:18:48.342459+0000","last_clean":"2024-01-19T05:18:48.342459+0000","last_became_active":"2024-01-19T05:18:47.341614+0000","last_became_peered":"2024-01-19T05:18:47.341614+0000","last_unstale":"2024-01-19T05:18:48.342459+0000","last_undegraded":"2024-01-19T05:18:48.342459+0000","last_fullsized":"2024-01-19T05:18:48.342459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:34:50.639528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.379121+0000","last_change":"2024-01-19T05:18:46.321817+0000","last_active":"2024-01-19T05:18:47.379121+0000","last_peered":"2024-01-19T05:18:47.379121+0000","last_clean":"2024-01-19T05:18:47.379121+0000","last_became_active":"2024-01-19T05:18:46.321023+0000","last_became_peered":"2024-01-19T05:18:46.321023+0000","last_unstale":"2024-01-19T05:18:47.379121+0000","last_undegraded":"2024-01-19T05:18:47.379121+0000","last_fullsized":"2024-01-19T05:18:47.379121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:23:00.337517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342125+0000","last_change":"2024-01-19T05:18:47.385354+0000","last_active":"2024-01-19T05:18:48.342125+0000","last_peered":"2024-01-19T05:18:48.342125+0000","last_clean":"2024-01-19T05:18:48.342125+0000","last_became_active":"2024-01-19T05:18:47.385000+0000","last_became_peered":"2024-01-19T05:18:47.385000+0000","last_unstale":"2024-01-19T05:18:48.342125+0000","last_undegraded":"2024-01-19T05:18:48.342125+0000","last_fullsized":"2024-01-19T05:18:48.342125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:58.797758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921920+0000","last_change":"2024-01-19T05:18:46.313839+0000","last_active":"2024-01-19T05:18:48.921920+0000","last_peered":"2024-01-19T05:18:48.921920+0000","last_clean":"2024-01-19T05:18:48.921920+0000","last_became_active":"2024-01-19T05:18:46.313232+0000","last_became_peered":"2024-01-19T05:18:46.313232+0000","last_unstale":"2024-01-19T05:18:48.921920+0000","last_undegraded":"2024-01-19T05:18:48.921920+0000","last_fullsized":"2024-01-19T05:18:48.921920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:59.768298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342067+0000","last_change":"2024-01-19T05:18:47.339362+0000","last_active":"2024-01-19T05:18:48.342067+0000","last_peered":"2024-01-19T05:18:48.342067+0000","last_clean":"2024-01-19T05:18:48.342067+0000","last_became_active":"2024-01-19T05:18:47.339057+0000","last_became_peered":"2024-01-19T05:18:47.339057+0000","last_unstale":"2024-01-19T05:18:48.342067+0000","last_undegraded":"2024-01-19T05:18:48.342067+0000","last_fullsized":"2024-01-19T05:18:48.342067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:35:34.869227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.322471+0000","last_change":"2024-01-19T05:18:46.324680+0000","last_active":"2024-01-19T05:18:47.322471+0000","last_peered":"2024-01-19T05:18:47.322471+0000","last_clean":"2024-01-19T05:18:47.322471+0000","last_became_active":"2024-01-19T05:18:46.323968+0000","last_became_peered":"2024-01-19T05:18:46.323968+0000","last_unstale":"2024-01-19T05:18:47.322471+0000","last_undegraded":"2024-01-19T05:18:47.322471+0000","last_fullsized":"2024-01-19T05:18:47.322471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:57.794705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341618+0000","last_change":"2024-01-19T05:18:47.341711+0000","last_active":"2024-01-19T05:18:48.341618+0000","last_peered":"2024-01-19T05:18:48.341618+0000","last_clean":"2024-01-19T05:18:48.341618+0000","last_became_active":"2024-01-19T05:18:47.341341+0000","last_became_peered":"2024-01-19T05:18:47.341341+0000","last_unstale":"2024-01-19T05:18:48.341618+0000","last_undegraded":"2024-01-19T05:18:48.341618+0000","last_fullsized":"2024-01-19T05:18:48.341618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:41.649264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.376763+0000","last_change":"2024-01-19T05:18:46.314658+0000","last_active":"2024-01-19T05:18:47.376763+0000","last_peered":"2024-01-19T05:18:47.376763+0000","last_clean":"2024-01-19T05:18:47.376763+0000","last_became_active":"2024-01-19T05:18:46.313819+0000","last_became_peered":"2024-01-19T05:18:46.313819+0000","last_unstale":"2024-01-19T05:18:47.376763+0000","last_undegraded":"2024-01-19T05:18:47.376763+0000","last_fullsized":"2024-01-19T05:18:47.376763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:18.332189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454334+0000","last_change":"2024-01-19T05:18:47.361920+0000","last_active":"2024-01-19T05:18:48.454334+0000","last_peered":"2024-01-19T05:18:48.454334+0000","last_clean":"2024-01-19T05:18:48.454334+0000","last_became_active":"2024-01-19T05:18:47.360437+0000","last_became_peered":"2024-01-19T05:18:47.360437+0000","last_unstale":"2024-01-19T05:18:48.454334+0000","last_undegraded":"2024-01-19T05:18:48.454334+0000","last_fullsized":"2024-01-19T05:18:48.454334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:58.555110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.339926+0000","last_change":"2024-01-19T05:18:46.340492+0000","last_active":"2024-01-19T05:18:47.339926+0000","last_peered":"2024-01-19T05:18:47.339926+0000","last_clean":"2024-01-19T05:18:47.339926+0000","last_became_active":"2024-01-19T05:18:46.339399+0000","last_became_peered":"2024-01-19T05:18:46.339399+0000","last_unstale":"2024-01-19T05:18:47.339926+0000","last_undegraded":"2024-01-19T05:18:47.339926+0000","last_fullsized":"2024-01-19T05:18:47.339926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:02:12.094820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341974+0000","last_change":"2024-01-19T05:18:47.355938+0000","last_active":"2024-01-19T05:18:48.341974+0000","last_peered":"2024-01-19T05:18:48.341974+0000","last_clean":"2024-01-19T05:18:48.341974+0000","last_became_active":"2024-01-19T05:18:47.355618+0000","last_became_peered":"2024-01-19T05:18:47.355618+0000","last_unstale":"2024-01-19T05:18:48.341974+0000","last_undegraded":"2024-01-19T05:18:48.341974+0000","last_fullsized":"2024-01-19T05:18:48.341974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:19.335242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.358950+0000","last_change":"2024-01-19T05:18:46.335047+0000","last_active":"2024-01-19T05:18:47.358950+0000","last_peered":"2024-01-19T05:18:47.358950+0000","last_clean":"2024-01-19T05:18:47.358950+0000","last_became_active":"2024-01-19T05:18:46.334739+0000","last_became_peered":"2024-01-19T05:18:46.334739+0000","last_unstale":"2024-01-19T05:18:47.358950+0000","last_undegraded":"2024-01-19T05:18:47.358950+0000","last_fullsized":"2024-01-19T05:18:47.358950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:59.768298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.922192+0000","last_change":"2024-01-19T05:18:47.354777+0000","last_active":"2024-01-19T05:18:48.922192+0000","last_peered":"2024-01-19T05:18:48.922192+0000","last_clean":"2024-01-19T05:18:48.922192+0000","last_became_active":"2024-01-19T05:18:47.353650+0000","last_became_peered":"2024-01-19T05:18:47.353650+0000","last_unstale":"2024-01-19T05:18:48.922192+0000","last_undegraded":"2024-01-19T05:18:48.922192+0000","last_fullsized":"2024-01-19T05:18:48.922192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:12.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:50.302927+0000","last_change":"2024-01-19T05:18:46.315538+0000","last_active":"2024-01-19T05:18:50.302927+0000","last_peered":"2024-01-19T05:18:50.302927+0000","last_clean":"2024-01-19T05:18:50.302927+0000","last_became_active":"2024-01-19T05:18:46.314907+0000","last_became_peered":"2024-01-19T05:18:46.314907+0000","last_unstale":"2024-01-19T05:18:50.302927+0000","last_undegraded":"2024-01-19T05:18:50.302927+0000","last_fullsized":"2024-01-19T05:18:50.302927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:34:49.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921664+0000","last_change":"2024-01-19T05:18:47.343423+0000","last_active":"2024-01-19T05:18:48.921664+0000","last_peered":"2024-01-19T05:18:48.921664+0000","last_clean":"2024-01-19T05:18:48.921664+0000","last_became_active":"2024-01-19T05:18:47.342970+0000","last_became_peered":"2024-01-19T05:18:47.342970+0000","last_unstale":"2024-01-19T05:18:48.921664+0000","last_undegraded":"2024-01-19T05:18:48.921664+0000","last_fullsized":"2024-01-19T05:18:48.921664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:29.882025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.322996+0000","last_change":"2024-01-19T05:18:46.313184+0000","last_active":"2024-01-19T05:18:47.322996+0000","last_peered":"2024-01-19T05:18:47.322996+0000","last_clean":"2024-01-19T05:18:47.322996+0000","last_became_active":"2024-01-19T05:18:46.312797+0000","last_became_peered":"2024-01-19T05:18:46.312797+0000","last_unstale":"2024-01-19T05:18:47.322996+0000","last_undegraded":"2024-01-19T05:18:47.322996+0000","last_fullsized":"2024-01-19T05:18:47.322996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:34:49.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.343389+0000","last_change":"2024-01-19T05:18:47.344884+0000","last_active":"2024-01-19T05:18:48.343389+0000","last_peered":"2024-01-19T05:18:48.343389+0000","last_clean":"2024-01-19T05:18:48.343389+0000","last_became_active":"2024-01-19T05:18:47.343762+0000","last_became_peered":"2024-01-19T05:18:47.343762+0000","last_unstale":"2024-01-19T05:18:48.343389+0000","last_undegraded":"2024-01-19T05:18:48.343389+0000","last_fullsized":"2024-01-19T05:18:48.343389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:02:13.097874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.922105+0000","last_change":"2024-01-19T05:18:46.333693+0000","last_active":"2024-01-19T05:18:48.922105+0000","last_peered":"2024-01-19T05:18:48.922105+0000","last_clean":"2024-01-19T05:18:48.922105+0000","last_became_active":"2024-01-19T05:18:46.333280+0000","last_became_peered":"2024-01-19T05:18:46.333280+0000","last_unstale":"2024-01-19T05:18:48.922105+0000","last_undegraded":"2024-01-19T05:18:48.922105+0000","last_fullsized":"2024-01-19T05:18:48.922105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:00.099255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921852+0000","last_change":"2024-01-19T05:18:47.355134+0000","last_active":"2024-01-19T05:18:48.921852+0000","last_peered":"2024-01-19T05:18:48.921852+0000","last_clean":"2024-01-19T05:18:48.921852+0000","last_became_active":"2024-01-19T05:18:47.353662+0000","last_became_peered":"2024-01-19T05:18:47.353662+0000","last_unstale":"2024-01-19T05:18:48.921852+0000","last_undegraded":"2024-01-19T05:18:48.921852+0000","last_fullsized":"2024-01-19T05:18:48.921852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:17:47.619046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.322970+0000","last_change":"2024-01-19T05:18:46.332678+0000","last_active":"2024-01-19T05:18:47.322970+0000","last_peered":"2024-01-19T05:18:47.322970+0000","last_clean":"2024-01-19T05:18:47.322970+0000","last_became_active":"2024-01-19T05:18:46.332373+0000","last_became_peered":"2024-01-19T05:18:46.332373+0000","last_unstale":"2024-01-19T05:18:47.322970+0000","last_undegraded":"2024-01-19T05:18:47.322970+0000","last_fullsized":"2024-01-19T05:18:47.322970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:57.794705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.340839+0000","last_change":"2024-01-19T05:18:47.360626+0000","last_active":"2024-01-19T05:18:48.340839+0000","last_peered":"2024-01-19T05:18:48.340839+0000","last_clean":"2024-01-19T05:18:48.340839+0000","last_became_active":"2024-01-19T05:18:47.353279+0000","last_became_peered":"2024-01-19T05:18:47.353279+0000","last_unstale":"2024-01-19T05:18:48.340839+0000","last_undegraded":"2024-01-19T05:18:48.340839+0000","last_fullsized":"2024-01-19T05:18:48.340839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:50.265741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.377106+0000","last_change":"2024-01-19T05:18:46.332860+0000","last_active":"2024-01-19T05:18:47.377106+0000","last_peered":"2024-01-19T05:18:47.377106+0000","last_clean":"2024-01-19T05:18:47.377106+0000","last_became_active":"2024-01-19T05:18:46.332174+0000","last_became_peered":"2024-01-19T05:18:46.332174+0000","last_unstale":"2024-01-19T05:18:47.377106+0000","last_undegraded":"2024-01-19T05:18:47.377106+0000","last_fullsized":"2024-01-19T05:18:47.377106+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:35:33.866174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420468+0000","last_change":"2024-01-19T05:18:47.368208+0000","last_active":"2024-01-19T05:18:48.420468+0000","last_peered":"2024-01-19T05:18:48.420468+0000","last_clean":"2024-01-19T05:18:48.420468+0000","last_became_active":"2024-01-19T05:18:47.367284+0000","last_became_peered":"2024-01-19T05:18:47.367284+0000","last_unstale":"2024-01-19T05:18:48.420468+0000","last_undegraded":"2024-01-19T05:18:48.420468+0000","last_fullsized":"2024-01-19T05:18:48.420468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:29.882025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.348804+0000","last_change":"2024-01-19T05:18:46.333918+0000","last_active":"2024-01-19T05:18:47.348804+0000","last_peered":"2024-01-19T05:18:47.348804+0000","last_clean":"2024-01-19T05:18:47.348804+0000","last_became_active":"2024-01-19T05:18:46.333470+0000","last_became_peered":"2024-01-19T05:18:46.333470+0000","last_unstale":"2024-01-19T05:18:47.348804+0000","last_undegraded":"2024-01-19T05:18:47.348804+0000","last_fullsized":"2024-01-19T05:18:47.348804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:06.572037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454583+0000","last_change":"2024-01-19T05:18:47.338955+0000","last_active":"2024-01-19T05:18:48.454583+0000","last_peered":"2024-01-19T05:18:48.454583+0000","last_clean":"2024-01-19T05:18:48.454583+0000","last_became_active":"2024-01-19T05:18:47.338202+0000","last_became_peered":"2024-01-19T05:18:47.338202+0000","last_unstale":"2024-01-19T05:18:48.454583+0000","last_undegraded":"2024-01-19T05:18:48.454583+0000","last_fullsized":"2024-01-19T05:18:48.454583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:49:03.050028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.320939+0000","last_change":"2024-01-19T05:18:46.328546+0000","last_active":"2024-01-19T05:18:47.320939+0000","last_peered":"2024-01-19T05:18:47.320939+0000","last_clean":"2024-01-19T05:18:47.320939+0000","last_became_active":"2024-01-19T05:18:46.327801+0000","last_became_peered":"2024-01-19T05:18:46.327801+0000","last_unstale":"2024-01-19T05:18:47.320939+0000","last_undegraded":"2024-01-19T05:18:47.320939+0000","last_fullsized":"2024-01-19T05:18:47.320939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:55:19.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.336732+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:47.336732+0000","last_peered":"2024-01-19T05:18:47.336732+0000","last_clean":"2024-01-19T05:18:47.336732+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:47.336732+0000","last_undegraded":"2024-01-19T05:18:47.336732+0000","last_fullsized":"2024-01-19T05:18:47.336732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335596,"statfs":{"total":96636764160,"available":96599650304,"internally_reserved":0,"allocated":921600,"data_stored":714446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":124058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":125622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":714356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:54.875 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:18:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.004+0000 7ff7b8914640 1 Processor -- start 2024-01-19T05:18:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.004+0000 7ff7b8914640 1 -- start start 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b8914640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff7b40b19f0 0x7ff7b406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b8914640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4144c70 0x7ff7b41450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b8914640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b4070680 con 0x7ff7b4071de0 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b8914640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b4070410 con 0x7ff7b40b19f0 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b8914640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b4144790 con 0x7ff7b4144c70 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff7b40b19f0 0x7ff7b406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b259c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff7b40b19f0 0x7ff7b406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:42788/0 (socket says 172.21.15.99:42788) 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b259c640 1 -- 172.21.15.99:0/397065877 learned_addr learned my addr 172.21.15.99:0/397065877 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b2d9d640 1 --1- 172.21.15.99:0/397065877 >> v1:172.21.15.157:6789/0 conn(0x7ff7b4071de0 0x7ff7b4072210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:54876/0 (socket says 172.21.15.99:54876) 2024-01-19T05:18:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b1d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4144c70 0x7ff7b41450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b259c640 1 -- 172.21.15.99:0/397065877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4144c70 msgr2=0x7ff7b41450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b259c640 1 --2- 172.21.15.99:0/397065877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4144c70 0x7ff7b41450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b259c640 1 -- 172.21.15.99:0/397065877 >> v1:172.21.15.157:6789/0 conn(0x7ff7b4071de0 legacy=0x7ff7b4072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.008+0000 7ff7b259c640 1 -- 172.21.15.99:0/397065877 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b406f2b0 con 0x7ff7b40b19f0 2024-01-19T05:18:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b259c640 1 --2- 172.21.15.99:0/397065877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b40b19f0 0x7ff7b406ebe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009e50 tx=0x7ff7ac01c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c380784fc0b6ce81 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b159a640 1 -- 172.21.15.99:0/397065877 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0a57a0 con 0x7ff7b40b19f0 2024-01-19T05:18:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b159a640 1 -- 172.21.15.99:0/397065877 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0a5900 con 0x7ff7b40b19f0 2024-01-19T05:18:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b159a640 1 -- 172.21.15.99:0/397065877 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0a5c90 con 0x7ff7b40b19f0 2024-01-19T05:18:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- 172.21.15.99:0/397065877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b40b19f0 msgr2=0x7ff7b406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 --2- 172.21.15.99:0/397065877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b40b19f0 0x7ff7b406ebe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009e50 tx=0x7ff7ac01c980 comp rx=0 tx=0).stop 2024-01-19T05:18:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- 172.21.15.99:0/397065877 shutdown_connections 2024-01-19T05:18:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 --2- 172.21.15.99:0/397065877 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4144c70 0x7ff7b41450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 --2- 172.21.15.99:0/397065877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b40b19f0 0x7ff7b406ebe0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- 172.21.15.99:0/397065877 >> 172.21.15.99:0/397065877 conn(0x7ff7b40b8080 msgr2=0x7ff7b40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- 172.21.15.99:0/397065877 shutdown_connections 2024-01-19T05:18:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- 172.21.15.99:0/397065877 wait complete. 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 Processor -- start 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- start start 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4071de0 0x7ff7b4141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b40b19f0 0x7ff7b413c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b4144c70 0x7ff7b413b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b41416d0 con 0x7ff7b40b19f0 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b413f350 con 0x7ff7b4144c70 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b413f630 con 0x7ff7b4071de0 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b40b19f0 0x7ff7b413c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b40b19f0 0x7ff7b413c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45154/0 (socket says 172.21.15.99:45154) 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 -- 172.21.15.99:0/2984157238 learned_addr learned my addr 172.21.15.99:0/2984157238 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b2d9d640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b4144c70 0x7ff7b413b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b259c640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4071de0 0x7ff7b4141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 -- 172.21.15.99:0/2984157238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4071de0 msgr2=0x7ff7b4141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4071de0 0x7ff7b4141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 -- 172.21.15.99:0/2984157238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b4144c70 msgr2=0x7ff7b413b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b4144c70 0x7ff7b413b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 -- 172.21.15.99:0/2984157238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009b30 con 0x7ff7b40b19f0 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b1d9b640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b40b19f0 0x7ff7b413c210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00e930 tx=0x7ff79c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7aaffd640 1 -- 172.21.15.99:0/2984157238 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c009690 con 0x7ff7b40b19f0 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7aaffd640 1 -- 172.21.15.99:0/2984157238 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c00ca00 con 0x7ff7b40b19f0 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7aaffd640 1 -- 172.21.15.99:0/2984157238 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00cd70 con 0x7ff7b40b19f0 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b413f910 con 0x7ff7b40b19f0 2024-01-19T05:18:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.012+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b413ceb0 con 0x7ff7b40b19f0 2024-01-19T05:18:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.016+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b406a870 con 0x7ff7b40b19f0 2024-01-19T05:18:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.016+0000 7ff7aaffd640 1 -- 172.21.15.99:0/2984157238 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff79c013470 con 0x7ff7b40b19f0 2024-01-19T05:18:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.016+0000 7ff7aaffd640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff794066500 0x7ff7940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.016+0000 7ff7aaffd640 1 -- 172.21.15.99:0/2984157238 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff79c084420 con 0x7ff7b40b19f0 2024-01-19T05:18:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.016+0000 7ff7b259c640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff794066500 0x7ff7940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.016+0000 7ff7b259c640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff794066500 0x7ff7940689c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0ae000 tx=0x7ff7ac0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.020+0000 7ff7aaffd640 1 -- 172.21.15.99:0/2984157238 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff79c051810 con 0x7ff7b40b19f0 2024-01-19T05:18:55.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.172+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7b40696e0 con 0x7ff794066500 2024-01-19T05:18:55.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.192+0000 7ff7aaffd640 1 -- 172.21.15.99:0/2984157238 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264626 (secure 0 0 0) 0x7ff7b40696e0 con 0x7ff794066500 2024-01-19T05:18:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:55.195 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff794066500 msgr2=0x7ff7940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff794066500 0x7ff7940689c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0ae000 tx=0x7ff7ac0a7070 comp rx=0 tx=0).stop 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b40b19f0 msgr2=0x7ff7b413c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b40b19f0 0x7ff7b413c210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00e930 tx=0x7ff79c00edf0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 shutdown_connections 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff794066500 0x7ff7940689c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7b4144c70 0x7ff7b413b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b40b19f0 0x7ff7b413c210 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 --2- 172.21.15.99:0/2984157238 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff7b4071de0 0x7ff7b4141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 >> 172.21.15.99:0/2984157238 conn(0x7ff7b40b8080 msgr2=0x7ff7b40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:55.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 shutdown_connections 2024-01-19T05:18:55.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.196+0000 7ff7b8914640 1 -- 172.21.15.99:0/2984157238 wait complete. 2024-01-19T05:18:55.210 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-01-19T05:18:53.357269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240736,"kb_used_data":3752,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733984,"statfs":{"total":773094113280,"available":772847599616,"internally_reserved":0,"allocated":3842048,"data_stored":2177460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.061779"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.343339+0000","last_change":"2024-01-19T05:18:47.356994+0000","last_active":"2024-01-19T05:18:48.343339+0000","last_peered":"2024-01-19T05:18:48.343339+0000","last_clean":"2024-01-19T05:18:48.343339+0000","last_became_active":"2024-01-19T05:18:47.356397+0000","last_became_peered":"2024-01-19T05:18:47.356397+0000","last_unstale":"2024-01-19T05:18:48.343339+0000","last_undegraded":"2024-01-19T05:18:48.343339+0000","last_fullsized":"2024-01-19T05:18:48.343339+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:07.575090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342182+0000","last_change":"2024-01-19T05:18:47.361721+0000","last_active":"2024-01-19T05:18:48.342182+0000","last_peered":"2024-01-19T05:18:48.342182+0000","last_clean":"2024-01-19T05:18:48.342182+0000","last_became_active":"2024-01-19T05:18:47.360669+0000","last_became_peered":"2024-01-19T05:18:47.360669+0000","last_unstale":"2024-01-19T05:18:48.342182+0000","last_undegraded":"2024-01-19T05:18:48.342182+0000","last_fullsized":"2024-01-19T05:18:48.342182+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:12.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921606+0000","last_change":"2024-01-19T05:18:47.347089+0000","last_active":"2024-01-19T05:18:48.921606+0000","last_peered":"2024-01-19T05:18:48.921606+0000","last_clean":"2024-01-19T05:18:48.921606+0000","last_became_active":"2024-01-19T05:18:47.346472+0000","last_became_peered":"2024-01-19T05:18:47.346472+0000","last_unstale":"2024-01-19T05:18:48.921606+0000","last_undegraded":"2024-01-19T05:18:48.921606+0000","last_fullsized":"2024-01-19T05:18:48.921606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:49:03.050028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828452+0000","last_change":"2024-01-19T05:18:47.378978+0000","last_active":"2024-01-19T05:18:48.828452+0000","last_peered":"2024-01-19T05:18:48.828452+0000","last_clean":"2024-01-19T05:18:48.828452+0000","last_became_active":"2024-01-19T05:18:47.378517+0000","last_became_peered":"2024-01-19T05:18:47.378517+0000","last_unstale":"2024-01-19T05:18:48.828452+0000","last_undegraded":"2024-01-19T05:18:48.828452+0000","last_fullsized":"2024-01-19T05:18:48.828452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:10:11.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341940+0000","last_change":"2024-01-19T05:18:47.352475+0000","last_active":"2024-01-19T05:18:48.341940+0000","last_peered":"2024-01-19T05:18:48.341940+0000","last_clean":"2024-01-19T05:18:48.341940+0000","last_became_active":"2024-01-19T05:18:47.352220+0000","last_became_peered":"2024-01-19T05:18:47.352220+0000","last_unstale":"2024-01-19T05:18:48.341940+0000","last_undegraded":"2024-01-19T05:18:48.341940+0000","last_fullsized":"2024-01-19T05:18:48.341940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:53:07.074519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341426+0000","last_change":"2024-01-19T05:18:47.361688+0000","last_active":"2024-01-19T05:18:48.341426+0000","last_peered":"2024-01-19T05:18:48.341426+0000","last_clean":"2024-01-19T05:18:48.341426+0000","last_became_active":"2024-01-19T05:18:47.359832+0000","last_became_peered":"2024-01-19T05:18:47.359832+0000","last_unstale":"2024-01-19T05:18:48.341426+0000","last_undegraded":"2024-01-19T05:18:48.341426+0000","last_fullsized":"2024-01-19T05:18:48.341426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:49:03.050028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454584+0000","last_change":"2024-01-19T05:18:47.364864+0000","last_active":"2024-01-19T05:18:48.454584+0000","last_peered":"2024-01-19T05:18:48.454584+0000","last_clean":"2024-01-19T05:18:48.454584+0000","last_became_active":"2024-01-19T05:18:47.361274+0000","last_became_peered":"2024-01-19T05:18:47.361274+0000","last_unstale":"2024-01-19T05:18:48.454584+0000","last_undegraded":"2024-01-19T05:18:48.454584+0000","last_fullsized":"2024-01-19T05:18:48.454584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:50.265741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454156+0000","last_change":"2024-01-19T05:18:47.370612+0000","last_active":"2024-01-19T05:18:48.454156+0000","last_peered":"2024-01-19T05:18:48.454156+0000","last_clean":"2024-01-19T05:18:48.454156+0000","last_became_active":"2024-01-19T05:18:47.342665+0000","last_became_peered":"2024-01-19T05:18:47.342665+0000","last_unstale":"2024-01-19T05:18:48.454156+0000","last_undegraded":"2024-01-19T05:18:48.454156+0000","last_fullsized":"2024-01-19T05:18:48.454156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:42:44.642617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.421477+0000","last_change":"2024-01-19T05:18:47.384795+0000","last_active":"2024-01-19T05:18:48.421477+0000","last_peered":"2024-01-19T05:18:48.421477+0000","last_clean":"2024-01-19T05:18:48.421477+0000","last_became_active":"2024-01-19T05:18:47.384076+0000","last_became_peered":"2024-01-19T05:18:47.384076+0000","last_unstale":"2024-01-19T05:18:48.421477+0000","last_undegraded":"2024-01-19T05:18:48.421477+0000","last_fullsized":"2024-01-19T05:18:48.421477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:08.042636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828842+0000","last_change":"2024-01-19T05:18:47.353322+0000","last_active":"2024-01-19T05:18:48.828842+0000","last_peered":"2024-01-19T05:18:48.828842+0000","last_clean":"2024-01-19T05:18:48.828842+0000","last_became_active":"2024-01-19T05:18:47.353019+0000","last_became_peered":"2024-01-19T05:18:47.353019+0000","last_unstale":"2024-01-19T05:18:48.828842+0000","last_undegraded":"2024-01-19T05:18:48.828842+0000","last_fullsized":"2024-01-19T05:18:48.828842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T17:05:22.652535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.455116+0000","last_change":"2024-01-19T05:18:47.340924+0000","last_active":"2024-01-19T05:18:48.455116+0000","last_peered":"2024-01-19T05:18:48.455116+0000","last_clean":"2024-01-19T05:18:48.455116+0000","last_became_active":"2024-01-19T05:18:47.340062+0000","last_became_peered":"2024-01-19T05:18:47.340062+0000","last_unstale":"2024-01-19T05:18:48.455116+0000","last_undegraded":"2024-01-19T05:18:48.455116+0000","last_fullsized":"2024-01-19T05:18:48.455116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:30:36.095975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921521+0000","last_change":"2024-01-19T05:18:47.355413+0000","last_active":"2024-01-19T05:18:48.921521+0000","last_peered":"2024-01-19T05:18:48.921521+0000","last_clean":"2024-01-19T05:18:48.921521+0000","last_became_active":"2024-01-19T05:18:47.354687+0000","last_became_peered":"2024-01-19T05:18:47.354687+0000","last_unstale":"2024-01-19T05:18:48.921521+0000","last_undegraded":"2024-01-19T05:18:48.921521+0000","last_fullsized":"2024-01-19T05:18:48.921521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:27:38.933913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342017+0000","last_change":"2024-01-19T05:18:47.332704+0000","last_active":"2024-01-19T05:18:48.342017+0000","last_peered":"2024-01-19T05:18:48.342017+0000","last_clean":"2024-01-19T05:18:48.342017+0000","last_became_active":"2024-01-19T05:18:47.332387+0000","last_became_peered":"2024-01-19T05:18:47.332387+0000","last_unstale":"2024-01-19T05:18:48.342017+0000","last_undegraded":"2024-01-19T05:18:48.342017+0000","last_fullsized":"2024-01-19T05:18:48.342017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:55:20.448095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341550+0000","last_change":"2024-01-19T05:18:47.351032+0000","last_active":"2024-01-19T05:18:48.341550+0000","last_peered":"2024-01-19T05:18:48.341550+0000","last_clean":"2024-01-19T05:18:48.341550+0000","last_became_active":"2024-01-19T05:18:47.349517+0000","last_became_peered":"2024-01-19T05:18:47.349517+0000","last_unstale":"2024-01-19T05:18:48.341550+0000","last_undegraded":"2024-01-19T05:18:48.341550+0000","last_fullsized":"2024-01-19T05:18:48.341550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:14:38.070895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921134+0000","last_change":"2024-01-19T05:18:47.359495+0000","last_active":"2024-01-19T05:18:48.921134+0000","last_peered":"2024-01-19T05:18:48.921134+0000","last_clean":"2024-01-19T05:18:48.921134+0000","last_became_active":"2024-01-19T05:18:47.356897+0000","last_became_peered":"2024-01-19T05:18:47.356897+0000","last_unstale":"2024-01-19T05:18:48.921134+0000","last_undegraded":"2024-01-19T05:18:48.921134+0000","last_fullsized":"2024-01-19T05:18:48.921134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:58.555110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454958+0000","last_change":"2024-01-19T05:18:47.373476+0000","last_active":"2024-01-19T05:18:48.454958+0000","last_peered":"2024-01-19T05:18:48.454958+0000","last_clean":"2024-01-19T05:18:48.454958+0000","last_became_active":"2024-01-19T05:18:47.372744+0000","last_became_peered":"2024-01-19T05:18:47.372744+0000","last_unstale":"2024-01-19T05:18:48.454958+0000","last_undegraded":"2024-01-19T05:18:48.454958+0000","last_fullsized":"2024-01-19T05:18:48.454958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:48:11.050965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.455220+0000","last_change":"2024-01-19T05:18:47.360441+0000","last_active":"2024-01-19T05:18:48.455220+0000","last_peered":"2024-01-19T05:18:48.455220+0000","last_clean":"2024-01-19T05:18:48.455220+0000","last_became_active":"2024-01-19T05:18:47.359787+0000","last_became_peered":"2024-01-19T05:18:47.359787+0000","last_unstale":"2024-01-19T05:18:48.455220+0000","last_undegraded":"2024-01-19T05:18:48.455220+0000","last_fullsized":"2024-01-19T05:18:48.455220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:12.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342246+0000","last_change":"2024-01-19T05:18:47.359867+0000","last_active":"2024-01-19T05:18:48.342246+0000","last_peered":"2024-01-19T05:18:48.342246+0000","last_clean":"2024-01-19T05:18:48.342246+0000","last_became_active":"2024-01-19T05:18:47.353362+0000","last_became_peered":"2024-01-19T05:18:47.353362+0000","last_unstale":"2024-01-19T05:18:48.342246+0000","last_undegraded":"2024-01-19T05:18:48.342246+0000","last_fullsized":"2024-01-19T05:18:48.342246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:04:59.630917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342428+0000","last_change":"2024-01-19T05:18:47.359897+0000","last_active":"2024-01-19T05:18:48.342428+0000","last_peered":"2024-01-19T05:18:48.342428+0000","last_clean":"2024-01-19T05:18:48.342428+0000","last_became_active":"2024-01-19T05:18:47.353308+0000","last_became_peered":"2024-01-19T05:18:47.353308+0000","last_unstale":"2024-01-19T05:18:48.342428+0000","last_undegraded":"2024-01-19T05:18:48.342428+0000","last_fullsized":"2024-01-19T05:18:48.342428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:47:35.443759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341827+0000","last_change":"2024-01-19T05:18:47.350455+0000","last_active":"2024-01-19T05:18:48.341827+0000","last_peered":"2024-01-19T05:18:48.341827+0000","last_clean":"2024-01-19T05:18:48.341827+0000","last_became_active":"2024-01-19T05:18:47.350243+0000","last_became_peered":"2024-01-19T05:18:47.350243+0000","last_unstale":"2024-01-19T05:18:48.341827+0000","last_undegraded":"2024-01-19T05:18:48.341827+0000","last_fullsized":"2024-01-19T05:18:48.341827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:45.426277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420754+0000","last_change":"2024-01-19T05:18:47.384150+0000","last_active":"2024-01-19T05:18:48.420754+0000","last_peered":"2024-01-19T05:18:48.420754+0000","last_clean":"2024-01-19T05:18:48.420754+0000","last_became_active":"2024-01-19T05:18:47.383651+0000","last_became_peered":"2024-01-19T05:18:47.383651+0000","last_unstale":"2024-01-19T05:18:48.420754+0000","last_undegraded":"2024-01-19T05:18:48.420754+0000","last_fullsized":"2024-01-19T05:18:48.420754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:17:47.619046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420919+0000","last_change":"2024-01-19T05:18:47.376638+0000","last_active":"2024-01-19T05:18:48.420919+0000","last_peered":"2024-01-19T05:18:48.420919+0000","last_clean":"2024-01-19T05:18:48.420919+0000","last_became_active":"2024-01-19T05:18:47.376030+0000","last_became_peered":"2024-01-19T05:18:47.376030+0000","last_unstale":"2024-01-19T05:18:48.420919+0000","last_undegraded":"2024-01-19T05:18:48.420919+0000","last_fullsized":"2024-01-19T05:18:48.420919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:34.529608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921317+0000","last_change":"2024-01-19T05:18:47.366501+0000","last_active":"2024-01-19T05:18:48.921317+0000","last_peered":"2024-01-19T05:18:48.921317+0000","last_clean":"2024-01-19T05:18:48.921317+0000","last_became_active":"2024-01-19T05:18:47.366217+0000","last_became_peered":"2024-01-19T05:18:47.366217+0000","last_unstale":"2024-01-19T05:18:48.921317+0000","last_undegraded":"2024-01-19T05:18:48.921317+0000","last_fullsized":"2024-01-19T05:18:48.921317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:02:13.097874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921032+0000","last_change":"2024-01-19T05:18:47.351269+0000","last_active":"2024-01-19T05:18:48.921032+0000","last_peered":"2024-01-19T05:18:48.921032+0000","last_clean":"2024-01-19T05:18:48.921032+0000","last_became_active":"2024-01-19T05:18:47.350600+0000","last_became_peered":"2024-01-19T05:18:47.350600+0000","last_unstale":"2024-01-19T05:18:48.921032+0000","last_undegraded":"2024-01-19T05:18:48.921032+0000","last_fullsized":"2024-01-19T05:18:48.921032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:21.691525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828942+0000","last_change":"2024-01-19T05:18:47.343140+0000","last_active":"2024-01-19T05:18:48.828942+0000","last_peered":"2024-01-19T05:18:48.828942+0000","last_clean":"2024-01-19T05:18:48.828942+0000","last_became_active":"2024-01-19T05:18:47.342811+0000","last_became_peered":"2024-01-19T05:18:47.342811+0000","last_unstale":"2024-01-19T05:18:48.828942+0000","last_undegraded":"2024-01-19T05:18:48.828942+0000","last_fullsized":"2024-01-19T05:18:48.828942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:42:44.642617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342336+0000","last_change":"2024-01-19T05:18:47.371456+0000","last_active":"2024-01-19T05:18:48.342336+0000","last_peered":"2024-01-19T05:18:48.342336+0000","last_clean":"2024-01-19T05:18:48.342336+0000","last_became_active":"2024-01-19T05:18:47.370969+0000","last_became_peered":"2024-01-19T05:18:47.370969+0000","last_unstale":"2024-01-19T05:18:48.342336+0000","last_undegraded":"2024-01-19T05:18:48.342336+0000","last_fullsized":"2024-01-19T05:18:48.342336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:59:48.604458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828975+0000","last_change":"2024-01-19T05:18:47.378888+0000","last_active":"2024-01-19T05:18:48.828975+0000","last_peered":"2024-01-19T05:18:48.828975+0000","last_clean":"2024-01-19T05:18:48.828975+0000","last_became_active":"2024-01-19T05:18:47.378444+0000","last_became_peered":"2024-01-19T05:18:47.378444+0000","last_unstale":"2024-01-19T05:18:48.828975+0000","last_undegraded":"2024-01-19T05:18:48.828975+0000","last_fullsized":"2024-01-19T05:18:48.828975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:21.691525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921690+0000","last_change":"2024-01-19T05:18:47.347904+0000","last_active":"2024-01-19T05:18:48.921690+0000","last_peered":"2024-01-19T05:18:48.921690+0000","last_clean":"2024-01-19T05:18:48.921690+0000","last_became_active":"2024-01-19T05:18:47.346067+0000","last_became_peered":"2024-01-19T05:18:47.346067+0000","last_unstale":"2024-01-19T05:18:48.921690+0000","last_undegraded":"2024-01-19T05:18:48.921690+0000","last_fullsized":"2024-01-19T05:18:48.921690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:14:38.070895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420867+0000","last_change":"2024-01-19T05:18:47.375647+0000","last_active":"2024-01-19T05:18:48.420867+0000","last_peered":"2024-01-19T05:18:48.420867+0000","last_clean":"2024-01-19T05:18:48.420867+0000","last_became_active":"2024-01-19T05:18:47.368485+0000","last_became_peered":"2024-01-19T05:18:47.368485+0000","last_unstale":"2024-01-19T05:18:48.420867+0000","last_undegraded":"2024-01-19T05:18:48.420867+0000","last_fullsized":"2024-01-19T05:18:48.420867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:58:28.301294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454854+0000","last_change":"2024-01-19T05:18:47.365964+0000","last_active":"2024-01-19T05:18:48.454854+0000","last_peered":"2024-01-19T05:18:48.454854+0000","last_clean":"2024-01-19T05:18:48.454854+0000","last_became_active":"2024-01-19T05:18:47.365216+0000","last_became_peered":"2024-01-19T05:18:47.365216+0000","last_unstale":"2024-01-19T05:18:48.454854+0000","last_undegraded":"2024-01-19T05:18:48.454854+0000","last_fullsized":"2024-01-19T05:18:48.454854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:14:38.070895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342926+0000","last_change":"2024-01-19T05:18:47.336966+0000","last_active":"2024-01-19T05:18:48.342926+0000","last_peered":"2024-01-19T05:18:48.342926+0000","last_clean":"2024-01-19T05:18:48.342926+0000","last_became_active":"2024-01-19T05:18:47.335998+0000","last_became_peered":"2024-01-19T05:18:47.335998+0000","last_unstale":"2024-01-19T05:18:48.342926+0000","last_undegraded":"2024-01-19T05:18:48.342926+0000","last_fullsized":"2024-01-19T05:18:48.342926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:19.180566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454279+0000","last_change":"2024-01-19T05:18:47.379129+0000","last_active":"2024-01-19T05:18:48.454279+0000","last_peered":"2024-01-19T05:18:48.454279+0000","last_clean":"2024-01-19T05:18:48.454279+0000","last_became_active":"2024-01-19T05:18:47.378541+0000","last_became_peered":"2024-01-19T05:18:47.378541+0000","last_unstale":"2024-01-19T05:18:48.454279+0000","last_undegraded":"2024-01-19T05:18:48.454279+0000","last_fullsized":"2024-01-19T05:18:48.454279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:30:21.691525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921705+0000","last_change":"2024-01-19T05:18:47.363386+0000","last_active":"2024-01-19T05:18:48.921705+0000","last_peered":"2024-01-19T05:18:48.921705+0000","last_clean":"2024-01-19T05:18:48.921705+0000","last_became_active":"2024-01-19T05:18:47.363012+0000","last_became_peered":"2024-01-19T05:18:47.363012+0000","last_unstale":"2024-01-19T05:18:48.921705+0000","last_undegraded":"2024-01-19T05:18:48.921705+0000","last_fullsized":"2024-01-19T05:18:48.921705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:10:07.628689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'4","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.370394+0000","last_change":"2024-01-19T05:18:46.336756+0000","last_active":"2024-01-19T05:18:47.370394+0000","last_peered":"2024-01-19T05:18:47.370394+0000","last_clean":"2024-01-19T05:18:47.370394+0000","last_became_active":"2024-01-19T05:18:46.336052+0000","last_became_peered":"2024-01-19T05:18:46.336052+0000","last_unstale":"2024-01-19T05:18:47.370394+0000","last_undegraded":"2024-01-19T05:18:47.370394+0000","last_fullsized":"2024-01-19T05:18:47.370394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:35:33.866174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.343424+0000","last_change":"2024-01-19T05:18:47.387944+0000","last_active":"2024-01-19T05:18:48.343424+0000","last_peered":"2024-01-19T05:18:48.343424+0000","last_clean":"2024-01-19T05:18:48.343424+0000","last_became_active":"2024-01-19T05:18:47.387099+0000","last_became_peered":"2024-01-19T05:18:47.387099+0000","last_unstale":"2024-01-19T05:18:48.343424+0000","last_undegraded":"2024-01-19T05:18:48.343424+0000","last_fullsized":"2024-01-19T05:18:48.343424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:29.882025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921785+0000","last_change":"2024-01-19T05:18:46.337013+0000","last_active":"2024-01-19T05:18:48.921785+0000","last_peered":"2024-01-19T05:18:48.921785+0000","last_clean":"2024-01-19T05:18:48.921785+0000","last_became_active":"2024-01-19T05:18:46.336748+0000","last_became_peered":"2024-01-19T05:18:46.336748+0000","last_unstale":"2024-01-19T05:18:48.921785+0000","last_undegraded":"2024-01-19T05:18:48.921785+0000","last_fullsized":"2024-01-19T05:18:48.921785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:57.794705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.421348+0000","last_change":"2024-01-19T05:18:47.376474+0000","last_active":"2024-01-19T05:18:48.421348+0000","last_peered":"2024-01-19T05:18:48.421348+0000","last_clean":"2024-01-19T05:18:48.421348+0000","last_became_active":"2024-01-19T05:18:47.375822+0000","last_became_peered":"2024-01-19T05:18:47.375822+0000","last_unstale":"2024-01-19T05:18:48.421348+0000","last_undegraded":"2024-01-19T05:18:48.421348+0000","last_fullsized":"2024-01-19T05:18:48.421348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:10:11.524473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.368338+0000","last_change":"2024-01-19T05:18:46.312714+0000","last_active":"2024-01-19T05:18:47.368338+0000","last_peered":"2024-01-19T05:18:47.368338+0000","last_clean":"2024-01-19T05:18:47.368338+0000","last_became_active":"2024-01-19T05:18:46.312361+0000","last_became_peered":"2024-01-19T05:18:46.312361+0000","last_unstale":"2024-01-19T05:18:47.368338+0000","last_undegraded":"2024-01-19T05:18:47.368338+0000","last_fullsized":"2024-01-19T05:18:47.368338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:28.878972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.829143+0000","last_change":"2024-01-19T05:18:47.367903+0000","last_active":"2024-01-19T05:18:48.829143+0000","last_peered":"2024-01-19T05:18:48.829143+0000","last_clean":"2024-01-19T05:18:48.829143+0000","last_became_active":"2024-01-19T05:18:47.367633+0000","last_became_peered":"2024-01-19T05:18:47.367633+0000","last_unstale":"2024-01-19T05:18:48.829143+0000","last_undegraded":"2024-01-19T05:18:48.829143+0000","last_fullsized":"2024-01-19T05:18:48.829143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:58.555110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.346024+0000","last_change":"2024-01-19T05:18:46.317178+0000","last_active":"2024-01-19T05:18:47.346024+0000","last_peered":"2024-01-19T05:18:47.346024+0000","last_clean":"2024-01-19T05:18:47.346024+0000","last_became_active":"2024-01-19T05:18:46.316584+0000","last_became_peered":"2024-01-19T05:18:46.316584+0000","last_unstale":"2024-01-19T05:18:47.346024+0000","last_undegraded":"2024-01-19T05:18:47.346024+0000","last_fullsized":"2024-01-19T05:18:47.346024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:56:45.015876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454521+0000","last_change":"2024-01-19T05:18:47.387815+0000","last_active":"2024-01-19T05:18:48.454521+0000","last_peered":"2024-01-19T05:18:48.454521+0000","last_clean":"2024-01-19T05:18:48.454521+0000","last_became_active":"2024-01-19T05:18:47.387034+0000","last_became_peered":"2024-01-19T05:18:47.387034+0000","last_unstale":"2024-01-19T05:18:48.454521+0000","last_undegraded":"2024-01-19T05:18:48.454521+0000","last_fullsized":"2024-01-19T05:18:48.454521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:07.690039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"28'1","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.389496+0000","last_change":"2024-01-19T05:18:46.322418+0000","last_active":"2024-01-19T05:18:47.389496+0000","last_peered":"2024-01-19T05:18:47.389496+0000","last_clean":"2024-01-19T05:18:47.389496+0000","last_became_active":"2024-01-19T05:18:46.321434+0000","last_became_peered":"2024-01-19T05:18:46.321434+0000","last_unstale":"2024-01-19T05:18:47.389496+0000","last_undegraded":"2024-01-19T05:18:47.389496+0000","last_fullsized":"2024-01-19T05:18:47.389496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:34:49.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921289+0000","last_change":"2024-01-19T05:18:47.345439+0000","last_active":"2024-01-19T05:18:48.921289+0000","last_peered":"2024-01-19T05:18:48.921289+0000","last_clean":"2024-01-19T05:18:48.921289+0000","last_became_active":"2024-01-19T05:18:47.344754+0000","last_became_peered":"2024-01-19T05:18:47.344754+0000","last_unstale":"2024-01-19T05:18:48.921289+0000","last_undegraded":"2024-01-19T05:18:48.921289+0000","last_fullsized":"2024-01-19T05:18:48.921289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:30:07.690039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'1","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.388456+0000","last_change":"2024-01-19T05:18:46.321982+0000","last_active":"2024-01-19T05:18:47.388456+0000","last_peered":"2024-01-19T05:18:47.388456+0000","last_clean":"2024-01-19T05:18:47.388456+0000","last_became_active":"2024-01-19T05:18:46.321109+0000","last_became_peered":"2024-01-19T05:18:46.321109+0000","last_unstale":"2024-01-19T05:18:47.388456+0000","last_undegraded":"2024-01-19T05:18:47.388456+0000","last_fullsized":"2024-01-19T05:18:47.388456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:57.794705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420504+0000","last_change":"2024-01-19T05:18:47.368995+0000","last_active":"2024-01-19T05:18:48.420504+0000","last_peered":"2024-01-19T05:18:48.420504+0000","last_clean":"2024-01-19T05:18:48.420504+0000","last_became_active":"2024-01-19T05:18:47.368178+0000","last_became_peered":"2024-01-19T05:18:47.368178+0000","last_unstale":"2024-01-19T05:18:48.420504+0000","last_undegraded":"2024-01-19T05:18:48.420504+0000","last_fullsized":"2024-01-19T05:18:48.420504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:10:07.628689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.348799+0000","last_change":"2024-01-19T05:18:46.310539+0000","last_active":"2024-01-19T05:18:47.348799+0000","last_peered":"2024-01-19T05:18:47.348799+0000","last_clean":"2024-01-19T05:18:47.348799+0000","last_became_active":"2024-01-19T05:18:46.310156+0000","last_became_peered":"2024-01-19T05:18:46.310156+0000","last_unstale":"2024-01-19T05:18:47.348799+0000","last_undegraded":"2024-01-19T05:18:47.348799+0000","last_fullsized":"2024-01-19T05:18:47.348799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:11:55.108079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828064+0000","last_change":"2024-01-19T05:18:47.347703+0000","last_active":"2024-01-19T05:18:48.828064+0000","last_peered":"2024-01-19T05:18:48.828064+0000","last_clean":"2024-01-19T05:18:48.828064+0000","last_became_active":"2024-01-19T05:18:47.347395+0000","last_became_peered":"2024-01-19T05:18:47.347395+0000","last_unstale":"2024-01-19T05:18:48.828064+0000","last_undegraded":"2024-01-19T05:18:48.828064+0000","last_fullsized":"2024-01-19T05:18:48.828064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:29:34.529608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.376650+0000","last_change":"2024-01-19T05:18:46.316444+0000","last_active":"2024-01-19T05:18:47.376650+0000","last_peered":"2024-01-19T05:18:47.376650+0000","last_clean":"2024-01-19T05:18:47.376650+0000","last_became_active":"2024-01-19T05:18:46.315699+0000","last_became_peered":"2024-01-19T05:18:46.315699+0000","last_unstale":"2024-01-19T05:18:47.376650+0000","last_undegraded":"2024-01-19T05:18:47.376650+0000","last_fullsized":"2024-01-19T05:18:47.376650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:05:44.423224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921979+0000","last_change":"2024-01-19T05:18:47.357252+0000","last_active":"2024-01-19T05:18:48.921979+0000","last_peered":"2024-01-19T05:18:48.921979+0000","last_clean":"2024-01-19T05:18:48.921979+0000","last_became_active":"2024-01-19T05:18:47.356422+0000","last_became_peered":"2024-01-19T05:18:47.356422+0000","last_unstale":"2024-01-19T05:18:48.921979+0000","last_undegraded":"2024-01-19T05:18:48.921979+0000","last_fullsized":"2024-01-19T05:18:48.921979+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:48:11.050965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.351603+0000","last_change":"2024-01-19T05:18:46.340343+0000","last_active":"2024-01-19T05:18:47.351603+0000","last_peered":"2024-01-19T05:18:47.351603+0000","last_clean":"2024-01-19T05:18:47.351603+0000","last_became_active":"2024-01-19T05:18:46.340065+0000","last_became_peered":"2024-01-19T05:18:46.340065+0000","last_unstale":"2024-01-19T05:18:47.351603+0000","last_undegraded":"2024-01-19T05:18:47.351603+0000","last_fullsized":"2024-01-19T05:18:47.351603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:58:27.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342381+0000","last_change":"2024-01-19T05:18:47.360560+0000","last_active":"2024-01-19T05:18:48.342381+0000","last_peered":"2024-01-19T05:18:48.342381+0000","last_clean":"2024-01-19T05:18:48.342381+0000","last_became_active":"2024-01-19T05:18:47.360261+0000","last_became_peered":"2024-01-19T05:18:47.360261+0000","last_unstale":"2024-01-19T05:18:48.342381+0000","last_undegraded":"2024-01-19T05:18:48.342381+0000","last_fullsized":"2024-01-19T05:18:48.342381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:07:16.579968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.922002+0000","last_change":"2024-01-19T05:18:46.315379+0000","last_active":"2024-01-19T05:18:48.922002+0000","last_peered":"2024-01-19T05:18:48.922002+0000","last_clean":"2024-01-19T05:18:48.922002+0000","last_became_active":"2024-01-19T05:18:46.314403+0000","last_became_peered":"2024-01-19T05:18:46.314403+0000","last_unstale":"2024-01-19T05:18:48.922002+0000","last_undegraded":"2024-01-19T05:18:48.922002+0000","last_fullsized":"2024-01-19T05:18:48.922002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:01:21.099063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341793+0000","last_change":"2024-01-19T05:18:47.370656+0000","last_active":"2024-01-19T05:18:48.341793+0000","last_peered":"2024-01-19T05:18:48.341793+0000","last_clean":"2024-01-19T05:18:48.341793+0000","last_became_active":"2024-01-19T05:18:47.370372+0000","last_became_peered":"2024-01-19T05:18:47.370372+0000","last_unstale":"2024-01-19T05:18:48.341793+0000","last_undegraded":"2024-01-19T05:18:48.341793+0000","last_fullsized":"2024-01-19T05:18:48.341793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:30:36.095975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"28'3","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.370805+0000","last_change":"2024-01-19T05:18:46.339958+0000","last_active":"2024-01-19T05:18:47.370805+0000","last_peered":"2024-01-19T05:18:47.370805+0000","last_clean":"2024-01-19T05:18:47.370805+0000","last_became_active":"2024-01-19T05:18:46.339320+0000","last_became_peered":"2024-01-19T05:18:46.339320+0000","last_unstale":"2024-01-19T05:18:47.370805+0000","last_undegraded":"2024-01-19T05:18:47.370805+0000","last_fullsized":"2024-01-19T05:18:47.370805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:06.572037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921541+0000","last_change":"2024-01-19T05:18:47.350096+0000","last_active":"2024-01-19T05:18:48.921541+0000","last_peered":"2024-01-19T05:18:48.921541+0000","last_clean":"2024-01-19T05:18:48.921541+0000","last_became_active":"2024-01-19T05:18:47.347177+0000","last_became_peered":"2024-01-19T05:18:47.347177+0000","last_unstale":"2024-01-19T05:18:48.921541+0000","last_undegraded":"2024-01-19T05:18:48.921541+0000","last_fullsized":"2024-01-19T05:18:48.921541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:50.265741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.392174+0000","last_change":"2024-01-19T05:18:46.315459+0000","last_active":"2024-01-19T05:18:47.392174+0000","last_peered":"2024-01-19T05:18:47.392174+0000","last_clean":"2024-01-19T05:18:47.392174+0000","last_became_active":"2024-01-19T05:18:46.315170+0000","last_became_peered":"2024-01-19T05:18:46.315170+0000","last_unstale":"2024-01-19T05:18:47.392174+0000","last_undegraded":"2024-01-19T05:18:47.392174+0000","last_fullsized":"2024-01-19T05:18:47.392174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:17:46.615993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828116+0000","last_change":"2024-01-19T05:18:47.352536+0000","last_active":"2024-01-19T05:18:48.828116+0000","last_peered":"2024-01-19T05:18:48.828116+0000","last_clean":"2024-01-19T05:18:48.828116+0000","last_became_active":"2024-01-19T05:18:47.352271+0000","last_became_peered":"2024-01-19T05:18:47.352271+0000","last_unstale":"2024-01-19T05:18:48.828116+0000","last_undegraded":"2024-01-19T05:18:48.828116+0000","last_fullsized":"2024-01-19T05:18:48.828116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:47.348700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.390157+0000","last_change":"2024-01-19T05:18:46.316085+0000","last_active":"2024-01-19T05:18:47.390157+0000","last_peered":"2024-01-19T05:18:47.390157+0000","last_clean":"2024-01-19T05:18:47.390157+0000","last_became_active":"2024-01-19T05:18:46.315358+0000","last_became_peered":"2024-01-19T05:18:46.315358+0000","last_unstale":"2024-01-19T05:18:47.390157+0000","last_undegraded":"2024-01-19T05:18:47.390157+0000","last_fullsized":"2024-01-19T05:18:47.390157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:00.099255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341766+0000","last_change":"2024-01-19T05:18:47.362018+0000","last_active":"2024-01-19T05:18:48.341766+0000","last_peered":"2024-01-19T05:18:48.341766+0000","last_clean":"2024-01-19T05:18:48.341766+0000","last_became_active":"2024-01-19T05:18:47.360598+0000","last_became_peered":"2024-01-19T05:18:47.360598+0000","last_unstale":"2024-01-19T05:18:48.341766+0000","last_undegraded":"2024-01-19T05:18:48.341766+0000","last_fullsized":"2024-01-19T05:18:48.341766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:48:11.050965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.321465+0000","last_change":"2024-01-19T05:18:46.312783+0000","last_active":"2024-01-19T05:18:47.321465+0000","last_peered":"2024-01-19T05:18:47.321465+0000","last_clean":"2024-01-19T05:18:47.321465+0000","last_became_active":"2024-01-19T05:18:46.312300+0000","last_became_peered":"2024-01-19T05:18:46.312300+0000","last_unstale":"2024-01-19T05:18:47.321465+0000","last_undegraded":"2024-01-19T05:18:47.321465+0000","last_fullsized":"2024-01-19T05:18:47.321465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:35:33.866174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454563+0000","last_change":"2024-01-19T05:18:47.383022+0000","last_active":"2024-01-19T05:18:48.454563+0000","last_peered":"2024-01-19T05:18:48.454563+0000","last_clean":"2024-01-19T05:18:48.454563+0000","last_became_active":"2024-01-19T05:18:47.382228+0000","last_became_peered":"2024-01-19T05:18:47.382228+0000","last_unstale":"2024-01-19T05:18:48.454563+0000","last_undegraded":"2024-01-19T05:18:48.454563+0000","last_fullsized":"2024-01-19T05:18:48.454563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:27:38.933913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.348963+0000","last_change":"2024-01-19T05:18:46.337884+0000","last_active":"2024-01-19T05:18:47.348963+0000","last_peered":"2024-01-19T05:18:47.348963+0000","last_clean":"2024-01-19T05:18:47.348963+0000","last_became_active":"2024-01-19T05:18:46.337610+0000","last_became_peered":"2024-01-19T05:18:46.337610+0000","last_unstale":"2024-01-19T05:18:47.348963+0000","last_undegraded":"2024-01-19T05:18:47.348963+0000","last_fullsized":"2024-01-19T05:18:47.348963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:02:12.094820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.343087+0000","last_change":"2024-01-19T05:18:47.377128+0000","last_active":"2024-01-19T05:18:48.343087+0000","last_peered":"2024-01-19T05:18:48.343087+0000","last_clean":"2024-01-19T05:18:48.343087+0000","last_became_active":"2024-01-19T05:18:47.376543+0000","last_became_peered":"2024-01-19T05:18:47.376543+0000","last_unstale":"2024-01-19T05:18:48.343087+0000","last_undegraded":"2024-01-19T05:18:48.343087+0000","last_fullsized":"2024-01-19T05:18:48.343087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:11:56.111132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"28'8","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.370250+0000","last_change":"2024-01-19T05:18:46.313279+0000","last_active":"2024-01-19T05:18:47.370250+0000","last_peered":"2024-01-19T05:18:47.370250+0000","last_clean":"2024-01-19T05:18:47.370250+0000","last_became_active":"2024-01-19T05:18:46.312912+0000","last_became_peered":"2024-01-19T05:18:46.312912+0000","last_unstale":"2024-01-19T05:18:47.370250+0000","last_undegraded":"2024-01-19T05:18:47.370250+0000","last_fullsized":"2024-01-19T05:18:47.370250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:41:18.177513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.421107+0000","last_change":"2024-01-19T05:18:47.385361+0000","last_active":"2024-01-19T05:18:48.421107+0000","last_peered":"2024-01-19T05:18:48.421107+0000","last_clean":"2024-01-19T05:18:48.421107+0000","last_became_active":"2024-01-19T05:18:47.384866+0000","last_became_peered":"2024-01-19T05:18:47.384866+0000","last_unstale":"2024-01-19T05:18:48.421107+0000","last_undegraded":"2024-01-19T05:18:48.421107+0000","last_fullsized":"2024-01-19T05:18:48.421107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:55:47.348700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'1","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.352926+0000","last_change":"2024-01-19T05:18:46.315098+0000","last_active":"2024-01-19T05:18:47.352926+0000","last_peered":"2024-01-19T05:18:47.352926+0000","last_clean":"2024-01-19T05:18:47.352926+0000","last_became_active":"2024-01-19T05:18:46.314855+0000","last_became_peered":"2024-01-19T05:18:46.314855+0000","last_unstale":"2024-01-19T05:18:47.352926+0000","last_undegraded":"2024-01-19T05:18:47.352926+0000","last_fullsized":"2024-01-19T05:18:47.352926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:01:21.099063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921984+0000","last_change":"2024-01-19T05:18:47.386905+0000","last_active":"2024-01-19T05:18:48.921984+0000","last_peered":"2024-01-19T05:18:48.921984+0000","last_clean":"2024-01-19T05:18:48.921984+0000","last_became_active":"2024-01-19T05:18:47.386057+0000","last_became_peered":"2024-01-19T05:18:47.386057+0000","last_unstale":"2024-01-19T05:18:48.921984+0000","last_undegraded":"2024-01-19T05:18:48.921984+0000","last_fullsized":"2024-01-19T05:18:48.921984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T06:30:36.095975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.390073+0000","last_change":"2024-01-19T05:18:46.322547+0000","last_active":"2024-01-19T05:18:47.390073+0000","last_peered":"2024-01-19T05:18:47.390073+0000","last_clean":"2024-01-19T05:18:47.390073+0000","last_became_active":"2024-01-19T05:18:46.321947+0000","last_became_peered":"2024-01-19T05:18:46.321947+0000","last_unstale":"2024-01-19T05:18:47.390073+0000","last_undegraded":"2024-01-19T05:18:47.390073+0000","last_fullsized":"2024-01-19T05:18:47.390073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:59.768298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.828493+0000","last_change":"2024-01-19T05:18:47.378910+0000","last_active":"2024-01-19T05:18:48.828493+0000","last_peered":"2024-01-19T05:18:48.828493+0000","last_clean":"2024-01-19T05:18:48.828493+0000","last_became_active":"2024-01-19T05:18:47.378444+0000","last_became_peered":"2024-01-19T05:18:47.378444+0000","last_unstale":"2024-01-19T05:18:48.828493+0000","last_undegraded":"2024-01-19T05:18:48.828493+0000","last_fullsized":"2024-01-19T05:18:48.828493+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:51:08.042636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"28'1","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.386261+0000","last_change":"2024-01-19T05:18:46.314755+0000","last_active":"2024-01-19T05:18:47.386261+0000","last_peered":"2024-01-19T05:18:47.386261+0000","last_clean":"2024-01-19T05:18:47.386261+0000","last_became_active":"2024-01-19T05:18:46.313921+0000","last_became_peered":"2024-01-19T05:18:46.313921+0000","last_unstale":"2024-01-19T05:18:47.386261+0000","last_undegraded":"2024-01-19T05:18:47.386261+0000","last_fullsized":"2024-01-19T05:18:47.386261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:01:21.099063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342459+0000","last_change":"2024-01-19T05:18:47.342045+0000","last_active":"2024-01-19T05:18:48.342459+0000","last_peered":"2024-01-19T05:18:48.342459+0000","last_clean":"2024-01-19T05:18:48.342459+0000","last_became_active":"2024-01-19T05:18:47.341614+0000","last_became_peered":"2024-01-19T05:18:47.341614+0000","last_unstale":"2024-01-19T05:18:48.342459+0000","last_undegraded":"2024-01-19T05:18:48.342459+0000","last_fullsized":"2024-01-19T05:18:48.342459+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:34:50.639528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.379121+0000","last_change":"2024-01-19T05:18:46.321817+0000","last_active":"2024-01-19T05:18:47.379121+0000","last_peered":"2024-01-19T05:18:47.379121+0000","last_clean":"2024-01-19T05:18:47.379121+0000","last_became_active":"2024-01-19T05:18:46.321023+0000","last_became_peered":"2024-01-19T05:18:46.321023+0000","last_unstale":"2024-01-19T05:18:47.379121+0000","last_undegraded":"2024-01-19T05:18:47.379121+0000","last_fullsized":"2024-01-19T05:18:47.379121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:23:00.337517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342125+0000","last_change":"2024-01-19T05:18:47.385354+0000","last_active":"2024-01-19T05:18:48.342125+0000","last_peered":"2024-01-19T05:18:48.342125+0000","last_clean":"2024-01-19T05:18:48.342125+0000","last_became_active":"2024-01-19T05:18:47.385000+0000","last_became_peered":"2024-01-19T05:18:47.385000+0000","last_unstale":"2024-01-19T05:18:48.342125+0000","last_undegraded":"2024-01-19T05:18:48.342125+0000","last_fullsized":"2024-01-19T05:18:48.342125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:58.797758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"28'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921920+0000","last_change":"2024-01-19T05:18:46.313839+0000","last_active":"2024-01-19T05:18:48.921920+0000","last_peered":"2024-01-19T05:18:48.921920+0000","last_clean":"2024-01-19T05:18:48.921920+0000","last_became_active":"2024-01-19T05:18:46.313232+0000","last_became_peered":"2024-01-19T05:18:46.313232+0000","last_unstale":"2024-01-19T05:18:48.921920+0000","last_undegraded":"2024-01-19T05:18:48.921920+0000","last_fullsized":"2024-01-19T05:18:48.921920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:59.768298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.342067+0000","last_change":"2024-01-19T05:18:47.339362+0000","last_active":"2024-01-19T05:18:48.342067+0000","last_peered":"2024-01-19T05:18:48.342067+0000","last_clean":"2024-01-19T05:18:48.342067+0000","last_became_active":"2024-01-19T05:18:47.339057+0000","last_became_peered":"2024-01-19T05:18:47.339057+0000","last_unstale":"2024-01-19T05:18:48.342067+0000","last_undegraded":"2024-01-19T05:18:48.342067+0000","last_fullsized":"2024-01-19T05:18:48.342067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:35:34.869227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.322471+0000","last_change":"2024-01-19T05:18:46.324680+0000","last_active":"2024-01-19T05:18:47.322471+0000","last_peered":"2024-01-19T05:18:47.322471+0000","last_clean":"2024-01-19T05:18:47.322471+0000","last_became_active":"2024-01-19T05:18:46.323968+0000","last_became_peered":"2024-01-19T05:18:46.323968+0000","last_unstale":"2024-01-19T05:18:47.322471+0000","last_undegraded":"2024-01-19T05:18:47.322471+0000","last_fullsized":"2024-01-19T05:18:47.322471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:57.794705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341618+0000","last_change":"2024-01-19T05:18:47.341711+0000","last_active":"2024-01-19T05:18:48.341618+0000","last_peered":"2024-01-19T05:18:48.341618+0000","last_clean":"2024-01-19T05:18:48.341618+0000","last_became_active":"2024-01-19T05:18:47.341341+0000","last_became_peered":"2024-01-19T05:18:47.341341+0000","last_unstale":"2024-01-19T05:18:48.341618+0000","last_undegraded":"2024-01-19T05:18:48.341618+0000","last_fullsized":"2024-01-19T05:18:48.341618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:37:41.649264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.376763+0000","last_change":"2024-01-19T05:18:46.314658+0000","last_active":"2024-01-19T05:18:47.376763+0000","last_peered":"2024-01-19T05:18:47.376763+0000","last_clean":"2024-01-19T05:18:47.376763+0000","last_became_active":"2024-01-19T05:18:46.313819+0000","last_became_peered":"2024-01-19T05:18:46.313819+0000","last_unstale":"2024-01-19T05:18:47.376763+0000","last_undegraded":"2024-01-19T05:18:47.376763+0000","last_fullsized":"2024-01-19T05:18:47.376763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:18.332189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454334+0000","last_change":"2024-01-19T05:18:47.361920+0000","last_active":"2024-01-19T05:18:48.454334+0000","last_peered":"2024-01-19T05:18:48.454334+0000","last_clean":"2024-01-19T05:18:48.454334+0000","last_became_active":"2024-01-19T05:18:47.360437+0000","last_became_peered":"2024-01-19T05:18:47.360437+0000","last_unstale":"2024-01-19T05:18:48.454334+0000","last_undegraded":"2024-01-19T05:18:48.454334+0000","last_fullsized":"2024-01-19T05:18:48.454334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T14:28:58.555110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.339926+0000","last_change":"2024-01-19T05:18:46.340492+0000","last_active":"2024-01-19T05:18:47.339926+0000","last_peered":"2024-01-19T05:18:47.339926+0000","last_clean":"2024-01-19T05:18:47.339926+0000","last_became_active":"2024-01-19T05:18:46.339399+0000","last_became_peered":"2024-01-19T05:18:46.339399+0000","last_unstale":"2024-01-19T05:18:47.339926+0000","last_undegraded":"2024-01-19T05:18:47.339926+0000","last_fullsized":"2024-01-19T05:18:47.339926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:02:12.094820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.341974+0000","last_change":"2024-01-19T05:18:47.355938+0000","last_active":"2024-01-19T05:18:48.341974+0000","last_peered":"2024-01-19T05:18:48.341974+0000","last_clean":"2024-01-19T05:18:48.341974+0000","last_became_active":"2024-01-19T05:18:47.355618+0000","last_became_peered":"2024-01-19T05:18:47.355618+0000","last_unstale":"2024-01-19T05:18:48.341974+0000","last_undegraded":"2024-01-19T05:18:48.341974+0000","last_fullsized":"2024-01-19T05:18:48.341974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T16:00:19.335242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'2","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.358950+0000","last_change":"2024-01-19T05:18:46.335047+0000","last_active":"2024-01-19T05:18:47.358950+0000","last_peered":"2024-01-19T05:18:47.358950+0000","last_clean":"2024-01-19T05:18:47.358950+0000","last_became_active":"2024-01-19T05:18:46.334739+0000","last_became_peered":"2024-01-19T05:18:46.334739+0000","last_unstale":"2024-01-19T05:18:47.358950+0000","last_undegraded":"2024-01-19T05:18:47.358950+0000","last_fullsized":"2024-01-19T05:18:47.358950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:12:59.768298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.922192+0000","last_change":"2024-01-19T05:18:47.354777+0000","last_active":"2024-01-19T05:18:48.922192+0000","last_peered":"2024-01-19T05:18:48.922192+0000","last_clean":"2024-01-19T05:18:48.922192+0000","last_became_active":"2024-01-19T05:18:47.353650+0000","last_became_peered":"2024-01-19T05:18:47.353650+0000","last_unstale":"2024-01-19T05:18:48.922192+0000","last_undegraded":"2024-01-19T05:18:48.922192+0000","last_fullsized":"2024-01-19T05:18:48.922192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T12:51:12.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:50.302927+0000","last_change":"2024-01-19T05:18:46.315538+0000","last_active":"2024-01-19T05:18:50.302927+0000","last_peered":"2024-01-19T05:18:50.302927+0000","last_clean":"2024-01-19T05:18:50.302927+0000","last_became_active":"2024-01-19T05:18:46.314907+0000","last_became_peered":"2024-01-19T05:18:46.314907+0000","last_unstale":"2024-01-19T05:18:50.302927+0000","last_undegraded":"2024-01-19T05:18:50.302927+0000","last_fullsized":"2024-01-19T05:18:50.302927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:34:49.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921664+0000","last_change":"2024-01-19T05:18:47.343423+0000","last_active":"2024-01-19T05:18:48.921664+0000","last_peered":"2024-01-19T05:18:48.921664+0000","last_clean":"2024-01-19T05:18:48.921664+0000","last_became_active":"2024-01-19T05:18:47.342970+0000","last_became_peered":"2024-01-19T05:18:47.342970+0000","last_unstale":"2024-01-19T05:18:48.921664+0000","last_undegraded":"2024-01-19T05:18:48.921664+0000","last_fullsized":"2024-01-19T05:18:48.921664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:29.882025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.322996+0000","last_change":"2024-01-19T05:18:46.313184+0000","last_active":"2024-01-19T05:18:47.322996+0000","last_peered":"2024-01-19T05:18:47.322996+0000","last_clean":"2024-01-19T05:18:47.322996+0000","last_became_active":"2024-01-19T05:18:46.312797+0000","last_became_peered":"2024-01-19T05:18:46.312797+0000","last_unstale":"2024-01-19T05:18:47.322996+0000","last_undegraded":"2024-01-19T05:18:47.322996+0000","last_fullsized":"2024-01-19T05:18:47.322996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:34:49.636475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.343389+0000","last_change":"2024-01-19T05:18:47.344884+0000","last_active":"2024-01-19T05:18:48.343389+0000","last_peered":"2024-01-19T05:18:48.343389+0000","last_clean":"2024-01-19T05:18:48.343389+0000","last_became_active":"2024-01-19T05:18:47.343762+0000","last_became_peered":"2024-01-19T05:18:47.343762+0000","last_unstale":"2024-01-19T05:18:48.343389+0000","last_undegraded":"2024-01-19T05:18:48.343389+0000","last_fullsized":"2024-01-19T05:18:48.343389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:02:13.097874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.922105+0000","last_change":"2024-01-19T05:18:46.333693+0000","last_active":"2024-01-19T05:18:48.922105+0000","last_peered":"2024-01-19T05:18:48.922105+0000","last_clean":"2024-01-19T05:18:48.922105+0000","last_became_active":"2024-01-19T05:18:46.333280+0000","last_became_peered":"2024-01-19T05:18:46.333280+0000","last_unstale":"2024-01-19T05:18:48.922105+0000","last_undegraded":"2024-01-19T05:18:48.922105+0000","last_fullsized":"2024-01-19T05:18:48.922105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T05:31:00.099255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.921852+0000","last_change":"2024-01-19T05:18:47.355134+0000","last_active":"2024-01-19T05:18:48.921852+0000","last_peered":"2024-01-19T05:18:48.921852+0000","last_clean":"2024-01-19T05:18:48.921852+0000","last_became_active":"2024-01-19T05:18:47.353662+0000","last_became_peered":"2024-01-19T05:18:47.353662+0000","last_unstale":"2024-01-19T05:18:48.921852+0000","last_undegraded":"2024-01-19T05:18:48.921852+0000","last_fullsized":"2024-01-19T05:18:48.921852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T10:17:47.619046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.322970+0000","last_change":"2024-01-19T05:18:46.332678+0000","last_active":"2024-01-19T05:18:47.322970+0000","last_peered":"2024-01-19T05:18:47.322970+0000","last_clean":"2024-01-19T05:18:47.322970+0000","last_became_active":"2024-01-19T05:18:46.332373+0000","last_became_peered":"2024-01-19T05:18:46.332373+0000","last_unstale":"2024-01-19T05:18:47.322970+0000","last_undegraded":"2024-01-19T05:18:47.322970+0000","last_fullsized":"2024-01-19T05:18:47.322970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:47:57.794705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.340839+0000","last_change":"2024-01-19T05:18:47.360626+0000","last_active":"2024-01-19T05:18:48.340839+0000","last_peered":"2024-01-19T05:18:48.340839+0000","last_clean":"2024-01-19T05:18:48.340839+0000","last_became_active":"2024-01-19T05:18:47.353279+0000","last_became_peered":"2024-01-19T05:18:47.353279+0000","last_unstale":"2024-01-19T05:18:48.340839+0000","last_undegraded":"2024-01-19T05:18:48.340839+0000","last_fullsized":"2024-01-19T05:18:48.340839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:13:50.265741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.377106+0000","last_change":"2024-01-19T05:18:46.332860+0000","last_active":"2024-01-19T05:18:47.377106+0000","last_peered":"2024-01-19T05:18:47.377106+0000","last_clean":"2024-01-19T05:18:47.377106+0000","last_became_active":"2024-01-19T05:18:46.332174+0000","last_became_peered":"2024-01-19T05:18:46.332174+0000","last_unstale":"2024-01-19T05:18:47.377106+0000","last_undegraded":"2024-01-19T05:18:47.377106+0000","last_fullsized":"2024-01-19T05:18:47.377106+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:35:33.866174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.420468+0000","last_change":"2024-01-19T05:18:47.368208+0000","last_active":"2024-01-19T05:18:48.420468+0000","last_peered":"2024-01-19T05:18:48.420468+0000","last_clean":"2024-01-19T05:18:48.420468+0000","last_became_active":"2024-01-19T05:18:47.367284+0000","last_became_peered":"2024-01-19T05:18:47.367284+0000","last_unstale":"2024-01-19T05:18:48.420468+0000","last_undegraded":"2024-01-19T05:18:48.420468+0000","last_fullsized":"2024-01-19T05:18:48.420468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T15:01:29.882025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.348804+0000","last_change":"2024-01-19T05:18:46.333918+0000","last_active":"2024-01-19T05:18:47.348804+0000","last_peered":"2024-01-19T05:18:47.348804+0000","last_clean":"2024-01-19T05:18:47.348804+0000","last_became_active":"2024-01-19T05:18:46.333470+0000","last_became_peered":"2024-01-19T05:18:46.333470+0000","last_unstale":"2024-01-19T05:18:47.348804+0000","last_undegraded":"2024-01-19T05:18:47.348804+0000","last_fullsized":"2024-01-19T05:18:47.348804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:58:06.572037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.454583+0000","last_change":"2024-01-19T05:18:47.338955+0000","last_active":"2024-01-19T05:18:48.454583+0000","last_peered":"2024-01-19T05:18:48.454583+0000","last_clean":"2024-01-19T05:18:48.454583+0000","last_became_active":"2024-01-19T05:18:47.338202+0000","last_became_peered":"2024-01-19T05:18:47.338202+0000","last_unstale":"2024-01-19T05:18:48.454583+0000","last_undegraded":"2024-01-19T05:18:48.454583+0000","last_fullsized":"2024-01-19T05:18:48.454583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:46.289275+0000","last_clean_scrub_stamp":"2024-01-19T05:18:46.289275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T07:49:03.050028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.320939+0000","last_change":"2024-01-19T05:18:46.328546+0000","last_active":"2024-01-19T05:18:47.320939+0000","last_peered":"2024-01-19T05:18:47.320939+0000","last_clean":"2024-01-19T05:18:47.320939+0000","last_became_active":"2024-01-19T05:18:46.327801+0000","last_became_peered":"2024-01-19T05:18:46.327801+0000","last_unstale":"2024-01-19T05:18:47.320939+0000","last_undegraded":"2024-01-19T05:18:47.320939+0000","last_fullsized":"2024-01-19T05:18:47.320939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:18:45.286222+0000","last_clean_scrub_stamp":"2024-01-19T05:18:45.286222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T11:55:19.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-19T05:18:47.336732+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:47.336732+0000","last_peered":"2024-01-19T05:18:47.336732+0000","last_clean":"2024-01-19T05:18:47.336732+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:47.336732+0000","last_undegraded":"2024-01-19T05:18:47.336732+0000","last_fullsized":"2024-01-19T05:18:47.336732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335596,"statfs":{"total":96636764160,"available":96599650304,"internally_reserved":0,"allocated":921600,"data_stored":714446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":124058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":125622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":714356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:18:55.215 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-19T05:18:55.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-19T05:18:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e99b7640 1 Processor -- start 2024-01-19T05:18:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e99b7640 1 -- start start 2024-01-19T05:18:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e99b7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e40b5f90 0x7f14e4072000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e99b7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14e41404e0 0x7f14e4140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e99b7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e4071b70 con 0x7f14e406a6e0 2024-01-19T05:18:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e99b7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e40b6370 con 0x7f14e41404e0 2024-01-19T05:18:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e99b7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40afe90 con 0x7f14e40b5f90 2024-01-19T05:18:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e27fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14e41404e0 0x7f14e4140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e2ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e40b5f90 0x7f14e4072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e27fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14e41404e0 0x7f14e4140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:42804/0 (socket says 172.21.15.99:42804) 2024-01-19T05:18:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e27fc640 1 -- 172.21.15.99:0/3044556712 learned_addr learned my addr 172.21.15.99:0/3044556712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e37fe640 1 --1- 172.21.15.99:0/3044556712 >> v1:172.21.15.157:6789/0 conn(0x7f14e406a6e0 0x7f14e406ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:54882/0 (socket says 172.21.15.99:54882) 2024-01-19T05:18:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e27fc640 1 -- 172.21.15.99:0/3044556712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e40b5f90 msgr2=0x7f14e4072000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e27fc640 1 --2- 172.21.15.99:0/3044556712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e40b5f90 0x7f14e4072000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e27fc640 1 -- 172.21.15.99:0/3044556712 >> v1:172.21.15.157:6789/0 conn(0x7f14e406a6e0 legacy=0x7f14e406ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.384+0000 7f14e27fc640 1 -- 172.21.15.99:0/3044556712 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e40b0170 con 0x7f14e41404e0 2024-01-19T05:18:55.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e27fc640 1 --2- 172.21.15.99:0/3044556712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e41404e0 0x7f14e4140940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009870 tx=0x7f14dc01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982d057b86d42fd6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e1ffb640 1 -- 172.21.15.99:0/3044556712 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0aa430 con 0x7f14e41404e0 2024-01-19T05:18:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e1ffb640 1 -- 172.21.15.99:0/3044556712 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc0aa590 con 0x7f14e41404e0 2024-01-19T05:18:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e1ffb640 1 -- 172.21.15.99:0/3044556712 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0aa920 con 0x7f14e41404e0 2024-01-19T05:18:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- 172.21.15.99:0/3044556712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e41404e0 msgr2=0x7f14e4140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 --2- 172.21.15.99:0/3044556712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e41404e0 0x7f14e4140940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009870 tx=0x7f14dc01c4b0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- 172.21.15.99:0/3044556712 shutdown_connections 2024-01-19T05:18:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 --2- 172.21.15.99:0/3044556712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e41404e0 0x7f14e4140940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 --2- 172.21.15.99:0/3044556712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e40b5f90 0x7f14e4072000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- 172.21.15.99:0/3044556712 >> 172.21.15.99:0/3044556712 conn(0x7f14e40665c0 msgr2=0x7f14e40669d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- 172.21.15.99:0/3044556712 shutdown_connections 2024-01-19T05:18:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- 172.21.15.99:0/3044556712 wait complete. 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 Processor -- start 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- start start 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e406a6e0 0x7f14e413a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40b5f90 0x7f14e4142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e41404e0 0x7f14e41e2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e4138e10 con 0x7f14e41404e0 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e4142f50 con 0x7f14e40b5f90 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e99b7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e41e2ec0 con 0x7f14e406a6e0 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e41404e0 0x7f14e41e2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e41404e0 0x7f14e41e2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45164/0 (socket says 172.21.15.99:45164) 2024-01-19T05:18:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.388+0000 7f14e37fe640 1 -- 172.21.15.99:0/327365 learned_addr learned my addr 172.21.15.99:0/327365 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e2ffd640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e406a6e0 0x7f14e413a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e27fc640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40b5f90 0x7f14e4142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e37fe640 1 -- 172.21.15.99:0/327365 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e406a6e0 msgr2=0x7f14e413a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e37fe640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e406a6e0 0x7f14e413a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e37fe640 1 -- 172.21.15.99:0/327365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40b5f90 msgr2=0x7f14e4142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e37fe640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40b5f90 0x7f14e4142a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e37fe640 1 -- 172.21.15.99:0/327365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0094d0 con 0x7f14e41404e0 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e37fe640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e41404e0 0x7f14e41e2980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00c3c0 tx=0x7f14cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14dbfff640 1 -- 172.21.15.99:0/327365 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0074e0 con 0x7f14e41404e0 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14dbfff640 1 -- 172.21.15.99:0/327365 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc007640 con 0x7f14e41404e0 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e40b2450 con 0x7f14e41404e0 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14dbfff640 1 -- 172.21.15.99:0/327365 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc004a10 con 0x7f14e41404e0 2024-01-19T05:18:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e413a8b0 con 0x7f14e41404e0 2024-01-19T05:18:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e40696e0 con 0x7f14e41404e0 2024-01-19T05:18:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14dbfff640 1 -- 172.21.15.99:0/327365 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f14cc004b70 con 0x7f14e41404e0 2024-01-19T05:18:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14dbfff640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f14c4066500 0x7f14c40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14dbfff640 1 -- 172.21.15.99:0/327365 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14cc083770 con 0x7f14e41404e0 2024-01-19T05:18:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e2ffd640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f14c4066500 0x7f14c40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.392+0000 7f14e2ffd640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f14c4066500 0x7f14c40689c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f14e40b0e40 tx=0x7f14d400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.396+0000 7f14dbfff640 1 -- 172.21.15.99:0/327365 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f14cc050aa0 con 0x7f14e41404e0 2024-01-19T05:18:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.592+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f14e4140a90 con 0x7f14e41404e0 2024-01-19T05:18:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14dbfff640 1 -- 172.21.15.99:0/327365 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f14cc0540c0 con 0x7f14e41404e0 2024-01-19T05:18:55.595 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-01-19T05:18:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDTBaplWVQgJhAAFrZruGldx9x7uUC0VUJzcg== 2024-01-19T05:18:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-01-19T05:18:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-01-19T05:18:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-19T05:18:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f14c4066500 msgr2=0x7f14c40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f14c4066500 0x7f14c40689c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f14e40b0e40 tx=0x7f14d400b040 comp rx=0 tx=0).stop 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e41404e0 msgr2=0x7f14e41e2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e41404e0 0x7f14e41e2980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00c3c0 tx=0x7f14cc00c880 comp rx=0 tx=0).stop 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 shutdown_connections 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f14c4066500 0x7f14c40689c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e41404e0 0x7f14e41e2980 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40b5f90 0x7f14e4142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 --2- 172.21.15.99:0/327365 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e406a6e0 0x7f14e413a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 >> 172.21.15.99:0/327365 conn(0x7f14e40665c0 msgr2=0x7f14e40af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 shutdown_connections 2024-01-19T05:18:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.596+0000 7f14e99b7640 1 -- 172.21.15.99:0/327365 wait complete. 2024-01-19T05:18:55.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:18:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.732+0000 7fce0883f640 1 Processor -- start 2024-01-19T05:18:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.732+0000 7fce0883f640 1 -- start start 2024-01-19T05:18:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0883f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0883f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fce040b1120 0x7fce040b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0883f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0406ed10 con 0x7fce040b36f0 2024-01-19T05:18:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0883f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce040b22b0 con 0x7fce040b1120 2024-01-19T05:18:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0883f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce040b16d0 con 0x7fce040b3310 2024-01-19T05:18:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce02d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fce040b1120 0x7fce040b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0259c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fcdf9d9b640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fce040b36f0 0x7fce04146390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:54896/0 (socket says 172.21.15.99:54896) 2024-01-19T05:18:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fcdf9d9b640 1 -- 172.21.15.99:0/337913157 learned_addr learned my addr 172.21.15.99:0/337913157 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce02d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fce040b1120 0x7fce040b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:42828/0 (socket says 172.21.15.99:42828) 2024-01-19T05:18:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0259c640 1 -- 172.21.15.99:0/337913157 >> v2:172.21.15.157:3300/0 conn(0x7fce040b1120 msgr2=0x7fce040b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0259c640 1 --2- 172.21.15.99:0/337913157 >> v2:172.21.15.157:3300/0 conn(0x7fce040b1120 0x7fce040b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0259c640 1 -- 172.21.15.99:0/337913157 >> v1:172.21.15.157:6789/0 conn(0x7fce040b36f0 legacy=0x7fce04146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce0259c640 1 -- 172.21.15.99:0/337913157 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce040721c0 con 0x7fce040b3310 2024-01-19T05:18:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.736+0000 7fce02d9d640 1 --2- 172.21.15.99:0/337913157 >> v2:172.21.15.157:3300/0 conn(0x7fce040b1120 0x7fce040b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:18:55.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 --2- 172.21.15.99:0/337913157 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040b3df0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400ba60 tx=0x7fcdf401eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=943f2091a7ec422a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce01d9b640 1 -- 172.21.15.99:0/337913157 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40a7b30 con 0x7fce040b3310 2024-01-19T05:18:55.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce01d9b640 1 -- 172.21.15.99:0/337913157 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40a7c90 con 0x7fce040b3310 2024-01-19T05:18:55.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce01d9b640 1 -- 172.21.15.99:0/337913157 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40af440 con 0x7fce040b3310 2024-01-19T05:18:55.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- 172.21.15.99:0/337913157 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 msgr2=0x7fce040b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 --2- 172.21.15.99:0/337913157 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040b3df0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400ba60 tx=0x7fcdf401eac0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- 172.21.15.99:0/337913157 shutdown_connections 2024-01-19T05:18:55.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 --2- 172.21.15.99:0/337913157 >> v2:172.21.15.157:3300/0 conn(0x7fce040b1120 0x7fce040b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 --2- 172.21.15.99:0/337913157 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040b3df0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- 172.21.15.99:0/337913157 >> 172.21.15.99:0/337913157 conn(0x7fce040b8080 msgr2=0x7fce040b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:55.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- 172.21.15.99:0/337913157 shutdown_connections 2024-01-19T05:18:55.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- 172.21.15.99:0/337913157 wait complete. 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 Processor -- start 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- start start 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce040b1120 0x7fce04143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce040b36f0 0x7fce04136e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0413d520 con 0x7fce040b1120 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0406fa70 con 0x7fce040b36f0 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0883f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0414bbb0 con 0x7fce040b3310 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce040b1120 0x7fce04143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce040b1120 0x7fce04143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45172/0 (socket says 172.21.15.99:45172) 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 -- 172.21.15.99:0/3731995408 learned_addr learned my addr 172.21.15.99:0/3731995408 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fcdf9d9b640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce02d9d640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce040b36f0 0x7fce04136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 -- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 msgr2=0x7fce040701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 -- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce040b36f0 msgr2=0x7fce04136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce040b36f0 0x7fce04136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 -- 172.21.15.99:0/3731995408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc009a70 con 0x7fce040b1120 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce02d9d640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce040b36f0 0x7fce04136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.740+0000 7fce0259c640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce040b1120 0x7fce04143140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40b2040 tx=0x7fcdf401b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fcdfb7fe640 1 -- 172.21.15.99:0/3731995408 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40be070 con 0x7fce040b1120 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fcdfb7fe640 1 -- 172.21.15.99:0/3731995408 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40afb70 con 0x7fce040b1120 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf400b6c0 con 0x7fce040b1120 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fcdfb7fe640 1 -- 172.21.15.99:0/3731995408 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40afd20 con 0x7fce040b1120 2024-01-19T05:18:55.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce040ae780 con 0x7fce040b1120 2024-01-19T05:18:55.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce040696e0 con 0x7fce040b1120 2024-01-19T05:18:55.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fcdfb7fe640 1 -- 172.21.15.99:0/3731995408 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcdf40b6070 con 0x7fce040b1120 2024-01-19T05:18:55.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fcdfb7fe640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcde4066530 0x7fcde40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:55.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fcdfb7fe640 1 -- 172.21.15.99:0/3731995408 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf411ed80 con 0x7fce040b1120 2024-01-19T05:18:55.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fcdf9d9b640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcde4066530 0x7fcde40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:55.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.744+0000 7fcdf9d9b640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcde4066530 0x7fcde40689f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fce04143a10 tx=0x7fcdec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:55.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.748+0000 7fcdfb7fe640 1 -- 172.21.15.99:0/3731995408 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcdf40ec190 con 0x7fce040b1120 2024-01-19T05:18:55.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.924+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce0414be90 con 0x7fce040b1120 2024-01-19T05:18:55.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.924+0000 7fcdfb7fe640 1 -- 172.21.15.99:0/3731995408 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3353 (secure 0 0 0) 0x7fcdf40b4d30 con 0x7fce040b1120 2024-01-19T05:18:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:18:55.925 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/84065038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":84065038},{"type":"v1","addr":"172.21.15.157:6833","nonce":84065038}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:46.663899+0000","modified":"2024-01-19T05:18:48.672449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/3566081214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3566081214},{"type":"v1","addr":"172.21.15.99:6835","nonce":3566081214}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-19T05:18:55.925 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 13 2024-01-19T05:18:55.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcde4066530 msgr2=0x7fcde40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcde4066530 0x7fcde40689f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fce04143a10 tx=0x7fcdec009040 comp rx=0 tx=0).stop 2024-01-19T05:18:55.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce040b1120 msgr2=0x7fce04143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:55.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce040b1120 0x7fce04143140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40b2040 tx=0x7fcdf401b860 comp rx=0 tx=0).stop 2024-01-19T05:18:55.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 shutdown_connections 2024-01-19T05:18:55.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fcde4066530 0x7fcde40689f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce040b36f0 0x7fce04136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fce040b3310 0x7fce040701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 --2- 172.21.15.99:0/3731995408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce040b1120 0x7fce04143140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:55.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 >> 172.21.15.99:0/3731995408 conn(0x7fce040b8080 msgr2=0x7fce040b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:55.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 shutdown_connections 2024-01-19T05:18:55.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:55.928+0000 7fce0883f640 1 -- 172.21.15.99:0/3731995408 wait complete. 2024-01-19T05:18:56.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-19T05:18:46.663899+0000', 'modified': '2024-01-19T05:18:48.672449+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4977}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4977': {'gid': 4977, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6835/3566081214', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6834', 'nonce': 3566081214}, {'type': 'v1', 'addr': '172.21.15.99:6835', 'nonce': 3566081214}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-19T05:18:56.144 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-19T05:18:56.144 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-19T05:18:56.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.272+0000 7f15bf2d7640 1 Processor -- start 2024-01-19T05:18:56.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.272+0000 7f15bf2d7640 1 -- start start 2024-01-19T05:18:56.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bf2d7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f15b81441d0 0x7f15b814edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bf2d7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b806f620 con 0x7f15b80b1870 2024-01-19T05:18:56.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bf2d7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b8143610 con 0x7f15b80b2ce0 2024-01-19T05:18:56.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bf2d7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b8141000 con 0x7f15b81441d0 2024-01-19T05:18:56.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bc872640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f15b80b1870 0x7f15b8143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37638/0 (socket says 172.21.15.99:37638) 2024-01-19T05:18:56.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bc872640 1 -- 172.21.15.99:0/78809889 learned_addr learned my addr 172.21.15.99:0/78809889 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:56.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876874163 0 0) 0x7f15b806f620 con 0x7f15b80b1870 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a4005740 con 0x7f15b80b1870 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bd874640 1 --2- 172.21.15.99:0/78809889 >> v2:172.21.15.157:3300/0 conn(0x7f15b81441d0 0x7f15b814edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1099056641 0 0) 0x7f15a4005740 con 0x7f15b80b1870 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 >> v2:172.21.15.157:3300/0 conn(0x7f15b81441d0 msgr2=0x7f15b814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 --2- 172.21.15.99:0/78809889 >> v2:172.21.15.157:3300/0 conn(0x7f15b81441d0 0x7f15b814edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 >> v1:172.21.15.157:6789/0 conn(0x7f15b80b2ce0 legacy=0x7f15b8071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80b30c0 con 0x7f15b80b1870 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f15a80016a0 con 0x7f15b80b1870 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 >> v1:172.21.15.99:6789/0 conn(0x7f15b80b1870 legacy=0x7f15b8143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15a4005b90 0x7f15a4005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a40069e0 0x7f15a4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40073a0 0x7f15a400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8141000 con 0x7f15a40069e0 2024-01-19T05:18:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a400e2f0 con 0x7f15a40073a0 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a400e4b0 con 0x7f15a4005b90 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bc872640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a40069e0 0x7f15a4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bd874640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40073a0 0x7f15a400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bd073640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15a4005b90 0x7f15a4005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bc872640 1 -- 172.21.15.99:0/78809889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15a4005b90 msgr2=0x7f15a4005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bc872640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15a4005b90 0x7f15a4005fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bc872640 1 -- 172.21.15.99:0/78809889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40073a0 msgr2=0x7f15a400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bc872640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40073a0 0x7f15a400dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bd874640 1 -- 172.21.15.99:0/78809889 reap_dead start 2024-01-19T05:18:56.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.276+0000 7f15bc872640 1 -- 172.21.15.99:0/78809889 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4005740 con 0x7f15a40069e0 2024-01-19T05:18:56.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a40069e0 0x7f15a4006e60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15b806f7b0 tx=0x7f15a801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d207867c92b9b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8005ae0 con 0x7f15a40069e0 2024-01-19T05:18:56.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80ab070 con 0x7f15a40069e0 2024-01-19T05:18:56.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15affff640 1 -- 172.21.15.99:0/78809889 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8007070 con 0x7f15a40069e0 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- 172.21.15.99:0/78809889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a40069e0 msgr2=0x7f15a4006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a40069e0 0x7f15a4006e60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15b806f7b0 tx=0x7f15a801f370 comp rx=0 tx=0).stop 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- 172.21.15.99:0/78809889 shutdown_connections 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 --2- 172.21.15.99:0/78809889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a40069e0 0x7f15a4006e60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- 172.21.15.99:0/78809889 >> 172.21.15.99:0/78809889 conn(0x7f15b80b8080 msgr2=0x7f15b80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- 172.21.15.99:0/78809889 shutdown_connections 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- 172.21.15.99:0/78809889 wait complete. 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 Processor -- start 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- start start 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40069e0 0x7f15b80ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b8121390 0x7f15b811fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b81217f0 0x7f15b81201a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b80ada60 con 0x7f15b8121390 2024-01-19T05:18:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8123cd0 con 0x7f15a40069e0 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b81df9a0 con 0x7f15b81217f0 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b8121390 0x7f15b811fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b8121390 0x7f15b811fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45184/0 (socket says 172.21.15.99:45184) 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 -- 172.21.15.99:0/3751934442 learned_addr learned my addr 172.21.15.99:0/3751934442 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bd073640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40069e0 0x7f15b80ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 -- 172.21.15.99:0/3751934442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b81217f0 msgr2=0x7f15b81201a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b81217f0 0x7f15b81201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 -- 172.21.15.99:0/3751934442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40069e0 msgr2=0x7f15b80ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40069e0 0x7f15b80ad520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 -- 172.21.15.99:0/3751934442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b81dfc80 con 0x7f15b8121390 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bc872640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b8121390 0x7f15b811fc60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f15a801f1a0 tx=0x7f15a4007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15adffb640 1 -- 172.21.15.99:0/3751934442 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8004a70 con 0x7f15b8121390 2024-01-19T05:18:56.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15adffb640 1 -- 172.21.15.99:0/3751934442 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a8004bd0 con 0x7f15b8121390 2024-01-19T05:18:56.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- 172.21.15.99:0/3751934442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b81dff60 con 0x7f15b8121390 2024-01-19T05:18:56.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15adffb640 1 -- 172.21.15.99:0/3751934442 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8007070 con 0x7f15b8121390 2024-01-19T05:18:56.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.280+0000 7f15bf2d7640 1 -- 172.21.15.99:0/3751934442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b81e0480 con 0x7f15b8121390 2024-01-19T05:18:56.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15adffb640 1 -- 172.21.15.99:0/3751934442 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f15a80b9030 con 0x7f15b8121390 2024-01-19T05:18:56.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15adffb640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f159c066500 0x7f159c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15adffb640 1 -- 172.21.15.99:0/3751934442 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15a80b7070 con 0x7f15b8121390 2024-01-19T05:18:56.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bd073640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f159c066500 0x7f159c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bd073640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f159c066500 0x7f159c0689c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15b4007fd0 tx=0x7f15b4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15c2434000 1 Processor -- start 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15c2434000 1 -- start start 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15c2434000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 0x564ad0058bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15c2434000 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0059130 0x564ad005dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15c2434000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad005e1c0 0x564ad005e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15c2434000 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acfe89d70 con 0x564ad0059130 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15c2434000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acfe85ba0 con 0x564ad005e1c0 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15c2434000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x564acfe830d0 con 0x564ad0058810 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0059130 0x564ad005dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0059130 0x564ad005dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45194/0 (socket says 172.21.15.99:45194) 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 -- 172.21.15.99:0/2089568205 learned_addr learned my addr 172.21.15.99:0/2089568205 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bd073640 1 --2- 172.21.15.99:0/2089568205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 0x564ad0058bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 -- 172.21.15.99:0/2089568205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 msgr2=0x564ad0058bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 --2- 172.21.15.99:0/2089568205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 0x564ad0058bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 -- 172.21.15.99:0/2089568205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad005e1c0 msgr2=0x564ad005e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 --2- 172.21.15.99:0/2089568205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad005e1c0 0x564ad005e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 -- 172.21.15.99:0/2089568205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564acfb75890 con 0x564ad0059130 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15bc872640 1 --2- 172.21.15.99:0/2089568205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0059130 0x564ad005dc80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f15a811f330 tx=0x7f15a80f1720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd1da7db77a0ed3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15a2ffd640 1 -- 172.21.15.99:0/2089568205 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80efe00 con 0x564ad0059130 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15a2ffd640 1 -- 172.21.15.99:0/2089568205 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80f0060 con 0x564ad0059130 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.284+0000 7f15a2ffd640 1 -- 172.21.15.99:0/2089568205 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80ee3d0 con 0x564ad0059130 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- 172.21.15.99:0/2089568205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0059130 msgr2=0x564ad005dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 --2- 172.21.15.99:0/2089568205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0059130 0x564ad005dc80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f15a811f330 tx=0x7f15a80f1720 comp rx=0 tx=0).stop 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- 172.21.15.99:0/2089568205 shutdown_connections 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 --2- 172.21.15.99:0/2089568205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad005e1c0 0x564ad005e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 --2- 172.21.15.99:0/2089568205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0059130 0x564ad005dc80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 --2- 172.21.15.99:0/2089568205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 0x564ad0058bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- 172.21.15.99:0/2089568205 >> 172.21.15.99:0/2089568205 conn(0x564ad0059a30 msgr2=0x564ad005be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- 172.21.15.99:0/2089568205 shutdown_connections 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- 172.21.15.99:0/2089568205 wait complete. 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- start start 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 Processor -- start 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0033970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0063d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 0x564ad00642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acfe7e9c0 con 0x564ad0058810 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acfe36040 con 0x564ad0059130 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x564acfe3bee0 con 0x564ad005e1c0 2024-01-19T05:18:56.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 10 client.0 _ll_register_callbacks cb 0x564acfe391b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0033970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0033970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45198/0 (socket says 172.21.15.99:45198) 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 -- 172.21.15.99:0/973760161 learned_addr learned my addr 172.21.15.99:0/973760161 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bc872640 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0063d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd874640 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 0x564ad00642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 -- 172.21.15.99:0/973760161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 msgr2=0x564ad00642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 0x564ad00642b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 -- 172.21.15.99:0/973760161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 msgr2=0x564ad0063d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0063d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 -- 172.21.15.99:0/973760161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b81e0480 con 0x564ad0058810 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bd073640 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0033970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f15b40143f0 tx=0x7f15b40011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7223e22b5d0fe5 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-19T05:18:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 1 -- 172.21.15.99:0/973760161 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400c050 con 0x564ad0058810 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 1 -- 172.21.15.99:0/973760161 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15b4022b30 con 0x564ad0058810 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- 172.21.15.99:0/973760161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564acfe04e30 con 0x564ad0058810 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 1 -- 172.21.15.99:0/973760161 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15b4022cf0 con 0x564ad0058810 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 10 client.5169 fetch_fsmap learned FSMap version 13 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- 172.21.15.99:0/973760161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x564acfe3e5e0 con 0x564ad0058810 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 1 -- 172.21.15.99:0/973760161 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564acfe04e30 con 0x564ad0058810 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 1 -- 172.21.15.99:0/973760161 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 13) v1 ==== 2144+0+0 (secure 0 0 0) 0x7f15b4005110 con 0x564ad0058810 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 10 client.5169 fetch_fsmap finished waiting for FSMap version 13 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 10 client.5169 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 20 client.5169 populate_metadata read hostname 'smithi099' 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] conn(0x564ad0033eb0 0x564ad0064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 4 client.5169 mds_command: new command op to 4977 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 -- 172.21.15.99:0/973760161 --> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564acfe3b870 con 0x564ad0033eb0 2024-01-19T05:18:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bc872640 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] conn(0x564ad0033eb0 0x564ad0064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 10 client.5169 ms_handle_connect on v2:172.21.15.99:6834/3566081214 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15bc872640 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] conn(0x564ad0033eb0 0x564ad0064cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c22570c3480e0c server_cookie=9cf47a4cf9432dcc in_seq=0 out_seq=0 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 1 -- 172.21.15.99:0/973760161 <== mds.0 v2:172.21.15.99:6834/3566081214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564acfe3b870 con 0x564ad0033eb0 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f1597fff640 10 client.5169 handle_command_reply: tid=0 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.288+0000 7f15c2434000 1 client.5169 shutdown 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 -- 172.21.15.99:0/973760161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 msgr2=0x564ad0033970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0033970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f15b40143f0 tx=0x7f15b40011a0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 -- 172.21.15.99:0/973760161 shutdown_connections 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] conn(0x564ad0033eb0 0x564ad0064cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 0x564ad00642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0063d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 --2- 172.21.15.99:0/973760161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0033970 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f1597fff640 0 client.5169 ms_handle_reset on v2:172.21.15.99:6834/3566081214 2024-01-19T05:18:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 -- 172.21.15.99:0/973760161 >> 172.21.15.99:0/973760161 conn(0x564ad0059a30 msgr2=0x564ad005be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:56.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 -- 172.21.15.99:0/973760161 shutdown_connections 2024-01-19T05:18:56.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 1 -- 172.21.15.99:0/973760161 wait complete. 2024-01-19T05:18:56.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.292+0000 7f15c2434000 20 client.5169 trim_cache size 0 max 16384 2024-01-19T05:18:56.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.304+0000 7f15c2434000 1 Processor -- start 2024-01-19T05:18:56.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.304+0000 7f15c2434000 1 -- start start 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0063b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0064090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 0x564ad005ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acfb36940 con 0x564ad0058810 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acfe81520 con 0x564ad0059130 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x564acfe865f0 con 0x564ad005e1c0 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0063b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0063b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45200/0 (socket says 172.21.15.99:45200) 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 -- 172.21.15.99:0/3563664292 learned_addr learned my addr 172.21.15.99:0/3563664292 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 -- 172.21.15.99:0/3563664292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 msgr2=0x564ad005ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 --2- 172.21.15.99:0/3563664292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 0x564ad005ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 -- 172.21.15.99:0/3563664292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 msgr2=0x564ad0064090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 --2- 172.21.15.99:0/3563664292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0064090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 -- 172.21.15.99:0/3563664292 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564acfe248e0 con 0x564ad0058810 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd073640 1 --2- 172.21.15.99:0/3563664292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0063b50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f15b4001060 tx=0x7f15b401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3292bc8534e3449e server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15a27fc640 1 -- 172.21.15.99:0/3563664292 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400c070 con 0x564ad0058810 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15a27fc640 1 -- 172.21.15.99:0/3563664292 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400d040 con 0x564ad0058810 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15a27fc640 1 -- 172.21.15.99:0/3563664292 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4005110 con 0x564ad0058810 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- 172.21.15.99:0/3563664292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 msgr2=0x564ad0063b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- 172.21.15.99:0/3563664292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0063b50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f15b4001060 tx=0x7f15b401f000 comp rx=0 tx=0).stop 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- 172.21.15.99:0/3563664292 shutdown_connections 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- 172.21.15.99:0/3563664292 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad005e1c0 0x564ad005ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- 172.21.15.99:0/3563664292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0064090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- 172.21.15.99:0/3563664292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad0058810 0x564ad0063b50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- 172.21.15.99:0/3563664292 >> 172.21.15.99:0/3563664292 conn(0x564ad0059a30 msgr2=0x564ad00335e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:56.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- 172.21.15.99:0/3563664292 shutdown_connections 2024-01-19T05:18:56.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- 172.21.15.99:0/3563664292 wait complete. 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- start start 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 Processor -- start 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 0x564ad0061b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0062070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad005e1c0 0x564ad00625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acfe7d850 con 0x564ad005e1c0 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acfe873f0 con 0x564ad0059130 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x564acfe7a330 con 0x564ad0058810 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 10 client.0 _ll_register_callbacks cb 0x564acfe78130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad005e1c0 0x564ad00625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad005e1c0 0x564ad00625b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45204/0 (socket says 172.21.15.99:45204) 2024-01-19T05:18:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 -- 172.21.15.99:0/2638697297 learned_addr learned my addr 172.21.15.99:0/2638697297 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 -- 172.21.15.99:0/2638697297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 msgr2=0x564ad0061b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 0x564ad0061b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 -- 172.21.15.99:0/2638697297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 msgr2=0x564ad0062070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0062070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 -- 172.21.15.99:0/2638697297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564acfe3e5e0 con 0x564ad005e1c0 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15bd874640 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad005e1c0 0x564ad00625b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f15b80af210 tx=0x7f15b00099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1406fd3b5dd573c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f1597fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f1597fff640 1 -- 172.21.15.99:0/2638697297 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0007800 con 0x564ad005e1c0 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f1597fff640 1 -- 172.21.15.99:0/2638697297 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15b0007960 con 0x564ad005e1c0 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- 172.21.15.99:0/2638697297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ad002bbf0 con 0x564ad005e1c0 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f1597fff640 1 -- 172.21.15.99:0/2638697297 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15b0007b60 con 0x564ad005e1c0 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 10 client.5175 fetch_fsmap learned FSMap version 13 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.308+0000 7f15c2434000 1 -- 172.21.15.99:0/2638697297 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x564acfb75cc0 con 0x564ad005e1c0 2024-01-19T05:18:56.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f1597fff640 1 -- 172.21.15.99:0/2638697297 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564ad002bbf0 con 0x564ad005e1c0 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f1597fff640 1 -- 172.21.15.99:0/2638697297 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 13) v1 ==== 2144+0+0 (secure 0 0 0) 0x7f15b0014cd0 con 0x564ad005e1c0 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 10 client.5175 fetch_fsmap finished waiting for FSMap version 13 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 10 client.5175 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 20 client.5175 populate_metadata read hostname 'smithi099' 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] conn(0x564ad00d1640 0x564ad00d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 4 client.5175 mds_command: new command op to 4977 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 -- 172.21.15.99:0/2638697297 --> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564acfe304f0 con 0x564ad00d1640 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bd073640 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] conn(0x564ad00d1640 0x564ad00d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bd073640 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] conn(0x564ad00d1640 0x564ad00d3a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f0c750c5980a335 server_cookie=238dd9725d46d8b8 in_seq=0 out_seq=0 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f1597fff640 10 client.5175 ms_handle_connect on v2:172.21.15.99:6834/3566081214 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f1597fff640 1 -- 172.21.15.99:0/2638697297 <== mds.0 v2:172.21.15.99:6834/3566081214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564acfe304f0 con 0x564ad00d1640 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f1597fff640 10 client.5175 handle_command_reply: tid=0 2024-01-19T05:18:56.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 client.5175 shutdown 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 -- 172.21.15.99:0/2638697297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad005e1c0 msgr2=0x564ad00625b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad005e1c0 0x564ad00625b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f15b80af210 tx=0x7f15b00099e0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 -- 172.21.15.99:0/2638697297 shutdown_connections 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.99:6834/3566081214,v1:172.21.15.99:6835/3566081214] conn(0x564ad00d1640 0x564ad00d3a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564ad005e1c0 0x564ad00625b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ad0059130 0x564ad0062070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 --2- 172.21.15.99:0/2638697297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x564ad0058810 0x564ad0061b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 -- 172.21.15.99:0/2638697297 >> 172.21.15.99:0/2638697297 conn(0x564ad0059a30 msgr2=0x564ad0065550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f1597fff640 0 client.5175 ms_handle_reset on v2:172.21.15.99:6834/3566081214 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 -- 172.21.15.99:0/2638697297 shutdown_connections 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 1 -- 172.21.15.99:0/2638697297 wait complete. 2024-01-19T05:18:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15c2434000 20 client.5175 trim_cache size 0 max 16384 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "7f059d9d-1406-48ae-9584-fdafb673a966", 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4977, 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 8.9825003240000001, 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 13, 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 29, 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 29, 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 16.014603488999999 2024-01-19T05:18:56.318 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:18:56.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 -- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f159c066500 msgr2=0x7f159c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f159c066500 0x7f159c0689c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15b4007fd0 tx=0x7f15b4009040 comp rx=0 tx=0).stop 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 -- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b8121390 msgr2=0x7f15b811fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b8121390 0x7f15b811fc60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f15a801f1a0 tx=0x7f15a4007a10 comp rx=0 tx=0).stop 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 -- 172.21.15.99:0/3751934442 shutdown_connections 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f159c066500 0x7f159c0689c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b81217f0 0x7f15b81201a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15b8121390 0x7f15b811fc60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 --2- 172.21.15.99:0/3751934442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a40069e0 0x7f15b80ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 -- 172.21.15.99:0/3751934442 >> 172.21.15.99:0/3751934442 conn(0x7f15b80b8080 msgr2=0x7f15b8141500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 -- 172.21.15.99:0/3751934442 shutdown_connections 2024-01-19T05:18:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.312+0000 7f15bf2d7640 1 -- 172.21.15.99:0/3751934442 wait complete. 2024-01-19T05:18:56.327 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-19T05:18:56.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37cdb77640 1 Processor -- start 2024-01-19T05:18:56.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37cdb77640 1 -- start start 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37cdb77640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f37c8150090 0x7f37c8152480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37cdb77640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c80ae1a0 con 0x7f37c80acad0 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37cdb77640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c80aceb0 con 0x7f37c80725b0 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37cdb77640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c8141020 con 0x7f37c8150090 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37c7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f37c8150090 0x7f37c8152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37c77fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f37c80acad0 0x7f37c80b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37654/0 (socket says 172.21.15.99:37654) 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37c77fe640 1 -- 172.21.15.99:0/2129960733 learned_addr learned my addr 172.21.15.99:0/2129960733 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37c7fff640 1 -- 172.21.15.99:0/2129960733 >> v1:172.21.15.157:6789/0 conn(0x7f37c80725b0 legacy=0x7f37c8146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37c7fff640 1 -- 172.21.15.99:0/2129960733 >> v1:172.21.15.99:6789/0 conn(0x7f37c80acad0 legacy=0x7f37c80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.428+0000 7f37c7fff640 1 -- 172.21.15.99:0/2129960733 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c80aefc0 con 0x7f37c8150090 2024-01-19T05:18:56.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37c7fff640 1 --2- 172.21.15.99:0/2129960733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c8150090 0x7f37c8152480 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009d90 tx=0x7f37c001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c57b3e632c781 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37c67fc640 1 -- 172.21.15.99:0/2129960733 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c00a59a0 con 0x7f37c8150090 2024-01-19T05:18:56.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37c67fc640 1 -- 172.21.15.99:0/2129960733 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c00a5b00 con 0x7f37c8150090 2024-01-19T05:18:56.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37c67fc640 1 -- 172.21.15.99:0/2129960733 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c00a5e90 con 0x7f37c8150090 2024-01-19T05:18:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 -- 172.21.15.99:0/2129960733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c8150090 msgr2=0x7f37c8152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 --2- 172.21.15.99:0/2129960733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c8150090 0x7f37c8152480 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009d90 tx=0x7f37c001c8e0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 -- 172.21.15.99:0/2129960733 shutdown_connections 2024-01-19T05:18:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 --2- 172.21.15.99:0/2129960733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c8150090 0x7f37c8152480 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 -- 172.21.15.99:0/2129960733 >> 172.21.15.99:0/2129960733 conn(0x7f37c80b8080 msgr2=0x7f37c80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 -- 172.21.15.99:0/2129960733 shutdown_connections 2024-01-19T05:18:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 -- 172.21.15.99:0/2129960733 wait complete. 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 Processor -- start 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.432+0000 7f37cdb77640 1 -- start start 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c80acad0 0x7f37c8139730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c8150090 0x7f37c806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c81e2460 0x7f37c81e28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c806fc80 con 0x7f37c81e2460 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8070230 con 0x7f37c8150090 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80716a0 con 0x7f37c80acad0 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c81e2460 0x7f37c81e28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c81e2460 0x7f37c81e28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45226/0 (socket says 172.21.15.99:45226) 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 -- 172.21.15.99:0/736070716 learned_addr learned my addr 172.21.15.99:0/736070716 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 -- 172.21.15.99:0/736070716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c80acad0 msgr2=0x7f37c8139730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c80acad0 0x7f37c8139730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 -- 172.21.15.99:0/736070716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c8150090 msgr2=0x7f37c806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c8150090 0x7f37c806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 -- 172.21.15.99:0/736070716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c0009a70 con 0x7f37c81e2460 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c7fff640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c81e2460 0x7f37c81e28d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f37c001a510 tx=0x7f37c0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37affff640 1 -- 172.21.15.99:0/736070716 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c00addc0 con 0x7f37c81e2460 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37affff640 1 -- 172.21.15.99:0/736070716 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c00b9450 con 0x7f37c81e2460 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c8071980 con 0x7f37c81e2460 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37affff640 1 -- 172.21.15.99:0/736070716 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c00b97e0 con 0x7f37c81e2460 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c813b5a0 con 0x7f37c81e2460 2024-01-19T05:18:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c806adb0 con 0x7f37c81e2460 2024-01-19T05:18:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37affff640 1 -- 172.21.15.99:0/736070716 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f37c00b9940 con 0x7f37c81e2460 2024-01-19T05:18:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37affff640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f37b4066530 0x7f37b40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37affff640 1 -- 172.21.15.99:0/736070716 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37c011fb10 con 0x7f37c81e2460 2024-01-19T05:18:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c77fe640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f37b4066530 0x7f37b40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.436+0000 7f37c77fe640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f37b4066530 0x7f37b40689f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37bc000f70 tx=0x7f37bc007a90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:56.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.440+0000 7f37affff640 1 -- 172.21.15.99:0/736070716 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f37c00ecf20 con 0x7f37c81e2460 2024-01-19T05:18:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37c8070370 con 0x7f37c81e2460 2024-01-19T05:18:56.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37affff640 1 -- 172.21.15.99:0/736070716 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f37c00b2070 con 0x7f37c81e2460 2024-01-19T05:18:56.635 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-19T05:18:56.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f37b4066530 msgr2=0x7f37b40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f37b4066530 0x7f37b40689f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37bc000f70 tx=0x7f37bc007a90 comp rx=0 tx=0).stop 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c81e2460 msgr2=0x7f37c81e28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c81e2460 0x7f37c81e28d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f37c001a510 tx=0x7f37c0019680 comp rx=0 tx=0).stop 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 shutdown_connections 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f37b4066530 0x7f37b40689f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37c81e2460 0x7f37c81e28d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c8150090 0x7f37c806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 --2- 172.21.15.99:0/736070716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c80acad0 0x7f37c8139730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 >> 172.21.15.99:0/736070716 conn(0x7f37c80b8080 msgr2=0x7f37c80b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 shutdown_connections 2024-01-19T05:18:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:56.636+0000 7f37cdb77640 1 -- 172.21.15.99:0/736070716 wait complete. 2024-01-19T05:18:56.653 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-19T05:18:56.653 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-19T05:18:56.654 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-01-19T05:18:56.654 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-19T05:18:56.654 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:56.654 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-19T05:18:56.654 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-19T05:18:56.654 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-19T05:18:56.655 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T05:18:56.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:56.655 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T05:18:56.662 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42493sec preferred_lft 42493sec 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-19T05:18:56.663 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 02:42:63:a0:fe:6e brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-19T05:18:56.664 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-19T05:18:56.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:56.665 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-19T05:18:56.715 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-01-19T05:18:56.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:56.716 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-01-19T05:18:56.765 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-01-19T05:18:56.765 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-19T05:18:56.765 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-19T05:18:56.765 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-19T05:18:56.765 INFO:teuthology.orchestra.run.smithi099.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-19T05:18:56.765 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-19T05:18:56.765 INFO:teuthology.orchestra.run.smithi099.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T05:18:56.766 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T05:18:56.766 INFO:teuthology.orchestra.run.smithi099.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-19T05:18:56.766 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-19T05:18:56.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:56.766 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-19T05:18:56.766 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-19T05:18:56.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-19T05:18:56.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-19T05:18:56.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-19T05:18:56.767 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-19T05:18:56.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:56.967 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-01-19T05:18:56.973 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T05:18:56.974 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-19T05:18:56.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:56.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-01-19T05:18:57.028 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-01-19T05:18:57.028 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T05:18:57.028 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:57.075 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-19T05:18:57.076 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-19T05:18:57.076 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:57.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-01-19T05:18:57.180 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T05:18:57.228 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-01-19T05:18:57.228 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-01-19T05:18:57.228 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-01-19T05:18:57.228 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-01-19T05:18:57.228 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-01-19T05:18:57.228 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-01-19T05:18:57.228 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/run/lock 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/bpf 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/fs/nfsd 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-01-19T05:18:57.229 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/run/rpc_pipefs 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:57.230 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:57.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:57.231 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-01-19T05:18:57.279 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-19T05:18:57.279 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-19T05:18:57.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-01-19T05:18:57.338 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T05:18:57.387 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-01-19T05:18:57.387 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-01-19T05:18:57.387 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-01-19T05:18:57.387 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-01-19T05:18:57.387 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/run/lock 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/bpf 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/fs/nfsd 2024-01-19T05:18:57.388 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/run/rpc_pipefs 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:57.389 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:57.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:57.390 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-01-19T05:18:57.398 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:2024-01-19T05:18:57.396+0000 7f6b8ce83580 -1 init, newargv = 0x55a89593ab80 newargc=15 2024-01-19T05:18:57.398 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[37194]: starting ceph client 2024-01-19T05:18:57.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[37194]: starting fuse 2024-01-19T05:18:58.503 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-01-19T05:18:58.520 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-01-19T05:18:58.569 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/run/lock 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/bpf 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-01-19T05:18:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/fs/nfsd 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysusers.service 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/run/rpc_pipefs 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-0 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-1 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-2 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-3 2024-01-19T05:18:58.571 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-01-19T05:18:58.572 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:58.572 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:18:58.572 INFO:teuthology.orchestra.run.smithi099.stdout:/home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:58.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:58.573 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-01-19T05:18:58.619 INFO:teuthology.orchestra.run.smithi099.stdout:45 2024-01-19T05:18:58.619 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> sudo stdin-killer -- python3 -c ' 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> import re 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2024-01-19T05:18:58.620 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> return f 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.0")) 2024-01-19T05:18:58.621 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-01-19T05:18:58.745 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.0.37194.asok 2024-01-19T05:18:58.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-19T05:18:58.756 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37194.asok 2024-01-19T05:18:58.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:58.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37194.asok status 2024-01-19T05:18:58.908 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:18:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2024-01-19T05:18:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "0edf41a622739843d6b978b179ff3227b476dd9d", 2024-01-19T05:18:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 19.0.0-766-g0edf41a6 (0edf41a622739843d6b978b179ff3227b476dd9d) squid (dev)", 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "0", 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "37194", 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2024-01-19T05:18:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5193, 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 5193 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1165596248 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-01-19T05:18:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1165596248 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.5193 192.168.0.1:0/1165596248", 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "192.168.0.1:0/1165596248", 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 13, 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 29, 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2024-01-19T05:18:58.911 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:18:58.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:58.923 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2024-01-19T05:18:58.923 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:58.929 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2024-01-19T05:18:58.929 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:58.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:58.930 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-19T05:18:58.983 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-01-19T05:18:59.030 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.C5DNEm7JSD 2024-01-19T05:18:59.030 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:18:59.031 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/tmp/tmp.C5DNEm7JSD 2024-01-19T05:18:59.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:59.079 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mkdir -p dir1/dir2/dir3') 2024-01-19T05:18:59.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:18:59.200 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'chmod 755 /tmp/test-cephfs23h9w1gt') 2024-01-19T05:18:59.209 INFO:tasks.cephfs.test_cephfs_shell:Running script "/tmp/test-cephfs23h9w1gt" 2024-01-19T05:18:59.209 DEBUG:teuthology.orchestra.run.smithi099:> cephfs-shell -b /tmp/test-cephfs23h9w1gt 2024-01-19T05:18:59.569 INFO:teuthology.orchestra.run.smithi099.stderr:Unrecognized command 2024-01-19T05:18:59.599 DEBUG:teuthology.orchestra.run:got remote process result: 127 2024-01-19T05:18:59.599 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-19T05:18:59.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T05:18:59.652 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-19T05:18:59.714 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-19T05:18:59.714 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:18:59.714 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T05:18:59.720 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:18:59.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.888+0000 7f6f699f4640 1 Processor -- start 2024-01-19T05:18:59.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.888+0000 7f6f699f4640 1 -- start start 2024-01-19T05:18:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f640b19f0 0x7f6f6406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f640724f0 0x7f6f64145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f64070680 con 0x7f6f64144c70 2024-01-19T05:18:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f64070410 con 0x7f6f640b19f0 2024-01-19T05:18:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f64144790 con 0x7f6f640724f0 2024-01-19T05:18:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f62ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f640b19f0 0x7f6f6406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f62ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f640b19f0 0x7f6f6406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45262/0 (socket says 172.21.15.99:45262) 2024-01-19T05:18:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f62ffd640 1 -- 172.21.15.99:0/2471492998 learned_addr learned my addr 172.21.15.99:0/2471492998 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f62ffd640 1 -- 172.21.15.99:0/2471492998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f640724f0 msgr2=0x7f6f64145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f637fe640 1 --2- 172.21.15.99:0/2471492998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f640724f0 0x7f6f64145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f62ffd640 1 --2- 172.21.15.99:0/2471492998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f640724f0 0x7f6f64145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f62ffd640 1 -- 172.21.15.99:0/2471492998 >> v1:172.21.15.157:6789/0 conn(0x7f6f64144c70 legacy=0x7f6f64071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:18:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f62ffd640 1 -- 172.21.15.99:0/2471492998 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6406f2b0 con 0x7f6f640b19f0 2024-01-19T05:18:59.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f62ffd640 1 --2- 172.21.15.99:0/2471492998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640b19f0 0x7f6f6406ebe0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009e50 tx=0x7f6f5c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc9e8f522967deb server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:59.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f61ffb640 1 -- 172.21.15.99:0/2471492998 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0a57a0 con 0x7f6f640b19f0 2024-01-19T05:18:59.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f61ffb640 1 -- 172.21.15.99:0/2471492998 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0a5900 con 0x7f6f640b19f0 2024-01-19T05:18:59.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f61ffb640 1 -- 172.21.15.99:0/2471492998 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0a5c90 con 0x7f6f640b19f0 2024-01-19T05:18:59.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 -- 172.21.15.99:0/2471492998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640b19f0 msgr2=0x7f6f6406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:59.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 --2- 172.21.15.99:0/2471492998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640b19f0 0x7f6f6406ebe0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009e50 tx=0x7f6f5c01c940 comp rx=0 tx=0).stop 2024-01-19T05:18:59.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 -- 172.21.15.99:0/2471492998 shutdown_connections 2024-01-19T05:18:59.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 --2- 172.21.15.99:0/2471492998 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f640724f0 0x7f6f64145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:59.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 --2- 172.21.15.99:0/2471492998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640b19f0 0x7f6f6406ebe0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:59.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 -- 172.21.15.99:0/2471492998 >> 172.21.15.99:0/2471492998 conn(0x7f6f640b8080 msgr2=0x7f6f640b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:18:59.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 -- 172.21.15.99:0/2471492998 shutdown_connections 2024-01-19T05:18:59.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.892+0000 7f6f699f4640 1 -- 172.21.15.99:0/2471492998 wait complete. 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 Processor -- start 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 -- start start 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640724f0 0x7f6f6413bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f640b19f0 0x7f6f641e2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f64144c70 0x7f6f641e27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f64137240 con 0x7f6f640724f0 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6413d6a0 con 0x7f6f640b19f0 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641df100 con 0x7f6f64144c70 2024-01-19T05:18:59.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640724f0 0x7f6f6413bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640724f0 0x7f6f6413bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45276/0 (socket says 172.21.15.99:45276) 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 -- 172.21.15.99:0/1496604808 learned_addr learned my addr 172.21.15.99:0/1496604808 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f637fe640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f64144c70 0x7f6f641e27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f627fc640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f640b19f0 0x7f6f641e2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 -- 172.21.15.99:0/1496604808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f64144c70 msgr2=0x7f6f641e27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f64144c70 0x7f6f641e27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 -- 172.21.15.99:0/1496604808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f640b19f0 msgr2=0x7f6f641e2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f640b19f0 0x7f6f641e2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 -- 172.21.15.99:0/1496604808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c009b30 con 0x7f6f640724f0 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f62ffd640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640724f0 0x7f6f6413bff0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c01d1e0 tx=0x7f6f5c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f5bfff640 1 -- 172.21.15.99:0/1496604808 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0b8880 con 0x7f6f640724f0 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f5bfff640 1 -- 172.21.15.99:0/1496604808 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0b89e0 con 0x7f6f640724f0 2024-01-19T05:18:59.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f641df3e0 con 0x7f6f640724f0 2024-01-19T05:18:59.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f5bfff640 1 -- 172.21.15.99:0/1496604808 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0b8d90 con 0x7f6f640724f0 2024-01-19T05:18:59.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6413d980 con 0x7f6f640724f0 2024-01-19T05:18:59.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f640ae530 con 0x7f6f640724f0 2024-01-19T05:18:59.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.896+0000 7f6f5bfff640 1 -- 172.21.15.99:0/1496604808 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6f5c0b6440 con 0x7f6f640724f0 2024-01-19T05:18:59.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.900+0000 7f6f5bfff640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f48066500 0x7f6f480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:18:59.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.900+0000 7f6f5bfff640 1 -- 172.21.15.99:0/1496604808 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f5c11f420 con 0x7f6f640724f0 2024-01-19T05:18:59.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.900+0000 7f6f627fc640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f48066500 0x7f6f480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:18:59.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.900+0000 7f6f627fc640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f48066500 0x7f6f480689c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6f640afea0 tx=0x7f6f4c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:18:59.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:18:59.904+0000 7f6f5bfff640 1 -- 172.21.15.99:0/1496604808 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6f5c0ec810 con 0x7f6f640724f0 2024-01-19T05:19:00.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.060+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f6406a870 con 0x7f6f640724f0 2024-01-19T05:19:00.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.060+0000 7f6f5bfff640 1 -- 172.21.15.99:0/1496604808 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f6f5c0efe30 con 0x7f6f640724f0 2024-01-19T05:19:00.062 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:00.062 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:48.330234+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:44.862843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:45.655715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:19:00.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f48066500 msgr2=0x7f6f480689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f48066500 0x7f6f480689c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6f640afea0 tx=0x7f6f4c009040 comp rx=0 tx=0).stop 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640724f0 msgr2=0x7f6f6413bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640724f0 0x7f6f6413bff0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c01d1e0 tx=0x7f6f5c0196e0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 shutdown_connections 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f48066500 0x7f6f480689c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f64144c70 0x7f6f641e27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f640b19f0 0x7f6f641e2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 --2- 172.21.15.99:0/1496604808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f640724f0 0x7f6f6413bff0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 >> 172.21.15.99:0/1496604808 conn(0x7f6f640b8080 msgr2=0x7f6f6413a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 shutdown_connections 2024-01-19T05:19:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.064+0000 7f6f699f4640 1 -- 172.21.15.99:0/1496604808 wait complete. 2024-01-19T05:19:00.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:44.862843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:45.655715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:19:00.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:19:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c3b358640 1 Processor -- start 2024-01-19T05:19:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c3b358640 1 -- start start 2024-01-19T05:19:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c3b358640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 0x7f1c34071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c3b358640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3406f620 con 0x7f1c341441d0 2024-01-19T05:19:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c3b358640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c34143610 con 0x7f1c340b1870 2024-01-19T05:19:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c3b358640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34141000 con 0x7f1c340b2ce0 2024-01-19T05:19:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c398f5640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1c341441d0 0x7f1c3414dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37662/0 (socket says 172.21.15.99:37662) 2024-01-19T05:19:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c398f5640 1 -- 172.21.15.99:0/4087579104 learned_addr learned my addr 172.21.15.99:0/4087579104 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c390f4640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 0x7f1c34071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310942024 0 0) 0x7f1c3406f620 con 0x7f1c341441d0 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c1c005740 con 0x7f1c341441d0 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 475577906 0 0) 0x7f1c1c005740 con 0x7f1c341441d0 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 msgr2=0x7f1c34071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 0x7f1c34071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 >> v1:172.21.15.157:6789/0 conn(0x7f1c340b1870 legacy=0x7f1c34143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340b30c0 con 0x7f1c341441d0 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f1c24001680 con 0x7f1c341441d0 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 >> v1:172.21.15.99:6789/0 conn(0x7f1c341441d0 legacy=0x7f1c3414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 0x7f1c1c005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c1c006140 0x7f1c1c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1c006f20 0x7f1c1c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34141000 con 0x7f1c1c006f20 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c00dc80 con 0x7f1c1c006140 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.200+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c00de40 con 0x7f1c340b2ce0 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c398f5640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1c006f20 0x7f1c1c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c390f4640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 0x7f1c1c005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c388f3640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c1c006140 0x7f1c1c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c398f5640 1 -- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 msgr2=0x7f1c1c005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c398f5640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 0x7f1c1c005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c398f5640 1 -- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c1c006140 msgr2=0x7f1c1c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c398f5640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c1c006140 0x7f1c1c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c398f5640 1 -- 172.21.15.99:0/4087579104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c005740 con 0x7f1c1c006f20 2024-01-19T05:19:00.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c390f4640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c340b2ce0 0x7f1c1c005bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:19:00.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c398f5640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1c006f20 0x7f1c1c0073a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c210 tx=0x7f1c2401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61778ef2dab715d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240a5b20 con 0x7f1c1c006f20 2024-01-19T05:19:00.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c240a5ca0 con 0x7f1c1c006f20 2024-01-19T05:19:00.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c33fff640 1 -- 172.21.15.99:0/4087579104 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24005b20 con 0x7f1c1c006f20 2024-01-19T05:19:00.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c3b358640 1 -- 172.21.15.99:0/4087579104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1c006f20 msgr2=0x7f1c1c0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c3b358640 1 --2- 172.21.15.99:0/4087579104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c1c006f20 0x7f1c1c0073a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c210 tx=0x7f1c2401cc20 comp rx=0 tx=0).stop 2024-01-19T05:19:00.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c398f5640 1 -- 172.21.15.99:0/4087579104 reap_dead start 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c3b358640 1 -- 172.21.15.99:0/4087579104 shutdown_connections 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c3b358640 1 -- 172.21.15.99:0/4087579104 >> 172.21.15.99:0/4087579104 conn(0x7f1c340b8080 msgr2=0x7f1c340b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c3b358640 1 -- 172.21.15.99:0/4087579104 shutdown_connections 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.204+0000 7f1c3b358640 1 -- 172.21.15.99:0/4087579104 wait complete. 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 Processor -- start 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 -- start start 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c341dbd60 0x7f1c341d5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c341d5d90 0x7f1c340a9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340a95d0 0x7f1c341df060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340ab6f0 con 0x7f1c340a95d0 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3413e070 con 0x7f1c341d5d90 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340a9a30 con 0x7f1c341dbd60 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340a95d0 0x7f1c341df060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340a95d0 0x7f1c341df060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45284/0 (socket says 172.21.15.99:45284) 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 -- 172.21.15.99:0/3835234168 learned_addr learned my addr 172.21.15.99:0/3835234168 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c390f4640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c341dbd60 0x7f1c341d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c388f3640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c341d5d90 0x7f1c340a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 -- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c341dbd60 msgr2=0x7f1c341d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c341dbd60 0x7f1c341d5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 -- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c341d5d90 msgr2=0x7f1c340a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c341d5d90 0x7f1c340a9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 -- 172.21.15.99:0/3835234168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340abbd0 con 0x7f1c340a95d0 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c390f4640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c341dbd60 0x7f1c341d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c398f5640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340a95d0 0x7f1c341df060 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c210 tx=0x7f1c1c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c31ffb640 1 -- 172.21.15.99:0/3835234168 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240b3070 con 0x7f1c340a95d0 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c31ffb640 1 -- 172.21.15.99:0/3835234168 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24000e50 con 0x7f1c340a95d0 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c341dc490 con 0x7f1c340a95d0 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c31ffb640 1 -- 172.21.15.99:0/3835234168 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240a5b20 con 0x7f1c340a95d0 2024-01-19T05:19:00.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c340ab8f0 con 0x7f1c340a95d0 2024-01-19T05:19:00.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c340696e0 con 0x7f1c340a95d0 2024-01-19T05:19:00.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c31ffb640 1 -- 172.21.15.99:0/3835234168 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1c24007140 con 0x7f1c340a95d0 2024-01-19T05:19:00.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.208+0000 7f1c31ffb640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1c20066500 0x7f1c200689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.212+0000 7f1c390f4640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1c20066500 0x7f1c200689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.212+0000 7f1c31ffb640 1 -- 172.21.15.99:0/3835234168 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c2411d730 con 0x7f1c340a95d0 2024-01-19T05:19:00.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.212+0000 7f1c390f4640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1c20066500 0x7f1c200689c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c007560 tx=0x7f1c2c00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.216+0000 7f1c31ffb640 1 -- 172.21.15.99:0/3835234168 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1c240eaa60 con 0x7f1c340a95d0 2024-01-19T05:19:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.360+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c3406f060 con 0x7f1c340a95d0 2024-01-19T05:19:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.360+0000 7f1c31ffb640 1 -- 172.21.15.99:0/3835234168 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c240ee080 con 0x7f1c340a95d0 2024-01-19T05:19:00.360 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:19:00.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.360+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1c20066500 msgr2=0x7f1c200689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.360+0000 7f1c3b358640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1c20066500 0x7f1c200689c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c007560 tx=0x7f1c2c00b040 comp rx=0 tx=0).stop 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.360+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340a95d0 msgr2=0x7f1c341df060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.360+0000 7f1c3b358640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340a95d0 0x7f1c341df060 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c210 tx=0x7f1c1c007a10 comp rx=0 tx=0).stop 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.364+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 shutdown_connections 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.364+0000 7f1c3b358640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1c20066500 0x7f1c200689c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.364+0000 7f1c3b358640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340a95d0 0x7f1c341df060 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.364+0000 7f1c3b358640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c341d5d90 0x7f1c340a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.364+0000 7f1c3b358640 1 --2- 172.21.15.99:0/3835234168 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1c341dbd60 0x7f1c341d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.364+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 >> 172.21.15.99:0/3835234168 conn(0x7f1c340b8080 msgr2=0x7f1c340b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.364+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 shutdown_connections 2024-01-19T05:19:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.364+0000 7f1c3b358640 1 -- 172.21.15.99:0/3835234168 wait complete. 2024-01-19T05:19:00.377 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:19:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.496+0000 7feb03c6d640 1 Processor -- start 2024-01-19T05:19:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.496+0000 7feb03c6d640 1 -- start start 2024-01-19T05:19:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb03c6d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc0b19f0 0x7feafc06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb03c6d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feafc144c70 0x7feafc1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb03c6d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feafc071de0 0x7feafc072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb03c6d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc070680 con 0x7feafc144c70 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb03c6d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc070410 con 0x7feafc071de0 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb03c6d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc144790 con 0x7feafc0b19f0 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feafc144c70 0x7feafc1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feafc144c70 0x7feafc1450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45286/0 (socket says 172.21.15.99:45286) 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 -- 172.21.15.99:0/909435863 learned_addr learned my addr 172.21.15.99:0/909435863 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb0220a640 1 --2- 172.21.15.99:0/909435863 >> v2:172.21.15.157:3300/0 conn(0x7feafc071de0 0x7feafc072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01a09640 1 --2- 172.21.15.99:0/909435863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc0b19f0 0x7feafc06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 -- 172.21.15.99:0/909435863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc0b19f0 msgr2=0x7feafc06ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 --2- 172.21.15.99:0/909435863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc0b19f0 0x7feafc06ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 -- 172.21.15.99:0/909435863 >> v2:172.21.15.157:3300/0 conn(0x7feafc071de0 msgr2=0x7feafc072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 --2- 172.21.15.99:0/909435863 >> v2:172.21.15.157:3300/0 conn(0x7feafc071de0 0x7feafc072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 -- 172.21.15.99:0/909435863 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc06f2b0 con 0x7feafc144c70 2024-01-19T05:19:00.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb0220a640 1 --2- 172.21.15.99:0/909435863 >> v2:172.21.15.157:3300/0 conn(0x7feafc071de0 0x7feafc072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:00.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb01208640 1 --2- 172.21.15.99:0/909435863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc144c70 0x7feafc1450d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7feafc0b8ce0 tx=0x7feaf001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ca7a61512909db server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb00a07640 1 -- 172.21.15.99:0/909435863 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00a5720 con 0x7feafc144c70 2024-01-19T05:19:00.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb00a07640 1 -- 172.21.15.99:0/909435863 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf00a5880 con 0x7feafc144c70 2024-01-19T05:19:00.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.500+0000 7feb00a07640 1 -- 172.21.15.99:0/909435863 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00a5c10 con 0x7feafc144c70 2024-01-19T05:19:00.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- 172.21.15.99:0/909435863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc144c70 msgr2=0x7feafc1450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 --2- 172.21.15.99:0/909435863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc144c70 0x7feafc1450d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7feafc0b8ce0 tx=0x7feaf001c940 comp rx=0 tx=0).stop 2024-01-19T05:19:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- 172.21.15.99:0/909435863 shutdown_connections 2024-01-19T05:19:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 --2- 172.21.15.99:0/909435863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc144c70 0x7feafc1450d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 --2- 172.21.15.99:0/909435863 >> v2:172.21.15.157:3300/0 conn(0x7feafc071de0 0x7feafc072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 --2- 172.21.15.99:0/909435863 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc0b19f0 0x7feafc06ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- 172.21.15.99:0/909435863 >> 172.21.15.99:0/909435863 conn(0x7feafc0b8080 msgr2=0x7feafc0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- 172.21.15.99:0/909435863 shutdown_connections 2024-01-19T05:19:00.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- 172.21.15.99:0/909435863 wait complete. 2024-01-19T05:19:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 Processor -- start 2024-01-19T05:19:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- start start 2024-01-19T05:19:00.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc071de0 0x7feafc146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc0b19f0 0x7feafc137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feafc144c70 0x7feafc137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0ae6d0 con 0x7feafc0b19f0 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0ae920 con 0x7feafc144c70 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc13c2a0 con 0x7feafc071de0 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc0b19f0 0x7feafc137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc0b19f0 0x7feafc137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45294/0 (socket says 172.21.15.99:45294) 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 -- 172.21.15.99:0/3649344785 learned_addr learned my addr 172.21.15.99:0/3649344785 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb0220a640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feafc144c70 0x7feafc137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01a09640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc071de0 0x7feafc146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 -- 172.21.15.99:0/3649344785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc071de0 msgr2=0x7feafc146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc071de0 0x7feafc146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 -- 172.21.15.99:0/3649344785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feafc144c70 msgr2=0x7feafc137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feafc144c70 0x7feafc137cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 -- 172.21.15.99:0/3649344785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf0009b30 con 0x7feafc0b19f0 2024-01-19T05:19:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb01208640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc0b19f0 0x7feafc137770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feaf00af040 tx=0x7feaf00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feaee7fc640 1 -- 172.21.15.99:0/3649344785 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00b8670 con 0x7feafc0b19f0 2024-01-19T05:19:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feaee7fc640 1 -- 172.21.15.99:0/3649344785 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf00b87f0 con 0x7feafc0b19f0 2024-01-19T05:19:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc138fd0 con 0x7feafc0b19f0 2024-01-19T05:19:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feaee7fc640 1 -- 172.21.15.99:0/3649344785 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00b8ba0 con 0x7feafc0b19f0 2024-01-19T05:19:00.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc147370 con 0x7feafc0b19f0 2024-01-19T05:19:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.504+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc137490 con 0x7feafc0b19f0 2024-01-19T05:19:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.508+0000 7feaee7fc640 1 -- 172.21.15.99:0/3649344785 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7feaf00b8d00 con 0x7feafc0b19f0 2024-01-19T05:19:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.508+0000 7feaee7fc640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feae0066500 0x7feae00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.508+0000 7feaee7fc640 1 -- 172.21.15.99:0/3649344785 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feaf011f3a0 con 0x7feafc0b19f0 2024-01-19T05:19:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.508+0000 7feb01a09640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feae0066500 0x7feae00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.508+0000 7feb01a09640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feae0066500 0x7feae00689c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feaf800b930 tx=0x7feaf8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.512+0000 7feaee7fc640 1 -- 172.21.15.99:0/3649344785 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7feafc137490 con 0x7feafc0b19f0 2024-01-19T05:19:00.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.668+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feafc137490 con 0x7feafc0b19f0 2024-01-19T05:19:00.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.668+0000 7feaee7fc640 1 -- 172.21.15.99:0/3649344785 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7feafc137490 con 0x7feafc0b19f0 2024-01-19T05:19:00.668 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feae0066500 msgr2=0x7feae00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feae0066500 0x7feae00689c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feaf800b930 tx=0x7feaf8008040 comp rx=0 tx=0).stop 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc0b19f0 msgr2=0x7feafc137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc0b19f0 0x7feafc137770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feaf00af040 tx=0x7feaf00196e0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 shutdown_connections 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7feae0066500 0x7feae00689c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feafc144c70 0x7feafc137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feafc0b19f0 0x7feafc137770 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 --2- 172.21.15.99:0/3649344785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feafc071de0 0x7feafc146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 >> 172.21.15.99:0/3649344785 conn(0x7feafc0b8080 msgr2=0x7feafc071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 shutdown_connections 2024-01-19T05:19:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.672+0000 7feb03c6d640 1 -- 172.21.15.99:0/3649344785 wait complete. 2024-01-19T05:19:00.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:19:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.808+0000 7f62392a0640 1 Processor -- start 2024-01-19T05:19:00.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.808+0000 7f62392a0640 1 -- start start 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62392a0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62340b1870 0x7f6234143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62392a0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623406f620 con 0x7f62340b2ce0 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62392a0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6234143610 con 0x7f6234144000 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62392a0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6234141000 con 0x7f62340b1870 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f6232ffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f62340b2ce0 0x7f6234071f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37676/0 (socket says 172.21.15.99:37676) 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f6232ffd640 1 -- 172.21.15.99:0/728699761 learned_addr learned my addr 172.21.15.99:0/728699761 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91570700 0 0) 0x7f623406f620 con 0x7f62340b2ce0 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6220003530 con 0x7f62340b2ce0 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f622a7fc640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62340b1870 0x7f6234143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194497542 0 0) 0x7f6220003530 con 0x7f62340b2ce0 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62340b1870 msgr2=0x7f6234143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:00.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62340b1870 0x7f6234143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 >> v1:172.21.15.157:6789/0 conn(0x7f6234144000 legacy=0x7f623414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234144480 con 0x7f62340b2ce0 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f6224001680 con 0x7f62340b2ce0 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 >> v1:172.21.15.99:6789/0 conn(0x7f62340b2ce0 legacy=0x7f6234071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62200039b0 0x7f6220003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62200047d0 0x7f6220004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6220005190 0x7f622000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6234141000 con 0x7f62200039b0 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622000bed0 con 0x7f62200047d0 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622000c060 con 0x7f6220005190 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f6232ffd640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62200039b0 0x7f6220003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f622a7fc640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62200047d0 0x7f6220004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62337fe640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6220005190 0x7f622000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f6232ffd640 1 -- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6220005190 msgr2=0x7f622000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:00.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f6232ffd640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6220005190 0x7f622000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f6232ffd640 1 -- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62200047d0 msgr2=0x7f6220004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:00.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f6232ffd640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62200047d0 0x7f6220004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f6232ffd640 1 -- 172.21.15.99:0/728699761 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6220003530 con 0x7f62200039b0 2024-01-19T05:19:00.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f622a7fc640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62200047d0 0x7f6220004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:00.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.812+0000 7f62337fe640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6220005190 0x7f622000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:00.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f6232ffd640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62200039b0 0x7f6220003dd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6224007cb0 tx=0x7f622401ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe61722965d1faf server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62240a7c40 con 0x7f62200039b0 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62240a7da0 con 0x7f62200039b0 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62327fc640 1 -- 172.21.15.99:0/728699761 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224005b20 con 0x7f62200039b0 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- 172.21.15.99:0/728699761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62200039b0 msgr2=0x7f6220003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 --2- 172.21.15.99:0/728699761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62200039b0 0x7f6220003dd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6224007cb0 tx=0x7f622401ee50 comp rx=0 tx=0).stop 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 -- 172.21.15.99:0/728699761 reap_dead start 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- 172.21.15.99:0/728699761 shutdown_connections 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- 172.21.15.99:0/728699761 >> 172.21.15.99:0/728699761 conn(0x7f62340b8080 msgr2=0x7f62340b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- 172.21.15.99:0/728699761 shutdown_connections 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- 172.21.15.99:0/728699761 wait complete. 2024-01-19T05:19:00.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 Processor -- start 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- start start 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039b0 0x7f623413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6234144ff0 0x7f62341da540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62341daa80 0x7f6234148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623413e010 con 0x7f62341daa80 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623413ea20 con 0x7f6234144ff0 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6234145770 con 0x7f62200039b0 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62341daa80 0x7f6234148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62341daa80 0x7f6234148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45308/0 (socket says 172.21.15.99:45308) 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 -- 172.21.15.99:0/81842175 learned_addr learned my addr 172.21.15.99:0/81842175 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f6232ffd640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039b0 0x7f623413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f622a7fc640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6234144ff0 0x7f62341da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 -- 172.21.15.99:0/81842175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039b0 msgr2=0x7f623413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039b0 0x7f623413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 -- 172.21.15.99:0/81842175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6234144ff0 msgr2=0x7f62341da540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6234144ff0 0x7f62341da540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 -- 172.21.15.99:0/81842175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623413e220 con 0x7f62341daa80 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62337fe640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62341daa80 0x7f6234148ed0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f623406bbe0 tx=0x7f622c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f622bfff640 1 -- 172.21.15.99:0/81842175 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c006d60 con 0x7f62341daa80 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f622bfff640 1 -- 172.21.15.99:0/81842175 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c003980 con 0x7f62341daa80 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623413e500 con 0x7f62341daa80 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f622bfff640 1 -- 172.21.15.99:0/81842175 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c003d70 con 0x7f62341daa80 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.816+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62340713a0 con 0x7f62341daa80 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.820+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6234071160 con 0x7f62341daa80 2024-01-19T05:19:00.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.820+0000 7f622bfff640 1 -- 172.21.15.99:0/81842175 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f622c005070 con 0x7f62341daa80 2024-01-19T05:19:00.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.820+0000 7f622bfff640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6214066530 0x7f62140689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:00.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.820+0000 7f622bfff640 1 -- 172.21.15.99:0/81842175 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f622c083bd0 con 0x7f62341daa80 2024-01-19T05:19:00.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.820+0000 7f6232ffd640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6214066530 0x7f62140689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:00.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.820+0000 7f6232ffd640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6214066530 0x7f62140689f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62240ad000 tx=0x7f62240a9070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:00.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.824+0000 7f622bfff640 1 -- 172.21.15.99:0/81842175 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f622c050e60 con 0x7f62341daa80 2024-01-19T05:19:00.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.976+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62340696e0 con 0x7f62341daa80 2024-01-19T05:19:00.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.976+0000 7f622bfff640 1 -- 172.21.15.99:0/81842175 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f622c054480 con 0x7f62341daa80 2024-01-19T05:19:00.978 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6214066530 msgr2=0x7f62140689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6214066530 0x7f62140689f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62240ad000 tx=0x7f62240a9070 comp rx=0 tx=0).stop 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62341daa80 msgr2=0x7f6234148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62341daa80 0x7f6234148ed0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f623406bbe0 tx=0x7f622c00dc00 comp rx=0 tx=0).stop 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 shutdown_connections 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6214066530 0x7f62140689f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62341daa80 0x7f6234148ed0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6234144ff0 0x7f62341da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 --2- 172.21.15.99:0/81842175 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62200039b0 0x7f623413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 >> 172.21.15.99:0/81842175 conn(0x7f62340b8080 msgr2=0x7f6234141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:00.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 shutdown_connections 2024-01-19T05:19:00.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:00.980+0000 7f62392a0640 1 -- 172.21.15.99:0/81842175 wait complete. 2024-01-19T05:19:00.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-19T05:19:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f9358640 1 Processor -- start 2024-01-19T05:19:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f9358640 1 -- start start 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f9358640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f27f40b19f0 0x7f27f406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f9358640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f27f4144c70 0x7f27f4145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f9358640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 0x7f27f4072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f9358640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f4070680 con 0x7f27f4144c70 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f9358640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f4070410 con 0x7f27f40b19f0 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f9358640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4144790 con 0x7f27f4071de0 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f27fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f27f4144c70 0x7f27f4145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f27fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f27f4144c70 0x7f27f4145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45322/0 (socket says 172.21.15.99:45322) 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f27fc640 1 -- 172.21.15.99:0/4269711786 learned_addr learned my addr 172.21.15.99:0/4269711786 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f37fe640 1 --2- 172.21.15.99:0/4269711786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 0x7f27f4072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f2ffd640 1 --2- 172.21.15.99:0/4269711786 >> v2:172.21.15.157:3300/0 conn(0x7f27f40b19f0 0x7f27f406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f27fc640 1 -- 172.21.15.99:0/4269711786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 msgr2=0x7f27f4072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:01.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f27fc640 1 --2- 172.21.15.99:0/4269711786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 0x7f27f4072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f27fc640 1 -- 172.21.15.99:0/4269711786 >> v2:172.21.15.157:3300/0 conn(0x7f27f40b19f0 msgr2=0x7f27f406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:01.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f27fc640 1 --2- 172.21.15.99:0/4269711786 >> v2:172.21.15.157:3300/0 conn(0x7f27f40b19f0 0x7f27f406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f27fc640 1 -- 172.21.15.99:0/4269711786 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f406f2b0 con 0x7f27f4144c70 2024-01-19T05:19:01.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.104+0000 7f27f37fe640 1 --2- 172.21.15.99:0/4269711786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 0x7f27f4072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 --2- 172.21.15.99:0/4269711786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f4144c70 0x7f27f4145100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f27f406d030 tx=0x7f27e801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468ea450e351ffbd server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f1ffb640 1 -- 172.21.15.99:0/4269711786 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80ad640 con 0x7f27f4144c70 2024-01-19T05:19:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f1ffb640 1 -- 172.21.15.99:0/4269711786 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80ad7a0 con 0x7f27f4144c70 2024-01-19T05:19:01.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f1ffb640 1 -- 172.21.15.99:0/4269711786 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80adb30 con 0x7f27f4144c70 2024-01-19T05:19:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- 172.21.15.99:0/4269711786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f4144c70 msgr2=0x7f27f4145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 --2- 172.21.15.99:0/4269711786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f4144c70 0x7f27f4145100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f27f406d030 tx=0x7f27e801c470 comp rx=0 tx=0).stop 2024-01-19T05:19:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- 172.21.15.99:0/4269711786 shutdown_connections 2024-01-19T05:19:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 --2- 172.21.15.99:0/4269711786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f4144c70 0x7f27f4145100 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 --2- 172.21.15.99:0/4269711786 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 0x7f27f4072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 --2- 172.21.15.99:0/4269711786 >> v2:172.21.15.157:3300/0 conn(0x7f27f40b19f0 0x7f27f406ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- 172.21.15.99:0/4269711786 >> 172.21.15.99:0/4269711786 conn(0x7f27f40b8080 msgr2=0x7f27f40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:01.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- 172.21.15.99:0/4269711786 shutdown_connections 2024-01-19T05:19:01.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- 172.21.15.99:0/4269711786 wait complete. 2024-01-19T05:19:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 Processor -- start 2024-01-19T05:19:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- start start 2024-01-19T05:19:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 0x7f27f4146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f40b19f0 0x7f27f413c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f41dee50 0x7f27f41df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40b1260 con 0x7f27f40b19f0 2024-01-19T05:19:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40b0dd0 con 0x7f27f41dee50 2024-01-19T05:19:01.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f9358640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40af6b0 con 0x7f27f4071de0 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f40b19f0 0x7f27f413c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f40b19f0 0x7f27f413c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45326/0 (socket says 172.21.15.99:45326) 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 -- 172.21.15.99:0/1493828680 learned_addr learned my addr 172.21.15.99:0/1493828680 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 -- 172.21.15.99:0/1493828680 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 msgr2=0x7f27f4146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 0x7f27f4146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 -- 172.21.15.99:0/1493828680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f41dee50 msgr2=0x7f27f41df2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f41dee50 0x7f27f41df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 -- 172.21.15.99:0/1493828680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80094d0 con 0x7f27f40b19f0 2024-01-19T05:19:01.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27f27fc640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f40b19f0 0x7f27f413c030 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f27e80b0040 tx=0x7f27e8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.108+0000 7f27db7fe640 1 -- 172.21.15.99:0/1493828680 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80b77f0 con 0x7f27f40b19f0 2024-01-19T05:19:01.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27db7fe640 1 -- 172.21.15.99:0/1493828680 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80a6040 con 0x7f27f40b19f0 2024-01-19T05:19:01.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f413c970 con 0x7f27f40b19f0 2024-01-19T05:19:01.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27db7fe640 1 -- 172.21.15.99:0/1493828680 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80b7bb0 con 0x7f27f40b19f0 2024-01-19T05:19:01.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f413c570 con 0x7f27f40b19f0 2024-01-19T05:19:01.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f40696e0 con 0x7f27f40b19f0 2024-01-19T05:19:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27db7fe640 1 -- 172.21.15.99:0/1493828680 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f27e80b7d10 con 0x7f27f40b19f0 2024-01-19T05:19:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27db7fe640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e0066500 0x7f27e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27db7fe640 1 -- 172.21.15.99:0/1493828680 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27e811eb90 con 0x7f27f40b19f0 2024-01-19T05:19:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27f2ffd640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e0066500 0x7f27e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.112+0000 7f27f2ffd640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e0066500 0x7f27e00689c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27ec008cd0 tx=0x7f27ec008200 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.116+0000 7f27db7fe640 1 -- 172.21.15.99:0/1493828680 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f27e80ebf40 con 0x7f27f40b19f0 2024-01-19T05:19:01.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.268+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f27f40b6970 con 0x7f27f40b19f0 2024-01-19T05:19:01.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.268+0000 7f27db7fe640 1 -- 172.21.15.99:0/1493828680 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f27e80b2020 con 0x7f27f40b19f0 2024-01-19T05:19:01.270 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e0066500 msgr2=0x7f27e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e0066500 0x7f27e00689c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27ec008cd0 tx=0x7f27ec008200 comp rx=0 tx=0).stop 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f40b19f0 msgr2=0x7f27f413c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f40b19f0 0x7f27f413c030 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f27e80b0040 tx=0x7f27e8019210 comp rx=0 tx=0).stop 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 shutdown_connections 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f27e0066500 0x7f27e00689c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27f41dee50 0x7f27f41df2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27f40b19f0 0x7f27f413c030 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 --2- 172.21.15.99:0/1493828680 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f27f4071de0 0x7f27f4146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 >> 172.21.15.99:0/1493828680 conn(0x7f27f40b8080 msgr2=0x7f27f40b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:01.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 shutdown_connections 2024-01-19T05:19:01.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.272+0000 7f27f9358640 1 -- 172.21.15.99:0/1493828680 wait complete. 2024-01-19T05:19:01.287 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2024-01-19T05:19:01.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:19:01.287 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-19T05:19:01.296 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[37194]: fuse finished with error 0 and tester_r 0 2024-01-19T05:19:01.297 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:19:01.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:19:01.298 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-19T05:19:01.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:19:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd33f7640 1 Processor -- start 2024-01-19T05:19:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd33f7640 1 -- start start 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd33f7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9dcc06ebe0 0x7f9dcc071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd33f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc072320 0x7f9dcc14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd33f7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc06f070 con 0x7f9dcc0b19f0 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd33f7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc070680 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd33f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc070410 con 0x7f9dcc072320 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd1994640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc072320 0x7f9dcc14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd0992640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9dcc06ebe0 0x7f9dcc071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd1994640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc072320 0x7f9dcc14ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:49992/0 (socket says 172.21.15.99:49992) 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd1994640 1 -- 172.21.15.99:0/2385701625 learned_addr learned my addr 172.21.15.99:0/2385701625 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd1193640 1 --1- 172.21.15.99:0/2385701625 >> v1:172.21.15.157:6789/0 conn(0x7f9dcc0b19f0 0x7f9dcc144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:54950/0 (socket says 172.21.15.99:54950) 2024-01-19T05:19:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd1994640 1 -- 172.21.15.99:0/2385701625 >> v2:172.21.15.157:3300/0 conn(0x7f9dcc06ebe0 msgr2=0x7f9dcc071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd1994640 1 --2- 172.21.15.99:0/2385701625 >> v2:172.21.15.157:3300/0 conn(0x7f9dcc06ebe0 0x7f9dcc071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd1994640 1 -- 172.21.15.99:0/2385701625 >> v1:172.21.15.157:6789/0 conn(0x7f9dcc0b19f0 legacy=0x7f9dcc144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.516+0000 7f9dd1994640 1 -- 172.21.15.99:0/2385701625 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc144790 con 0x7f9dcc072320 2024-01-19T05:19:01.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1994640 1 --2- 172.21.15.99:0/2385701625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc072320 0x7f9dcc14ee90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009e50 tx=0x7f9dc401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4256255842041e14 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dc3fff640 1 -- 172.21.15.99:0/2385701625 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40a5830 con 0x7f9dcc072320 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dc3fff640 1 -- 172.21.15.99:0/2385701625 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc40a5990 con 0x7f9dcc072320 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dc3fff640 1 -- 172.21.15.99:0/2385701625 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40a5d20 con 0x7f9dcc072320 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- 172.21.15.99:0/2385701625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc072320 msgr2=0x7f9dcc14ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/2385701625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc072320 0x7f9dcc14ee90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009e50 tx=0x7f9dc401c950 comp rx=0 tx=0).stop 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- 172.21.15.99:0/2385701625 shutdown_connections 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/2385701625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc072320 0x7f9dcc14ee90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/2385701625 >> v2:172.21.15.157:3300/0 conn(0x7f9dcc06ebe0 0x7f9dcc071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- 172.21.15.99:0/2385701625 >> 172.21.15.99:0/2385701625 conn(0x7f9dcc0b8080 msgr2=0x7f9dcc0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- 172.21.15.99:0/2385701625 shutdown_connections 2024-01-19T05:19:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- 172.21.15.99:0/2385701625 wait complete. 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 Processor -- start 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- start start 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc06ebe0 0x7f9dcc0a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9dcc072320 0x7f9dcc13cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc0b19f0 0x7f9dcc0a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1dff40 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1e07e0 con 0x7f9dcc072320 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd33f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1381a0 con 0x7f9dcc0b19f0 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc06ebe0 0x7f9dcc0a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc06ebe0 0x7f9dcc0a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45340/0 (socket says 172.21.15.99:45340) 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 -- 172.21.15.99:0/950629159 learned_addr learned my addr 172.21.15.99:0/950629159 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd0992640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9dcc072320 0x7f9dcc13cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1994640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc0b19f0 0x7f9dcc0a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 -- 172.21.15.99:0/950629159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc0b19f0 msgr2=0x7f9dcc0a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc0b19f0 0x7f9dcc0a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 -- 172.21.15.99:0/950629159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9dcc072320 msgr2=0x7f9dcc13cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9dcc072320 0x7f9dcc13cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 -- 172.21.15.99:0/950629159 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc4009b30 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.520+0000 7f9dd1193640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc06ebe0 0x7f9dcc0a9f90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c450 tx=0x7f9dc800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dc1ffb640 1 -- 172.21.15.99:0/950629159 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8007480 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dc1ffb640 1 -- 172.21.15.99:0/950629159 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc80075e0 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dc1ffb640 1 -- 172.21.15.99:0/950629159 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8004a30 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc0ab0c0 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc1e0470 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc0696e0 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dc1ffb640 1 -- 172.21.15.99:0/950629159 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9dc8004b90 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dc1ffb640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9db0066530 0x7f9db00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dc1ffb640 1 -- 172.21.15.99:0/950629159 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dc8082d20 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dd0992640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9db0066530 0x7f9db00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.524+0000 7f9dd0992640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9db0066530 0x7f9db00689f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0b41f0 tx=0x7f9dbc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.528+0000 7f9dc1ffb640 1 -- 172.21.15.99:0/950629159 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9dc8050050 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dcc06f070 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dc1ffb640 1 -- 172.21.15.99:0/950629159 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3353 (secure 0 0 0) 0x7f9dc8018d30 con 0x7f9dcc06ebe0 2024-01-19T05:19:01.711 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:01.711 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/84065038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":84065038},{"type":"v1","addr":"172.21.15.157:6833","nonce":84065038}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:46.663899+0000","modified":"2024-01-19T05:18:48.672449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/3566081214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3566081214},{"type":"v1","addr":"172.21.15.99:6835","nonce":3566081214}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-19T05:19:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 13 2024-01-19T05:19:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9db0066530 msgr2=0x7f9db00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9db0066530 0x7f9db00689f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0b41f0 tx=0x7f9dbc008040 comp rx=0 tx=0).stop 2024-01-19T05:19:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc06ebe0 msgr2=0x7f9dcc0a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc06ebe0 0x7f9dcc0a9f90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c450 tx=0x7f9dc800c910 comp rx=0 tx=0).stop 2024-01-19T05:19:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 shutdown_connections 2024-01-19T05:19:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f9db0066530 0x7f9db00689f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9dcc0b19f0 0x7f9dcc0a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9dcc072320 0x7f9dcc13cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 --2- 172.21.15.99:0/950629159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dcc06ebe0 0x7f9dcc0a9f90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 >> 172.21.15.99:0/950629159 conn(0x7f9dcc0b8080 msgr2=0x7f9dcc0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 shutdown_connections 2024-01-19T05:19:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.712+0000 7f9dd33f7640 1 -- 172.21.15.99:0/950629159 wait complete. 2024-01-19T05:19:01.729 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:19:01.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.844+0000 7f5394ac4640 1 Processor -- start 2024-01-19T05:19:01.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.844+0000 7f5394ac4640 1 -- start start 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f5394ac4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 0x7f5390071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f5394ac4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f53900b1870 0x7f5390072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f5394ac4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5390143ac0 0x7f5390143f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f5394ac4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5390141000 con 0x7f5390143ac0 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f5394ac4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53901444b0 con 0x7f53900b1870 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f5394ac4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539006f620 con 0x7f53900b2ce0 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5390143ac0 0x7f5390143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5390143ac0 0x7f5390143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45346/0 (socket says 172.21.15.99:45346) 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 -- 172.21.15.99:0/4019638052 learned_addr learned my addr 172.21.15.99:0/4019638052 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538e59c640 1 --2- 172.21.15.99:0/4019638052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 0x7f5390071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538dd9b640 1 --2- 172.21.15.99:0/4019638052 >> v2:172.21.15.157:3300/0 conn(0x7f53900b1870 0x7f5390072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 -- 172.21.15.99:0/4019638052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 msgr2=0x7f5390071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:01.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 --2- 172.21.15.99:0/4019638052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 0x7f5390071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 -- 172.21.15.99:0/4019638052 >> v2:172.21.15.157:3300/0 conn(0x7f53900b1870 msgr2=0x7f5390072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:01.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 --2- 172.21.15.99:0/4019638052 >> v2:172.21.15.157:3300/0 conn(0x7f53900b1870 0x7f5390072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 -- 172.21.15.99:0/4019638052 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390143610 con 0x7f5390143ac0 2024-01-19T05:19:01.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538dd9b640 1 --2- 172.21.15.99:0/4019638052 >> v2:172.21.15.157:3300/0 conn(0x7f53900b1870 0x7f5390072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:01.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538ed9d640 1 --2- 172.21.15.99:0/4019638052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5390143ac0 0x7f5390143f70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f539006ad00 tx=0x7f538801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b59ce21dca0ca8 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538d59a640 1 -- 172.21.15.99:0/4019638052 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880a5850 con 0x7f5390143ac0 2024-01-19T05:19:01.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538d59a640 1 -- 172.21.15.99:0/4019638052 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53880a59b0 con 0x7f5390143ac0 2024-01-19T05:19:01.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.848+0000 7f538d59a640 1 -- 172.21.15.99:0/4019638052 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880a5d40 con 0x7f5390143ac0 2024-01-19T05:19:01.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- 172.21.15.99:0/4019638052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5390143ac0 msgr2=0x7f5390143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 --2- 172.21.15.99:0/4019638052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5390143ac0 0x7f5390143f70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f539006ad00 tx=0x7f538801c9d0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- 172.21.15.99:0/4019638052 shutdown_connections 2024-01-19T05:19:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 --2- 172.21.15.99:0/4019638052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5390143ac0 0x7f5390143f70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 --2- 172.21.15.99:0/4019638052 >> v2:172.21.15.157:3300/0 conn(0x7f53900b1870 0x7f5390072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 --2- 172.21.15.99:0/4019638052 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 0x7f5390071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- 172.21.15.99:0/4019638052 >> 172.21.15.99:0/4019638052 conn(0x7f53900b8080 msgr2=0x7f53900b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- 172.21.15.99:0/4019638052 shutdown_connections 2024-01-19T05:19:01.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- 172.21.15.99:0/4019638052 wait complete. 2024-01-19T05:19:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 Processor -- start 2024-01-19T05:19:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- start start 2024-01-19T05:19:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 0x7f53900a86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5390143ac0 0x7f53900a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f539013f4b0 0x7f539013f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53901dc0b0 con 0x7f539013f4b0 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900ab2b0 con 0x7f5390143ac0 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539013fe80 con 0x7f53900b2ce0 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f539013f4b0 0x7f539013f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f539013f4b0 0x7f539013f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47162/0 (socket says 172.21.15.99:47162) 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 -- 172.21.15.99:0/1836622061 learned_addr learned my addr 172.21.15.99:0/1836622061 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538dd9b640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5390143ac0 0x7f53900a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 -- 172.21.15.99:0/1836622061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 msgr2=0x7f53900a86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 0x7f53900a86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 -- 172.21.15.99:0/1836622061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5390143ac0 msgr2=0x7f53900a8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5390143ac0 0x7f53900a8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 -- 172.21.15.99:0/1836622061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388009b30 con 0x7f539013f4b0 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f538ed9d640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f539013f4b0 0x7f539013f940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f53880af040 tx=0x7f5388019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f537effd640 1 -- 172.21.15.99:0/1836622061 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880b8880 con 0x7f539013f4b0 2024-01-19T05:19:01.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f537effd640 1 -- 172.21.15.99:0/1836622061 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53880b89e0 con 0x7f539013f4b0 2024-01-19T05:19:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53900aafd0 con 0x7f539013f4b0 2024-01-19T05:19:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f537effd640 1 -- 172.21.15.99:0/1836622061 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880b8d90 con 0x7f539013f4b0 2024-01-19T05:19:01.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53901dbd40 con 0x7f539013f4b0 2024-01-19T05:19:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.852+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53901dbed0 con 0x7f539013f4b0 2024-01-19T05:19:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.856+0000 7f537effd640 1 -- 172.21.15.99:0/1836622061 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f53880b6440 con 0x7f539013f4b0 2024-01-19T05:19:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.856+0000 7f537effd640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5370066530 0x7f53700689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.856+0000 7f537effd640 1 -- 172.21.15.99:0/1836622061 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f538811f6b0 con 0x7f539013f4b0 2024-01-19T05:19:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.856+0000 7f538e59c640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5370066530 0x7f53700689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:01.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.856+0000 7f538e59c640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5370066530 0x7f53700689f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5380009870 tx=0x7f5380008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:01.860+0000 7f537effd640 1 -- 172.21.15.99:0/1836622061 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f53880ec960 con 0x7f539013f4b0 2024-01-19T05:19:02.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.020+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53900696e0 con 0x7f539013f4b0 2024-01-19T05:19:02.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.020+0000 7f537effd640 1 -- 172.21.15.99:0/1836622061 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f53880eff80 con 0x7f539013f4b0 2024-01-19T05:19:02.021 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:02.021 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:48.330234+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:44.862843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:45.655715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:19:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5370066530 msgr2=0x7f53700689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5370066530 0x7f53700689f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5380009870 tx=0x7f5380008040 comp rx=0 tx=0).stop 2024-01-19T05:19:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f539013f4b0 msgr2=0x7f539013f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f539013f4b0 0x7f539013f940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f53880af040 tx=0x7f5388019770 comp rx=0 tx=0).stop 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 shutdown_connections 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5370066530 0x7f53700689f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f539013f4b0 0x7f539013f940 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5390143ac0 0x7f53900a8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 --2- 172.21.15.99:0/1836622061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53900b2ce0 0x7f53900a86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 >> 172.21.15.99:0/1836622061 conn(0x7f53900b8080 msgr2=0x7f53900721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 shutdown_connections 2024-01-19T05:19:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.024+0000 7f5394ac4640 1 -- 172.21.15.99:0/1836622061 wait complete. 2024-01-19T05:19:02.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-19T05:17:51.415642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-19T05:18:44.862843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-19T05:18:45.655715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-19T05:19:02.040 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-19T05:19:02.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402c7d4640 1 Processor -- start 2024-01-19T05:19:02.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402c7d4640 1 -- start start 2024-01-19T05:19:02.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402c7d4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40240b96f0 0x7f40240b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402c7d4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4024140e90 0x7f40241511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402c7d4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240b87f0 con 0x7f40240b7c40 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402c7d4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240b9ad0 con 0x7f40240b96f0 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402c7d4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b81e0 con 0x7f4024140e90 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402a570640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40240b96f0 0x7f40240b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402a570640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40240b96f0 0x7f40240b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47174/0 (socket says 172.21.15.99:47174) 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402a570640 1 -- 172.21.15.99:0/2079492096 learned_addr learned my addr 172.21.15.99:0/2079492096 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402ad71640 1 --2- 172.21.15.99:0/2079492096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4024140e90 0x7f40241511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402a570640 1 -- 172.21.15.99:0/2079492096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4024140e90 msgr2=0x7f40241511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402a570640 1 --2- 172.21.15.99:0/2079492096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4024140e90 0x7f40241511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402a570640 1 -- 172.21.15.99:0/2079492096 >> v1:172.21.15.157:6789/0 conn(0x7f40240b7c40 legacy=0x7f4024140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.164+0000 7f402a570640 1 -- 172.21.15.99:0/2079492096 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402406ba20 con 0x7f40240b96f0 2024-01-19T05:19:02.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 --2- 172.21.15.99:0/2079492096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b96f0 0x7f40240b7700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4020009870 tx=0x7f402001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be25cd0cceddbcfe server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402956e640 1 -- 172.21.15.99:0/2079492096 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200aa430 con 0x7f40240b96f0 2024-01-19T05:19:02.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402956e640 1 -- 172.21.15.99:0/2079492096 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40200aa590 con 0x7f40240b96f0 2024-01-19T05:19:02.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402956e640 1 -- 172.21.15.99:0/2079492096 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200aa920 con 0x7f40240b96f0 2024-01-19T05:19:02.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- 172.21.15.99:0/2079492096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b96f0 msgr2=0x7f40240b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 --2- 172.21.15.99:0/2079492096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b96f0 0x7f40240b7700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4020009870 tx=0x7f402001c510 comp rx=0 tx=0).stop 2024-01-19T05:19:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- 172.21.15.99:0/2079492096 shutdown_connections 2024-01-19T05:19:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 --2- 172.21.15.99:0/2079492096 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4024140e90 0x7f40241511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 --2- 172.21.15.99:0/2079492096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b96f0 0x7f40240b7700 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- 172.21.15.99:0/2079492096 >> 172.21.15.99:0/2079492096 conn(0x7f402409e600 msgr2=0x7f40240b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- 172.21.15.99:0/2079492096 shutdown_connections 2024-01-19T05:19:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- 172.21.15.99:0/2079492096 wait complete. 2024-01-19T05:19:02.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 Processor -- start 2024-01-19T05:19:02.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- start start 2024-01-19T05:19:02.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b7c40 0x7f4024146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40240b96f0 0x7f40240b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4024140e90 0x7f402413f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b51e0 con 0x7f40240b7c40 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024147430 con 0x7f4024140e90 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b4f90 con 0x7f40240b96f0 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b7c40 0x7f4024146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b7c40 0x7f4024146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47180/0 (socket says 172.21.15.99:47180) 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 -- 172.21.15.99:0/3530574239 learned_addr learned my addr 172.21.15.99:0/3530574239 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f4029d6f640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40240b96f0 0x7f40240b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402ad71640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4024140e90 0x7f402413f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 -- 172.21.15.99:0/3530574239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40240b96f0 msgr2=0x7f40240b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40240b96f0 0x7f40240b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 -- 172.21.15.99:0/3530574239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4024140e90 msgr2=0x7f402413f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4024140e90 0x7f402413f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 -- 172.21.15.99:0/3530574239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200094d0 con 0x7f40240b7c40 2024-01-19T05:19:02.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402a570640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b7c40 0x7f4024146cc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f402001abc0 tx=0x7f402001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f401affd640 1 -- 172.21.15.99:0/3530574239 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200b3800 con 0x7f40240b7c40 2024-01-19T05:19:02.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f401affd640 1 -- 172.21.15.99:0/3530574239 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40200b3960 con 0x7f40240b7c40 2024-01-19T05:19:02.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4024148f70 con 0x7f40240b7c40 2024-01-19T05:19:02.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f401affd640 1 -- 172.21.15.99:0/3530574239 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200b3d10 con 0x7f40240b7c40 2024-01-19T05:19:02.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.168+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4024148c90 con 0x7f40240b7c40 2024-01-19T05:19:02.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.172+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40240696e0 con 0x7f40240b7c40 2024-01-19T05:19:02.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.172+0000 7f401affd640 1 -- 172.21.15.99:0/3530574239 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f40200c6440 con 0x7f40240b7c40 2024-01-19T05:19:02.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.172+0000 7f401affd640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4008066500 0x7f40080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.172+0000 7f401affd640 1 -- 172.21.15.99:0/3530574239 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f402011e9b0 con 0x7f40240b7c40 2024-01-19T05:19:02.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.172+0000 7f4029d6f640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4008066500 0x7f40080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.172+0000 7f4029d6f640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4008066500 0x7f40080689c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f40240b2260 tx=0x7f4014009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.176+0000 7f401affd640 1 -- 172.21.15.99:0/3530574239 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f40200ebcc0 con 0x7f40240b7c40 2024-01-19T05:19:02.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4024099f50 con 0x7f40240b7c40 2024-01-19T05:19:02.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f401affd640 1 -- 172.21.15.99:0/3530574239 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40200ef2e0 con 0x7f40240b7c40 2024-01-19T05:19:02.336 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-19T05:19:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4008066500 msgr2=0x7f40080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4008066500 0x7f40080689c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f40240b2260 tx=0x7f4014009040 comp rx=0 tx=0).stop 2024-01-19T05:19:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b7c40 msgr2=0x7f4024146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b7c40 0x7f4024146cc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f402001abc0 tx=0x7f402001ad50 comp rx=0 tx=0).stop 2024-01-19T05:19:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 shutdown_connections 2024-01-19T05:19:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f4008066500 0x7f40080689c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4024140e90 0x7f402413f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40240b96f0 0x7f40240b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 --2- 172.21.15.99:0/3530574239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40240b7c40 0x7f4024146cc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 >> 172.21.15.99:0/3530574239 conn(0x7f402409e600 msgr2=0x7f4024140550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 shutdown_connections 2024-01-19T05:19:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.336+0000 7f402c7d4640 1 -- 172.21.15.99:0/3530574239 wait complete. 2024-01-19T05:19:02.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-19T05:19:02.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.472+0000 7f6fa9001640 1 Processor -- start 2024-01-19T05:19:02.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.472+0000 7f6fa9001640 1 -- start start 2024-01-19T05:19:02.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa9001640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6fa40b3310 0x7f6fa40b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa9001640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa40b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa9001640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa406ed10 con 0x7f6fa40b36f0 2024-01-19T05:19:02.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa9001640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa40b22b0 con 0x7f6fa40b3310 2024-01-19T05:19:02.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa9001640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa40b16d0 con 0x7f6fa40b1120 2024-01-19T05:19:02.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa2d9d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6fa40b3310 0x7f6fa40b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa259c640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6fa40b36f0 0x7f6fa4146390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:56646/0 (socket says 172.21.15.99:56646) 2024-01-19T05:19:02.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa259c640 1 -- 172.21.15.99:0/1471145042 learned_addr learned my addr 172.21.15.99:0/1471145042 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:02.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa359e640 1 --2- 172.21.15.99:0/1471145042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa40b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa359e640 1 -- 172.21.15.99:0/1471145042 >> v2:172.21.15.157:3300/0 conn(0x7f6fa40b3310 msgr2=0x7f6fa40b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa359e640 1 --2- 172.21.15.99:0/1471145042 >> v2:172.21.15.157:3300/0 conn(0x7f6fa40b3310 0x7f6fa40b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa359e640 1 -- 172.21.15.99:0/1471145042 >> v1:172.21.15.157:6789/0 conn(0x7f6fa40b36f0 legacy=0x7f6fa4146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa359e640 1 -- 172.21.15.99:0/1471145042 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa40721c0 con 0x7f6fa40b1120 2024-01-19T05:19:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.476+0000 7f6fa359e640 1 --2- 172.21.15.99:0/1471145042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa40b4330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0097c0 tx=0x7f6f9c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f84e70ffea837ad6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa1d9b640 1 -- 172.21.15.99:0/1471145042 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c0ab600 con 0x7f6fa40b1120 2024-01-19T05:19:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa1d9b640 1 -- 172.21.15.99:0/1471145042 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c0a7050 con 0x7f6fa40b1120 2024-01-19T05:19:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa1d9b640 1 -- 172.21.15.99:0/1471145042 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c0ab980 con 0x7f6fa40b1120 2024-01-19T05:19:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- 172.21.15.99:0/1471145042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 msgr2=0x7f6fa40b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 --2- 172.21.15.99:0/1471145042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa40b4330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0097c0 tx=0x7f6f9c01c3f0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- 172.21.15.99:0/1471145042 shutdown_connections 2024-01-19T05:19:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 --2- 172.21.15.99:0/1471145042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa40b4330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 --2- 172.21.15.99:0/1471145042 >> v2:172.21.15.157:3300/0 conn(0x7f6fa40b3310 0x7f6fa40b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- 172.21.15.99:0/1471145042 >> 172.21.15.99:0/1471145042 conn(0x7f6fa40b8080 msgr2=0x7f6fa40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- 172.21.15.99:0/1471145042 shutdown_connections 2024-01-19T05:19:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- 172.21.15.99:0/1471145042 wait complete. 2024-01-19T05:19:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 Processor -- start 2024-01-19T05:19:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- start start 2024-01-19T05:19:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa413fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa40b3310 0x7f6fa41435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fa40b36f0 0x7f6fa41e07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41381a0 con 0x7f6fa40b3310 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41e0060 con 0x7f6fa40b36f0 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41e0340 con 0x7f6fa40b1120 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa40b3310 0x7f6fa41435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa40b3310 0x7f6fa41435d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47190/0 (socket says 172.21.15.99:47190) 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 -- 172.21.15.99:0/3851329785 learned_addr learned my addr 172.21.15.99:0/3851329785 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa359e640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fa40b36f0 0x7f6fa41e07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa2d9d640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa413fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 -- 172.21.15.99:0/3851329785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 msgr2=0x7f6fa413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa413fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 -- 172.21.15.99:0/3851329785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fa40b36f0 msgr2=0x7f6fa41e07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fa40b36f0 0x7f6fa41e07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 -- 172.21.15.99:0/3851329785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c009420 con 0x7f6fa40b3310 2024-01-19T05:19:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa259c640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa40b3310 0x7f6fa41435d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800c450 tx=0x7f6f9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6f8b7fe640 1 -- 172.21.15.99:0/3851329785 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98005cf0 con 0x7f6fa40b3310 2024-01-19T05:19:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6f8b7fe640 1 -- 172.21.15.99:0/3851329785 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98005e50 con 0x7f6fa40b3310 2024-01-19T05:19:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa40a8600 con 0x7f6fa40b3310 2024-01-19T05:19:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6f8b7fe640 1 -- 172.21.15.99:0/3851329785 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98007290 con 0x7f6fa40b3310 2024-01-19T05:19:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.480+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa40a8990 con 0x7f6fa40b3310 2024-01-19T05:19:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.484+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa4143320 con 0x7f6fa40b3310 2024-01-19T05:19:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.484+0000 7f6f8b7fe640 1 -- 172.21.15.99:0/3851329785 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6f980073f0 con 0x7f6fa40b3310 2024-01-19T05:19:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.484+0000 7f6f8b7fe640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f90066500 0x7f6f900689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.484+0000 7f6f8b7fe640 1 -- 172.21.15.99:0/3851329785 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f98083250 con 0x7f6fa40b3310 2024-01-19T05:19:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.484+0000 7f6fa2d9d640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f90066500 0x7f6f900689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.484+0000 7f6fa2d9d640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f90066500 0x7f6f900689c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6f940074a0 tx=0x7f6f9400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.488+0000 7f6f8b7fe640 1 -- 172.21.15.99:0/3851329785 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6fa4143320 con 0x7f6fa40b3310 2024-01-19T05:19:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.632+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fa41432f0 con 0x7f6fa40b3310 2024-01-19T05:19:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.632+0000 7f6f8b7fe640 1 -- 172.21.15.99:0/3851329785 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f98017020 con 0x7f6fa40b3310 2024-01-19T05:19:02.633 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f90066500 msgr2=0x7f6f900689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f90066500 0x7f6f900689c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6f940074a0 tx=0x7f6f9400b040 comp rx=0 tx=0).stop 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa40b3310 msgr2=0x7f6fa41435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa40b3310 0x7f6fa41435d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800c450 tx=0x7f6f9800c910 comp rx=0 tx=0).stop 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 shutdown_connections 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6f90066500 0x7f6f900689c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6fa40b36f0 0x7f6fa41e07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa40b3310 0x7f6fa41435d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 --2- 172.21.15.99:0/3851329785 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6fa40b1120 0x7f6fa413fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 >> 172.21.15.99:0/3851329785 conn(0x7f6fa40b8080 msgr2=0x7f6fa413c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 shutdown_connections 2024-01-19T05:19:02.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.636+0000 7f6fa9001640 1 -- 172.21.15.99:0/3851329785 wait complete. 2024-01-19T05:19:02.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-19T05:19:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.772+0000 7f8f272af640 1 Processor -- start 2024-01-19T05:19:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.772+0000 7f8f272af640 1 -- start start 2024-01-19T05:19:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f200724f0 0x7f8f2014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2006f070 con 0x7f8f200b19f0 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f20070680 con 0x7f8f2006ebe0 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f20070410 con 0x7f8f200724f0 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f2504b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8f200b19f0 0x7f8f20144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46964/0 (socket says 172.21.15.99:46964) 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f2504b640 1 -- 172.21.15.99:0/1194574798 learned_addr learned my addr 172.21.15.99:0/1194574798 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f2584c640 1 --2- 172.21.15.99:0/1194574798 >> v2:172.21.15.99:3300/0 conn(0x7f8f200724f0 0x7f8f2014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f17fff640 1 -- 172.21.15.99:0/1194574798 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685781225 0 0) 0x7f8f180014a0 con 0x7f8f200b19f0 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f17fff640 1 -- 172.21.15.99:0/1194574798 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f0c003530 con 0x7f8f200b19f0 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f2584c640 1 -- 172.21.15.99:0/1194574798 >> v1:172.21.15.157:6789/0 conn(0x7f8f2006ebe0 legacy=0x7f8f20071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f2584c640 1 -- 172.21.15.99:0/1194574798 >> v1:172.21.15.99:6789/0 conn(0x7f8f200b19f0 legacy=0x7f8f20144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f2584c640 1 -- 172.21.15.99:0/1194574798 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20144790 con 0x7f8f200724f0 2024-01-19T05:19:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f2584c640 1 --2- 172.21.15.99:0/1194574798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200724f0 0x7f8f2014fea0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0097c0 tx=0x7f8f1c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67eaf723469690c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f17fff640 1 -- 172.21.15.99:0/1194574798 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c0ac630 con 0x7f8f200724f0 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f17fff640 1 -- 172.21.15.99:0/1194574798 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c0ac790 con 0x7f8f200724f0 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f17fff640 1 -- 172.21.15.99:0/1194574798 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c0acb20 con 0x7f8f200724f0 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 -- 172.21.15.99:0/1194574798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200724f0 msgr2=0x7f8f2014fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 --2- 172.21.15.99:0/1194574798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200724f0 0x7f8f2014fea0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0097c0 tx=0x7f8f1c01c3b0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 -- 172.21.15.99:0/1194574798 shutdown_connections 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 --2- 172.21.15.99:0/1194574798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200724f0 0x7f8f2014fea0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 -- 172.21.15.99:0/1194574798 >> 172.21.15.99:0/1194574798 conn(0x7f8f200b8080 msgr2=0x7f8f200b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 -- 172.21.15.99:0/1194574798 shutdown_connections 2024-01-19T05:19:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.776+0000 7f8f272af640 1 -- 172.21.15.99:0/1194574798 wait complete. 2024-01-19T05:19:02.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 Processor -- start 2024-01-19T05:19:02.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 -- start start 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f2006ebe0 0x7f8f201e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f200724f0 0x7f8f200b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200b19f0 0x7f8f201ded90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20135170 con 0x7f8f200b19f0 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f200a9340 con 0x7f8f200724f0 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201e2300 con 0x7f8f2006ebe0 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200b19f0 0x7f8f201ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200b19f0 0x7f8f201ded90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47204/0 (socket says 172.21.15.99:47204) 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 -- 172.21.15.99:0/2949034956 learned_addr learned my addr 172.21.15.99:0/2949034956 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2504b640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f2006ebe0 0x7f8f201e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2484a640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f200724f0 0x7f8f200b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 -- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f2006ebe0 msgr2=0x7f8f201e2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f2006ebe0 0x7f8f201e2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 -- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f200724f0 msgr2=0x7f8f200b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f200724f0 0x7f8f200b7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 -- 172.21.15.99:0/2949034956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c009420 con 0x7f8f200b19f0 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2504b640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f2006ebe0 0x7f8f201e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2484a640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f200724f0 0x7f8f200b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f2584c640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200b19f0 0x7f8f201ded90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0af040 tx=0x7f8f1c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f15ffb640 1 -- 172.21.15.99:0/2949034956 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c0b5610 con 0x7f8f200b19f0 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f15ffb640 1 -- 172.21.15.99:0/2949034956 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c0b5770 con 0x7f8f200b19f0 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f201e25e0 con 0x7f8f200b19f0 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f15ffb640 1 -- 172.21.15.99:0/2949034956 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c0b5b00 con 0x7f8f200b19f0 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2013c5f0 con 0x7f8f200b19f0 2024-01-19T05:19:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f200696e0 con 0x7f8f200b19f0 2024-01-19T05:19:02.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.780+0000 7f8f15ffb640 1 -- 172.21.15.99:0/2949034956 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8f1c0b3040 con 0x7f8f200b19f0 2024-01-19T05:19:02.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.784+0000 7f8f15ffb640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8f04066530 0x7f8f040689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:02.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.784+0000 7f8f15ffb640 1 -- 172.21.15.99:0/2949034956 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f1c11dfd0 con 0x7f8f200b19f0 2024-01-19T05:19:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.784+0000 7f8f2504b640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8f04066530 0x7f8f040689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.784+0000 7f8f2504b640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8f04066530 0x7f8f040689f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8f18001600 tx=0x7f8f18009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.788+0000 7f8f15ffb640 1 -- 172.21.15.99:0/2949034956 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8f1c0eb300 con 0x7f8f200b19f0 2024-01-19T05:19:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.944+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f20143330 con 0x7f8f200b19f0 2024-01-19T05:19:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.944+0000 7f8f15ffb640 1 -- 172.21.15.99:0/2949034956 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f1c0ee920 con 0x7f8f200b19f0 2024-01-19T05:19:02.946 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8f04066530 msgr2=0x7f8f040689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8f04066530 0x7f8f040689f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8f18001600 tx=0x7f8f18009040 comp rx=0 tx=0).stop 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200b19f0 msgr2=0x7f8f201ded90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200b19f0 0x7f8f201ded90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0af040 tx=0x7f8f1c019150 comp rx=0 tx=0).stop 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 shutdown_connections 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8f04066530 0x7f8f040689f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f200b19f0 0x7f8f201ded90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f200724f0 0x7f8f200b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 --2- 172.21.15.99:0/2949034956 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8f2006ebe0 0x7f8f201e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 >> 172.21.15.99:0/2949034956 conn(0x7f8f200b8080 msgr2=0x7f8f20138f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 shutdown_connections 2024-01-19T05:19:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:02.948+0000 7f8f272af640 1 -- 172.21.15.99:0/2949034956 wait complete. 2024-01-19T05:19:02.965 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:19:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11fd690640 1 Processor -- start 2024-01-19T05:19:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11fd690640 1 -- start start 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11fd690640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11f80aec10 0x7f11f8144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11fd690640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f11f80b3a10 0x7f11f813cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11fd690640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f8143dc0 con 0x7f11f806ccf0 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11fd690640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f80b3e60 con 0x7f11f80b3a10 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11fd690640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f806d0d0 con 0x7f11f80aec10 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f77fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f11f80b3a10 0x7f11f813cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f6ffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f11f806ccf0 0x7f11f80ae500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46972/0 (socket says 172.21.15.99:46972) 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f6ffd640 1 -- 172.21.15.99:0/3234796763 learned_addr learned my addr 172.21.15.99:0/3234796763 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f67fc640 1 --2- 172.21.15.99:0/3234796763 >> v2:172.21.15.157:3300/0 conn(0x7f11f80aec10 0x7f11f8144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f77fe640 1 -- 172.21.15.99:0/3234796763 >> v2:172.21.15.157:3300/0 conn(0x7f11f80aec10 msgr2=0x7f11f8144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f77fe640 1 --2- 172.21.15.99:0/3234796763 >> v2:172.21.15.157:3300/0 conn(0x7f11f80aec10 0x7f11f8144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f77fe640 1 -- 172.21.15.99:0/3234796763 >> v1:172.21.15.99:6789/0 conn(0x7f11f806ccf0 legacy=0x7f11f80ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f5ffb640 1 -- 172.21.15.99:0/3234796763 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115804350 0 0) 0x7f11f8143dc0 con 0x7f11f806ccf0 2024-01-19T05:19:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.072+0000 7f11f77fe640 1 -- 172.21.15.99:0/3234796763 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8143770 con 0x7f11f80b3a10 2024-01-19T05:19:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f77fe640 1 --2- 172.21.15.99:0/3234796763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f80b3a10 0x7f11f813cfb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f11f806ddd0 tx=0x7f11f001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ef86195edc8978 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f5ffb640 1 -- 172.21.15.99:0/3234796763 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00ac620 con 0x7f11f80b3a10 2024-01-19T05:19:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f5ffb640 1 -- 172.21.15.99:0/3234796763 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f00ac780 con 0x7f11f80b3a10 2024-01-19T05:19:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f5ffb640 1 -- 172.21.15.99:0/3234796763 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00acb10 con 0x7f11f80b3a10 2024-01-19T05:19:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- 172.21.15.99:0/3234796763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f80b3a10 msgr2=0x7f11f813cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 --2- 172.21.15.99:0/3234796763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f80b3a10 0x7f11f813cfb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f11f806ddd0 tx=0x7f11f001c3a0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- 172.21.15.99:0/3234796763 shutdown_connections 2024-01-19T05:19:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 --2- 172.21.15.99:0/3234796763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f80b3a10 0x7f11f813cfb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 --2- 172.21.15.99:0/3234796763 >> v2:172.21.15.157:3300/0 conn(0x7f11f80aec10 0x7f11f8144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- 172.21.15.99:0/3234796763 >> 172.21.15.99:0/3234796763 conn(0x7f11f8066ef0 msgr2=0x7f11f80b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- 172.21.15.99:0/3234796763 shutdown_connections 2024-01-19T05:19:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- 172.21.15.99:0/3234796763 wait complete. 2024-01-19T05:19:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 Processor -- start 2024-01-19T05:19:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- start start 2024-01-19T05:19:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f806ccf0 0x7f11f8138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11f80aec10 0x7f11f8134850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11f80b3a10 0x7f11f8133160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f809b3f0 con 0x7f11f806ccf0 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f809b620 con 0x7f11f80aec10 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f809b900 con 0x7f11f80b3a10 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f806ccf0 0x7f11f8138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f806ccf0 0x7f11f8138850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47212/0 (socket says 172.21.15.99:47212) 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 -- 172.21.15.99:0/3479204065 learned_addr learned my addr 172.21.15.99:0/3479204065 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 -- 172.21.15.99:0/3479204065 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11f80b3a10 msgr2=0x7f11f8133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11f80b3a10 0x7f11f8133160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 -- 172.21.15.99:0/3479204065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11f80aec10 msgr2=0x7f11f8134850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11f80aec10 0x7f11f8134850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 -- 172.21.15.99:0/3479204065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0009420 con 0x7f11f806ccf0 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11f6ffd640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f806ccf0 0x7f11f8138850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f11e80011f0 tx=0x7f11e800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11ef7fe640 1 -- 172.21.15.99:0/3479204065 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80074e0 con 0x7f11f806ccf0 2024-01-19T05:19:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11ef7fe640 1 -- 172.21.15.99:0/3479204065 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8007640 con 0x7f11f806ccf0 2024-01-19T05:19:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f8139020 con 0x7f11f806ccf0 2024-01-19T05:19:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11ef7fe640 1 -- 172.21.15.99:0/3479204065 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8004a10 con 0x7f11f806ccf0 2024-01-19T05:19:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.076+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f81e0550 con 0x7f11f806ccf0 2024-01-19T05:19:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.080+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f80696e0 con 0x7f11f806ccf0 2024-01-19T05:19:03.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.080+0000 7f11ef7fe640 1 -- 172.21.15.99:0/3479204065 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f11e8004b70 con 0x7f11f806ccf0 2024-01-19T05:19:03.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.080+0000 7f11ef7fe640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f11d8066500 0x7f11d80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.080+0000 7f11ef7fe640 1 -- 172.21.15.99:0/3479204065 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11e8083320 con 0x7f11f806ccf0 2024-01-19T05:19:03.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.080+0000 7f11f67fc640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f11d8066500 0x7f11d80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.080+0000 7f11f67fc640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f11d8066500 0x7f11d80689c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f11e00070b0 tx=0x7f11e0007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.084+0000 7f11ef7fe640 1 -- 172.21.15.99:0/3479204065 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f11e8050650 con 0x7f11f806ccf0 2024-01-19T05:19:03.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.260+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11f81345b0 con 0x7f11f806ccf0 2024-01-19T05:19:03.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.260+0000 7f11ef7fe640 1 -- 172.21.15.99:0/3479204065 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3353 (secure 0 0 0) 0x7f11e8018d30 con 0x7f11f806ccf0 2024-01-19T05:19:03.261 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:03.261 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/84065038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":84065038},{"type":"v1","addr":"172.21.15.157:6833","nonce":84065038}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:46.663899+0000","modified":"2024-01-19T05:18:48.672449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/3566081214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3566081214},{"type":"v1","addr":"172.21.15.99:6835","nonce":3566081214}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-19T05:19:03.262 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 13 2024-01-19T05:19:03.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f11d8066500 msgr2=0x7f11d80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f11d8066500 0x7f11d80689c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f11e00070b0 tx=0x7f11e0007040 comp rx=0 tx=0).stop 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f806ccf0 msgr2=0x7f11f8138850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f806ccf0 0x7f11f8138850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f11e80011f0 tx=0x7f11e800c9b0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 shutdown_connections 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f11d8066500 0x7f11d80689c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11f80b3a10 0x7f11f8133160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11f80aec10 0x7f11f8134850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 --2- 172.21.15.99:0/3479204065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f806ccf0 0x7f11f8138850 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 >> 172.21.15.99:0/3479204065 conn(0x7f11f8066ef0 msgr2=0x7f11f8142300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 shutdown_connections 2024-01-19T05:19:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.264+0000 7f11fd690640 1 -- 172.21.15.99:0/3479204065 wait complete. 2024-01-19T05:19:03.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:19:03.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c7824640 1 Processor -- start 2024-01-19T05:19:03.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c7824640 1 -- start start 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c7824640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff4c0140780 0x7ff4c0140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c7824640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c00b87f0 con 0x7ff4c014f1b0 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c7824640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c00b9ad0 con 0x7ff4c00b96f0 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c7824640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c0141120 con 0x7ff4c0140780 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c4dbf640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff4c0140780 0x7ff4c0140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c5dc1640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff4c014f1b0 0x7ff4c01515a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46988/0 (socket says 172.21.15.99:46988) 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c5dc1640 1 -- 172.21.15.99:0/3221689894 learned_addr learned my addr 172.21.15.99:0/3221689894 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c4dbf640 1 -- 172.21.15.99:0/3221689894 >> v1:172.21.15.157:6789/0 conn(0x7ff4c00b96f0 legacy=0x7ff4c00b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c4dbf640 1 -- 172.21.15.99:0/3221689894 >> v1:172.21.15.99:6789/0 conn(0x7ff4c014f1b0 legacy=0x7ff4c01515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c4dbf640 1 -- 172.21.15.99:0/3221689894 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00b81e0 con 0x7ff4c0140780 2024-01-19T05:19:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4b3fff640 1 -- 172.21.15.99:0/3221689894 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006635450 0 0) 0x7ff4c00b87f0 con 0x7ff4c014f1b0 2024-01-19T05:19:03.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4c4dbf640 1 --2- 172.21.15.99:0/3221689894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c0140780 0x7ff4c0140be0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0141260 tx=0x7ff4bc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62614e83bb4fa9ab server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4b3fff640 1 -- 172.21.15.99:0/3221689894 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0ab640 con 0x7ff4c0140780 2024-01-19T05:19:03.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4b3fff640 1 -- 172.21.15.99:0/3221689894 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc0a7070 con 0x7ff4c0140780 2024-01-19T05:19:03.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.392+0000 7ff4b3fff640 1 -- 172.21.15.99:0/3221689894 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0ab9c0 con 0x7ff4c0140780 2024-01-19T05:19:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- 172.21.15.99:0/3221689894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c0140780 msgr2=0x7ff4c0140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 --2- 172.21.15.99:0/3221689894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c0140780 0x7ff4c0140be0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0141260 tx=0x7ff4bc01c440 comp rx=0 tx=0).stop 2024-01-19T05:19:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- 172.21.15.99:0/3221689894 shutdown_connections 2024-01-19T05:19:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 --2- 172.21.15.99:0/3221689894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c0140780 0x7ff4c0140be0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- 172.21.15.99:0/3221689894 >> 172.21.15.99:0/3221689894 conn(0x7ff4c009e600 msgr2=0x7ff4c00b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- 172.21.15.99:0/3221689894 shutdown_connections 2024-01-19T05:19:03.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- 172.21.15.99:0/3221689894 wait complete. 2024-01-19T05:19:03.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 Processor -- start 2024-01-19T05:19:03.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- start start 2024-01-19T05:19:03.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c00b96f0 0x7ff4c0145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4c014f1b0 0x7ff4c009c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4c009f510 0x7ff4c009f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c012fac0 con 0x7ff4c00b96f0 2024-01-19T05:19:03.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c009f120 con 0x7ff4c014f1b0 2024-01-19T05:19:03.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0138ba0 con 0x7ff4c009f510 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c00b96f0 0x7ff4c0145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c00b96f0 0x7ff4c0145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47230/0 (socket says 172.21.15.99:47230) 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 -- 172.21.15.99:0/3843733597 learned_addr learned my addr 172.21.15.99:0/3843733597 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 -- 172.21.15.99:0/3843733597 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4c009f510 msgr2=0x7ff4c009f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4c009f510 0x7ff4c009f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 -- 172.21.15.99:0/3843733597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4c014f1b0 msgr2=0x7ff4c009c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4c014f1b0 0x7ff4c009c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 -- 172.21.15.99:0/3843733597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc009420 con 0x7ff4c00b96f0 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c55c0640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c00b96f0 0x7ff4c0145890 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c490 tx=0x7ff4b4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4b1ffb640 1 -- 172.21.15.99:0/3843733597 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4003600 con 0x7ff4c00b96f0 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4b1ffb640 1 -- 172.21.15.99:0/3843733597 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4003780 con 0x7ff4c00b96f0 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4b1ffb640 1 -- 172.21.15.99:0/3843733597 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4003b70 con 0x7ff4c00b96f0 2024-01-19T05:19:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c0138e60 con 0x7ff4c00b96f0 2024-01-19T05:19:03.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.396+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c00a02e0 con 0x7ff4c00b96f0 2024-01-19T05:19:03.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.400+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c00a0d10 con 0x7ff4c00b96f0 2024-01-19T05:19:03.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.400+0000 7ff4b1ffb640 1 -- 172.21.15.99:0/3843733597 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff4b4003cd0 con 0x7ff4c00b96f0 2024-01-19T05:19:03.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.400+0000 7ff4b1ffb640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff4a4066500 0x7ff4a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.400+0000 7ff4b1ffb640 1 -- 172.21.15.99:0/3843733597 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4b40830a0 con 0x7ff4c00b96f0 2024-01-19T05:19:03.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.400+0000 7ff4c4dbf640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff4a4066500 0x7ff4a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.400+0000 7ff4c4dbf640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff4a4066500 0x7ff4a40689c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0af000 tx=0x7ff4bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.404+0000 7ff4b1ffb640 1 -- 172.21.15.99:0/3843733597 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff4c00a0d10 con 0x7ff4c00b96f0 2024-01-19T05:19:03.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.560+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4c00a0d10 con 0x7ff4c00b96f0 2024-01-19T05:19:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.564+0000 7ff4b1ffb640 1 -- 172.21.15.99:0/3843733597 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16534 (secure 0 0 0) 0x7ff4b40503d0 con 0x7ff4c00b96f0 2024-01-19T05:19:03.566 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:03.566 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:48.330234+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:44.862843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:45.655715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:19:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff4a4066500 msgr2=0x7ff4a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff4a4066500 0x7ff4a40689c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0af000 tx=0x7ff4bc008040 comp rx=0 tx=0).stop 2024-01-19T05:19:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c00b96f0 msgr2=0x7ff4c0145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c00b96f0 0x7ff4c0145890 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c490 tx=0x7ff4b4001e80 comp rx=0 tx=0).stop 2024-01-19T05:19:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 shutdown_connections 2024-01-19T05:19:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7ff4a4066500 0x7ff4a40689c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4c009f510 0x7ff4c009f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4c014f1b0 0x7ff4c009c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 --2- 172.21.15.99:0/3843733597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c00b96f0 0x7ff4c0145890 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 >> 172.21.15.99:0/3843733597 conn(0x7ff4c009e600 msgr2=0x7ff4c00b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 shutdown_connections 2024-01-19T05:19:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.568+0000 7ff4c7824640 1 -- 172.21.15.99:0/3843733597 wait complete. 2024-01-19T05:19:03.584 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T05:19:03.585 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:19:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727b5c1640 1 Processor -- start 2024-01-19T05:19:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727b5c1640 1 -- start start 2024-01-19T05:19:03.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727b5c1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72740b3a70 0x7f7274148370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727b5c1640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740b49d0 con 0x7f7274147f90 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727b5c1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740b2ed0 con 0x7f727406cfc0 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727b5c1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727409b370 con 0x7f72740b3a70 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727935d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7274147f90 0x7f72740b3360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46994/0 (socket says 172.21.15.99:46994) 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727935d640 1 -- 172.21.15.99:0/3737162676 learned_addr learned my addr 172.21.15.99:0/3737162676 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101678034 0 0) 0x7f72740b49d0 con 0x7f7274147f90 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7260003530 con 0x7f7274147f90 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f7279b5e640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72740b3a70 0x7f7274148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4060263996 0 0) 0x7f7260003530 con 0x7f7274147f90 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72740b3a70 msgr2=0x7f7274148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72740b3a70 0x7f7274148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 >> v1:172.21.15.157:6789/0 conn(0x7f727406cfc0 legacy=0x7f7274141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274148a20 con 0x7f7274147f90 2024-01-19T05:19:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f7270001680 con 0x7f7274147f90 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 >> v1:172.21.15.99:6789/0 conn(0x7f7274147f90 legacy=0x7f72740b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72740b3a70 0x7f72600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7260003fe0 0x7f72600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7260005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727409b370 con 0x7f7260004d10 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726000bbd0 con 0x7f7260003fe0 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726000bd90 con 0x7f72740b3a70 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f7279b5e640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7260005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f7278b5c640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7260003fe0 0x7f72600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f727935d640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72740b3a70 0x7f72600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f7279b5e640 1 -- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72740b3a70 msgr2=0x7f72600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f7279b5e640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72740b3a70 0x7f72600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f7279b5e640 1 -- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7260003fe0 msgr2=0x7f72600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f7279b5e640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7260003fe0 0x7f72600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.692+0000 7f7279b5e640 1 -- 172.21.15.99:0/3737162676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7260003530 con 0x7f7260004d10 2024-01-19T05:19:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f7279b5e640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7260005190 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f726c007330 tx=0x7f726c01ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd9b56054c023cc server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0a5bf0 con 0x7f7260004d10 2024-01-19T05:19:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c0a5d50 con 0x7f7260004d10 2024-01-19T05:19:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f726bfff640 1 -- 172.21.15.99:0/3737162676 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0ad680 con 0x7f7260004d10 2024-01-19T05:19:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- 172.21.15.99:0/3737162676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 msgr2=0x7f7260005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 --2- 172.21.15.99:0/3737162676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7260005190 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f726c007330 tx=0x7f726c01ce00 comp rx=0 tx=0).stop 2024-01-19T05:19:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f7279b5e640 1 -- 172.21.15.99:0/3737162676 reap_dead start 2024-01-19T05:19:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- 172.21.15.99:0/3737162676 shutdown_connections 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- 172.21.15.99:0/3737162676 >> 172.21.15.99:0/3737162676 conn(0x7f72740b4dc0 msgr2=0x7f72740b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- 172.21.15.99:0/3737162676 shutdown_connections 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- 172.21.15.99:0/3737162676 wait complete. 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 Processor -- start 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- start start 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7274142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f727409ce20 0x7f72741dd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f727413b5a0 0x7f727413ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727409d2a0 con 0x7f7260004d10 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740b0ce0 con 0x7f727413b5a0 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72741dd790 con 0x7f727409ce20 2024-01-19T05:19:03.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7274142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7274142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47234/0 (socket says 172.21.15.99:47234) 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 -- 172.21.15.99:0/4019684130 learned_addr learned my addr 172.21.15.99:0/4019684130 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f7278b5c640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f727409ce20 0x7f72741dd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f7279b5e640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f727413b5a0 0x7f727413ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 -- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f727409ce20 msgr2=0x7f72741dd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f727409ce20 0x7f72741dd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 -- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f727413b5a0 msgr2=0x7f727413ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f727413b5a0 0x7f727413ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 -- 172.21.15.99:0/4019684130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740b1bd0 con 0x7f7260004d10 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f7279b5e640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f727413b5a0 0x7f727413ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727935d640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7274142830 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7270011930 tx=0x7f7270011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f7269ffb640 1 -- 172.21.15.99:0/4019684130 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727001a030 con 0x7f7260004d10 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f7269ffb640 1 -- 172.21.15.99:0/4019684130 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727000fb20 con 0x7f7260004d10 2024-01-19T05:19:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7274143900 con 0x7f7260004d10 2024-01-19T05:19:03.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f7269ffb640 1 -- 172.21.15.99:0/4019684130 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727000fed0 con 0x7f7260004d10 2024-01-19T05:19:03.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.696+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72740b20d0 con 0x7f7260004d10 2024-01-19T05:19:03.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.700+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72740696e0 con 0x7f7260004d10 2024-01-19T05:19:03.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.700+0000 7f7269ffb640 1 -- 172.21.15.99:0/4019684130 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f727001d070 con 0x7f7260004d10 2024-01-19T05:19:03.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.700+0000 7f7269ffb640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7258066500 0x7f72580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:03.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.700+0000 7f7269ffb640 1 -- 172.21.15.99:0/4019684130 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f727001b070 con 0x7f7260004d10 2024-01-19T05:19:03.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.700+0000 7f7278b5c640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7258066500 0x7f72580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:03.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.700+0000 7f7278b5c640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7258066500 0x7f72580689c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f72740b1650 tx=0x7f7264009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:03.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.704+0000 7f7269ffb640 1 -- 172.21.15.99:0/4019684130 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7270058690 con 0x7f7260004d10 2024-01-19T05:19:03.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72741412c0 con 0x7f7260004d10 2024-01-19T05:19:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f7269ffb640 1 -- 172.21.15.99:0/4019684130 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3353 (secure 0 0 0) 0x7f7270058220 con 0x7f7260004d10 2024-01-19T05:19:03.880 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:03.880 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/84065038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":84065038},{"type":"v1","addr":"172.21.15.157:6833","nonce":84065038}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:46.663899+0000","modified":"2024-01-19T05:18:48.672449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/3566081214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3566081214},{"type":"v1","addr":"172.21.15.99:6835","nonce":3566081214}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-19T05:19:03.880 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 13 2024-01-19T05:19:03.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7258066500 msgr2=0x7f72580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7258066500 0x7f72580689c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f72740b1650 tx=0x7f7264009040 comp rx=0 tx=0).stop 2024-01-19T05:19:03.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 msgr2=0x7f7274142830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:03.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7274142830 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7270011930 tx=0x7f7270011df0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 shutdown_connections 2024-01-19T05:19:03.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f7258066500 0x7f72580689c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f727413b5a0 0x7f727413ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f727409ce20 0x7f72741dd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 --2- 172.21.15.99:0/4019684130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7260004d10 0x7f7274142830 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:03.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 >> 172.21.15.99:0/4019684130 conn(0x7f72740b4dc0 msgr2=0x7f72740999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:03.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 shutdown_connections 2024-01-19T05:19:03.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:03.880+0000 7f727b5c1640 1 -- 172.21.15.99:0/4019684130 wait complete. 2024-01-19T05:19:03.897 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:19:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34ece32640 1 Processor -- start 2024-01-19T05:19:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34ece32640 1 -- start start 2024-01-19T05:19:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34ece32640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f34e80b3310 0x7f34e80b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34ece32640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e80b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34ece32640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f34e80b1120 0x7f34e80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34ece32640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e806ed10 con 0x7f34e80b3310 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34ece32640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80b22b0 con 0x7f34e80b1120 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34ece32640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80b16d0 con 0x7f34e80b36f0 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f34e80b3310 0x7f34e80b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f34e80b3310 0x7f34e80b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47242/0 (socket says 172.21.15.99:47242) 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e659c640 1 -- 172.21.15.99:0/187234722 learned_addr learned my addr 172.21.15.99:0/187234722 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e5d9b640 1 --2- 172.21.15.99:0/187234722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e80b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e6d9d640 1 --2- 172.21.15.99:0/187234722 >> v2:172.21.15.157:3300/0 conn(0x7f34e80b1120 0x7f34e80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e659c640 1 -- 172.21.15.99:0/187234722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 msgr2=0x7f34e80b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e659c640 1 --2- 172.21.15.99:0/187234722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e80b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e659c640 1 -- 172.21.15.99:0/187234722 >> v2:172.21.15.157:3300/0 conn(0x7f34e80b1120 msgr2=0x7f34e80b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e659c640 1 --2- 172.21.15.99:0/187234722 >> v2:172.21.15.157:3300/0 conn(0x7f34e80b1120 0x7f34e80b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e659c640 1 -- 172.21.15.99:0/187234722 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80721c0 con 0x7f34e80b3310 2024-01-19T05:19:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.000+0000 7f34e5d9b640 1 --2- 172.21.15.99:0/187234722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e80b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34e659c640 1 --2- 172.21.15.99:0/187234722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b3310 0x7f34e80b3df0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f34e80b15e0 tx=0x7f34d801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf9672775e3d5ec server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34e559a640 1 -- 172.21.15.99:0/187234722 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80ab650 con 0x7f34e80b3310 2024-01-19T05:19:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34e559a640 1 -- 172.21.15.99:0/187234722 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d80ab7b0 con 0x7f34e80b3310 2024-01-19T05:19:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34e559a640 1 -- 172.21.15.99:0/187234722 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80abb40 con 0x7f34e80b3310 2024-01-19T05:19:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 -- 172.21.15.99:0/187234722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b3310 msgr2=0x7f34e80b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 --2- 172.21.15.99:0/187234722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b3310 0x7f34e80b3df0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f34e80b15e0 tx=0x7f34d801c470 comp rx=0 tx=0).stop 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 -- 172.21.15.99:0/187234722 shutdown_connections 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 --2- 172.21.15.99:0/187234722 >> v2:172.21.15.157:3300/0 conn(0x7f34e80b1120 0x7f34e80b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 --2- 172.21.15.99:0/187234722 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e80b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 --2- 172.21.15.99:0/187234722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b3310 0x7f34e80b3df0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 -- 172.21.15.99:0/187234722 >> 172.21.15.99:0/187234722 conn(0x7f34e80b8080 msgr2=0x7f34e80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 -- 172.21.15.99:0/187234722 shutdown_connections 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.004+0000 7f34ece32640 1 -- 172.21.15.99:0/187234722 wait complete. 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 Processor -- start 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 -- start start 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b1120 0x7f34e80a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34e80b3310 0x7f34e80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e81dcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80a9290 con 0x7f34e80b1120 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80aa0a0 con 0x7f34e80b3310 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80a9480 con 0x7f34e80b36f0 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b1120 0x7f34e80a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b1120 0x7f34e80a8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47252/0 (socket says 172.21.15.99:47252) 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 -- 172.21.15.99:0/1856355671 learned_addr learned my addr 172.21.15.99:0/1856355671 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e6d9d640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e81dcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e5d9b640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34e80b3310 0x7f34e80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 -- 172.21.15.99:0/1856355671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 msgr2=0x7f34e81dcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e81dcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 -- 172.21.15.99:0/1856355671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34e80b3310 msgr2=0x7f34e80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34e80b3310 0x7f34e80a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 -- 172.21.15.99:0/1856355671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80094d0 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34e659c640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b1120 0x7f34e80a8d50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f34d801ab20 tx=0x7f34d801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34d6ffd640 1 -- 172.21.15.99:0/1856355671 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80b4800 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34d6ffd640 1 -- 172.21.15.99:0/1856355671 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d80b4960 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e8140d90 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34d6ffd640 1 -- 172.21.15.99:0/1856355671 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80b4cf0 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e80aa300 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e813fd90 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34d6ffd640 1 -- 172.21.15.99:0/1856355671 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f34d80c7440 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.008+0000 7f34d6ffd640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f34c8066530 0x7f34c80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.012+0000 7f34d6ffd640 1 -- 172.21.15.99:0/1856355671 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34d811eaf0 con 0x7f34e80b1120 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.012+0000 7f34e5d9b640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f34c8066530 0x7f34c80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.012+0000 7f34e5d9b640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f34c8066530 0x7f34c80689f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34e81ddc20 tx=0x7f34dc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.016+0000 7f34d6ffd640 1 -- 172.21.15.99:0/1856355671 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f34d80ebf40 con 0x7f34e80b1120 2024-01-19T05:19:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.196+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34e80696e0 con 0x7f34e80b1120 2024-01-19T05:19:04.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34d6ffd640 1 -- 172.21.15.99:0/1856355671 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3353 (secure 0 0 0) 0x7f34d80ef560 con 0x7f34e80b1120 2024-01-19T05:19:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:04.199 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/84065038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":84065038},{"type":"v1","addr":"172.21.15.157:6833","nonce":84065038}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-19T05:18:46.663899+0000","modified":"2024-01-19T05:18:48.672449+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/3566081214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3566081214},{"type":"v1","addr":"172.21.15.99:6835","nonce":3566081214}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-19T05:19:04.199 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 13 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f34c8066530 msgr2=0x7f34c80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f34c8066530 0x7f34c80689f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34e81ddc20 tx=0x7f34dc008040 comp rx=0 tx=0).stop 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b1120 msgr2=0x7f34e80a8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b1120 0x7f34e80a8d50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f34d801ab20 tx=0x7f34d801acb0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 shutdown_connections 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f34c8066530 0x7f34c80689f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f34e80b36f0 0x7f34e81dcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34e80b3310 0x7f34e80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 --2- 172.21.15.99:0/1856355671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e80b1120 0x7f34e80a8d50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 >> 172.21.15.99:0/1856355671 conn(0x7f34e80b8080 msgr2=0x7f34e80b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 shutdown_connections 2024-01-19T05:19:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.200+0000 7f34ece32640 1 -- 172.21.15.99:0/1856355671 wait complete. 2024-01-19T05:19:04.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:19:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.323+0000 7f0147306640 1 Processor -- start 2024-01-19T05:19:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.323+0000 7f0147306640 1 -- start start 2024-01-19T05:19:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0147306640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f01400b9220 0x7f01400b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0147306640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01401464c0 0x7f0140146950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0147306640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0140140800 con 0x7f014013fcc0 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0147306640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400b29b0 con 0x7f01400b9220 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0147306640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400afda0 con 0x7f01401464c0 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01450a2640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f01400b9220 0x7f01400b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01450a2640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f01400b9220 0x7f01400b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47266/0 (socket says 172.21.15.99:47266) 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01450a2640 1 -- 172.21.15.99:0/473804869 learned_addr learned my addr 172.21.15.99:0/473804869 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01458a3640 1 --1- 172.21.15.99:0/473804869 >> v1:172.21.15.99:6789/0 conn(0x7f014013fcc0 0x7f01401400f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46996/0 (socket says 172.21.15.99:46996) 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01448a1640 1 --2- 172.21.15.99:0/473804869 >> v2:172.21.15.157:3300/0 conn(0x7f01401464c0 0x7f0140146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01450a2640 1 -- 172.21.15.99:0/473804869 >> v2:172.21.15.157:3300/0 conn(0x7f01401464c0 msgr2=0x7f0140146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01450a2640 1 --2- 172.21.15.99:0/473804869 >> v2:172.21.15.157:3300/0 conn(0x7f01401464c0 0x7f0140146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01450a2640 1 -- 172.21.15.99:0/473804869 >> v1:172.21.15.99:6789/0 conn(0x7f014013fcc0 legacy=0x7f01401400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0137fff640 1 -- 172.21.15.99:0/473804869 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320629418 0 0) 0x7f0140140800 con 0x7f014013fcc0 2024-01-19T05:19:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01450a2640 1 -- 172.21.15.99:0/473804869 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140146e90 con 0x7f01400b9220 2024-01-19T05:19:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f01450a2640 1 --2- 172.21.15.99:0/473804869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01400b9220 0x7f01400b1540 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f01400afbb0 tx=0x7f013c01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1697bc422fbfb1 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0137fff640 1 -- 172.21.15.99:0/473804869 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00b2d0 con 0x7f01400b9220 2024-01-19T05:19:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0137fff640 1 -- 172.21.15.99:0/473804869 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00b430 con 0x7f01400b9220 2024-01-19T05:19:04.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0137fff640 1 -- 172.21.15.99:0/473804869 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0a7bb0 con 0x7f01400b9220 2024-01-19T05:19:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0147306640 1 -- 172.21.15.99:0/473804869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01400b9220 msgr2=0x7f01400b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.327+0000 7f0147306640 1 --2- 172.21.15.99:0/473804869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01400b9220 0x7f01400b1540 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f01400afbb0 tx=0x7f013c01eb40 comp rx=0 tx=0).stop 2024-01-19T05:19:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- 172.21.15.99:0/473804869 shutdown_connections 2024-01-19T05:19:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 --2- 172.21.15.99:0/473804869 >> v2:172.21.15.157:3300/0 conn(0x7f01401464c0 0x7f0140146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 --2- 172.21.15.99:0/473804869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01400b9220 0x7f01400b1540 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- 172.21.15.99:0/473804869 >> 172.21.15.99:0/473804869 conn(0x7f014006adf0 msgr2=0x7f01400b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- 172.21.15.99:0/473804869 shutdown_connections 2024-01-19T05:19:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- 172.21.15.99:0/473804869 wait complete. 2024-01-19T05:19:04.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 Processor -- start 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- start start 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01400b9220 0x7f01401458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f014013fcc0 0x7f014006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01401464c0 0x7f014013c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014013bc30 con 0x7f01401464c0 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140070210 con 0x7f01400b9220 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140070490 con 0x7f014013fcc0 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01401464c0 0x7f014013c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01401464c0 0x7f014013c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47272/0 (socket says 172.21.15.99:47272) 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 -- 172.21.15.99:0/1976316106 learned_addr learned my addr 172.21.15.99:0/1976316106 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01450a2640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01400b9220 0x7f01401458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 -- 172.21.15.99:0/1976316106 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f014013fcc0 msgr2=0x7f014006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f014013fcc0 0x7f014006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 -- 172.21.15.99:0/1976316106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01400b9220 msgr2=0x7f01401458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01400b9220 0x7f01401458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 -- 172.21.15.99:0/1976316106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c00bd40 con 0x7f01401464c0 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01450a2640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01400b9220 0x7f01401458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f01458a3640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01401464c0 0x7f014013c9f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f013800c4a0 tx=0x7f013800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0135ffb640 1 -- 172.21.15.99:0/1976316106 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01380074e0 con 0x7f01401464c0 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0135ffb640 1 -- 172.21.15.99:0/1976316106 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138007640 con 0x7f01401464c0 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140070770 con 0x7f01401464c0 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0135ffb640 1 -- 172.21.15.99:0/1976316106 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138004a30 con 0x7f01401464c0 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014013e290 con 0x7f01401464c0 2024-01-19T05:19:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01400696e0 con 0x7f01401464c0 2024-01-19T05:19:04.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.331+0000 7f0135ffb640 1 -- 172.21.15.99:0/1976316106 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0138004b90 con 0x7f01401464c0 2024-01-19T05:19:04.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.335+0000 7f0135ffb640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0124066500 0x7f01240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.335+0000 7f0135ffb640 1 -- 172.21.15.99:0/1976316106 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01380833b0 con 0x7f01401464c0 2024-01-19T05:19:04.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.335+0000 7f01450a2640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0124066500 0x7f01240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.335+0000 7f01450a2640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0124066500 0x7f01240689c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f013c0b0000 tx=0x7f013c0a9070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.339+0000 7f0135ffb640 1 -- 172.21.15.99:0/1976316106 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0138050680 con 0x7f01401464c0 2024-01-19T05:19:04.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.483+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01400b0670 con 0x7f01401464c0 2024-01-19T05:19:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0135ffb640 1 -- 172.21.15.99:0/1976316106 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f0138053ca0 con 0x7f01401464c0 2024-01-19T05:19:04.488 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:04.488 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:18:48.330234+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-19T05:18:44.862843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-19T05:18:45.655715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0124066500 msgr2=0x7f01240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0124066500 0x7f01240689c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f013c0b0000 tx=0x7f013c0a9070 comp rx=0 tx=0).stop 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01401464c0 msgr2=0x7f014013c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01401464c0 0x7f014013c9f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f013800c4a0 tx=0x7f013800c960 comp rx=0 tx=0).stop 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 shutdown_connections 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0124066500 0x7f01240689c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01401464c0 0x7f014013c9f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f014013fcc0 0x7f014006fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 --2- 172.21.15.99:0/1976316106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01400b9220 0x7f01401458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 >> 172.21.15.99:0/1976316106 conn(0x7f014006adf0 msgr2=0x7f014013edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:04.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 shutdown_connections 2024-01-19T05:19:04.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.487+0000 7f0147306640 1 -- 172.21.15.99:0/1976316106 wait complete. 2024-01-19T05:19:04.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-19T05:19:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d9226640 1 Processor -- start 2024-01-19T05:19:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d9226640 1 -- start start 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d9226640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 0x7fa8d40b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d9226640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa8d4146c20 0x7fa8d41470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d9226640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d41475e0 con 0x7fa8d406ab40 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d9226640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d406b500 con 0x7fa8d4146c20 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d9226640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4141120 con 0x7fa8d409b420 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d2d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa8d406ab40 0x7fa8d409ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47006/0 (socket says 172.21.15.99:47006) 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d2d9d640 1 -- 172.21.15.99:0/1037580064 learned_addr learned my addr 172.21.15.99:0/1037580064 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8412382 0 0) 0x7fa8d41475e0 con 0x7fa8d406ab40 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d359e640 1 --2- 172.21.15.99:0/1037580064 >> v2:172.21.15.157:3300/0 conn(0x7fa8d4146c20 0x7fa8d41470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d259c640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 0x7fa8d40b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8bc003530 con 0x7fa8d406ab40 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1345395413 0 0) 0x7fa8bc003530 con 0x7fa8d406ab40 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 msgr2=0x7fa8d40b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 0x7fa8d40b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 >> v2:172.21.15.157:3300/0 conn(0x7fa8d4146c20 msgr2=0x7fa8d41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 --2- 172.21.15.99:0/1037580064 >> v2:172.21.15.157:3300/0 conn(0x7fa8d4146c20 0x7fa8d41470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d406af20 con 0x7fa8d406ab40 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fa8c4001680 con 0x7fa8d406ab40 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 >> v1:172.21.15.99:6789/0 conn(0x7fa8d406ab40 legacy=0x7fa8d409ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc003980 0x7fa8bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 0x7fa8bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc004d10 0x7fa8bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4141120 con 0x7fa8bc004d10 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc00ba40 con 0x7fa8bc003980 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc00bb80 con 0x7fa8d409b420 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d359e640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc004d10 0x7fa8bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d2d9d640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc003980 0x7fa8bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d259c640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 0x7fa8bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d359e640 1 -- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 msgr2=0x7fa8bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d359e640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 0x7fa8bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d359e640 1 -- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc003980 msgr2=0x7fa8bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d359e640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc003980 0x7fa8bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d359e640 1 -- 172.21.15.99:0/1037580064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc003530 con 0x7fa8bc004d10 2024-01-19T05:19:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.611+0000 7fa8d259c640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d409b420 0x7fa8bc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:04.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d2d9d640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc003980 0x7fa8bc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:04.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d359e640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc004d10 0x7fa8bc005190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007390 tx=0x7fa8cc01ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1341f98e5618d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0a5d60 con 0x7fa8bc004d10 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc0ad440 con 0x7fa8bc004d10 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d1d9b640 1 -- 172.21.15.99:0/1037580064 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0ad7d0 con 0x7fa8bc004d10 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d9226640 1 -- 172.21.15.99:0/1037580064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc004d10 msgr2=0x7fa8bc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d9226640 1 --2- 172.21.15.99:0/1037580064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc004d10 0x7fa8bc005190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007390 tx=0x7fa8cc01ce60 comp rx=0 tx=0).stop 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d359e640 1 -- 172.21.15.99:0/1037580064 reap_dead start 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d9226640 1 -- 172.21.15.99:0/1037580064 shutdown_connections 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d9226640 1 -- 172.21.15.99:0/1037580064 >> 172.21.15.99:0/1037580064 conn(0x7fa8d40b8e80 msgr2=0x7fa8d40b9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d9226640 1 -- 172.21.15.99:0/1037580064 shutdown_connections 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d9226640 1 -- 172.21.15.99:0/1037580064 wait complete. 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d9226640 1 Processor -- start 2024-01-19T05:19:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.615+0000 7fa8d9226640 1 -- start start 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc004d10 0x7fa8d409f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d41deca0 0x7fa8d41df120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d413e320 0x7fa8d413e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d409fc40 con 0x7fa8d413e320 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d41df660 con 0x7fa8bc004d10 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40a1870 con 0x7fa8d41deca0 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d413e320 0x7fa8d413e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d413e320 0x7fa8d413e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47296/0 (socket says 172.21.15.99:47296) 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 -- 172.21.15.99:0/1206565996 learned_addr learned my addr 172.21.15.99:0/1206565996 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d2d9d640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc004d10 0x7fa8d409f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d259c640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d41deca0 0x7fa8d41df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 -- 172.21.15.99:0/1206565996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d41deca0 msgr2=0x7fa8d41df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d41deca0 0x7fa8d41df120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 -- 172.21.15.99:0/1206565996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc004d10 msgr2=0x7fa8d409f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc004d10 0x7fa8d409f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 -- 172.21.15.99:0/1206565996 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d409fe90 con 0x7fa8d413e320 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d359e640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d413e320 0x7fa8d413e7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007390 tx=0x7fa8bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8bb7fe640 1 -- 172.21.15.99:0/1206565996 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0adc70 con 0x7fa8d413e320 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8bb7fe640 1 -- 172.21.15.99:0/1206565996 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc0addd0 con 0x7fa8d413e320 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d40a0170 con 0x7fa8d413e320 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8bb7fe640 1 -- 172.21.15.99:0/1206565996 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0b6650 con 0x7fa8d413e320 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d40a1590 con 0x7fa8d413e320 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d40696e0 con 0x7fa8d413e320 2024-01-19T05:19:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8bb7fe640 1 -- 172.21.15.99:0/1206565996 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa8cc0b4040 con 0x7fa8d413e320 2024-01-19T05:19:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8bb7fe640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8c0066500 0x7fa8c00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8bb7fe640 1 -- 172.21.15.99:0/1206565996 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8cc11e6a0 con 0x7fa8d413e320 2024-01-19T05:19:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d2d9d640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8c0066500 0x7fa8c00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.619+0000 7fa8d2d9d640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8c0066500 0x7fa8c00689c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40017b0 tx=0x7fa8c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.623+0000 7fa8bb7fe640 1 -- 172.21.15.99:0/1206565996 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa8cc0eb9d0 con 0x7fa8d413e320 2024-01-19T05:19:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.799+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa8d40a0620 con 0x7fa8d413e320 2024-01-19T05:19:04.801 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-01-19T05:19:04.799+0000 7efe6f296640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-19T05:19:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.803+0000 7fa8bb7fe640 1 -- 172.21.15.99:0/1206565996 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa8cc0eeff0 con 0x7fa8d413e320 2024-01-19T05:19:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8c0066500 msgr2=0x7fa8c00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8c0066500 0x7fa8c00689c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40017b0 tx=0x7fa8c4009040 comp rx=0 tx=0).stop 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d413e320 msgr2=0x7fa8d413e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d413e320 0x7fa8d413e7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007390 tx=0x7fa8bc005800 comp rx=0 tx=0).stop 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 shutdown_connections 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8c0066500 0x7fa8c00689c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d413e320 0x7fa8d413e7a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d41deca0 0x7fa8d41df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 --2- 172.21.15.99:0/1206565996 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8bc004d10 0x7fa8d409f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 >> 172.21.15.99:0/1206565996 conn(0x7fa8d40b8e80 msgr2=0x7fa8d4144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 shutdown_connections 2024-01-19T05:19:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.807+0000 7fa8d9226640 1 -- 172.21.15.99:0/1206565996 wait complete. 2024-01-19T05:19:04.813 INFO:tasks.ceph.mds.a.smithi099.stderr: -2279> 2024-01-19T05:18:51.152+0000 7f0621130640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-19T05:19:04.825 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-19T05:19:04.852 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-01-19T05:19:04.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef8bbb640 1 Processor -- start 2024-01-19T05:19:04.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef8bbb640 1 -- start start 2024-01-19T05:19:04.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef8bbb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcef40b3310 0x7fcef40b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef8bbb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcef40b36f0 0x7fcef40b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef8bbb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef406ed10 con 0x7fcef40b1120 2024-01-19T05:19:04.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef8bbb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40b22b0 con 0x7fcef40b3310 2024-01-19T05:19:04.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef8bbb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40b16d0 con 0x7fcef40b36f0 2024-01-19T05:19:04.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef259c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcef40b3310 0x7fcef40b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef259c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcef40b3310 0x7fcef40b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47328/0 (socket says 172.21.15.99:47328) 2024-01-19T05:19:04.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef259c640 1 -- 172.21.15.99:0/1312760644 learned_addr learned my addr 172.21.15.99:0/1312760644 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:04.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fceebfff640 1 --2- 172.21.15.99:0/1312760644 >> v2:172.21.15.157:3300/0 conn(0x7fcef40b36f0 0x7fcef40b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef259c640 1 -- 172.21.15.99:0/1312760644 >> v2:172.21.15.157:3300/0 conn(0x7fcef40b36f0 msgr2=0x7fcef40b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef259c640 1 --2- 172.21.15.99:0/1312760644 >> v2:172.21.15.157:3300/0 conn(0x7fcef40b36f0 0x7fcef40b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef259c640 1 -- 172.21.15.99:0/1312760644 >> v1:172.21.15.157:6789/0 conn(0x7fcef40b1120 legacy=0x7fcef4146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:04.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef259c640 1 -- 172.21.15.99:0/1312760644 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef40721c0 con 0x7fcef40b3310 2024-01-19T05:19:04.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.939+0000 7fcef259c640 1 --2- 172.21.15.99:0/1312760644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b3310 0x7fcef40b3df0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcef40b3c60 tx=0x7fcee401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c20ddc2d2fd3ea6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef1d9b640 1 -- 172.21.15.99:0/1312760644 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40ab600 con 0x7fcef40b3310 2024-01-19T05:19:04.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef1d9b640 1 -- 172.21.15.99:0/1312760644 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee40a7050 con 0x7fcef40b3310 2024-01-19T05:19:04.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef1d9b640 1 -- 172.21.15.99:0/1312760644 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40ab980 con 0x7fcef40b3310 2024-01-19T05:19:04.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- 172.21.15.99:0/1312760644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b3310 msgr2=0x7fcef40b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/1312760644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b3310 0x7fcef40b3df0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcef40b3c60 tx=0x7fcee401c3a0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- 172.21.15.99:0/1312760644 shutdown_connections 2024-01-19T05:19:04.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/1312760644 >> v2:172.21.15.157:3300/0 conn(0x7fcef40b36f0 0x7fcef40b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/1312760644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b3310 0x7fcef40b3df0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- 172.21.15.99:0/1312760644 >> 172.21.15.99:0/1312760644 conn(0x7fcef40b8080 msgr2=0x7fcef40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:04.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- 172.21.15.99:0/1312760644 shutdown_connections 2024-01-19T05:19:04.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- 172.21.15.99:0/1312760644 wait complete. 2024-01-19T05:19:04.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 Processor -- start 2024-01-19T05:19:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- start start 2024-01-19T05:19:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b1120 0x7fcef413ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcef40b3310 0x7fcef41dac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcef40b36f0 0x7fcef4143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef413b040 con 0x7fcef40b1120 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef41de190 con 0x7fcef40b3310 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef41de750 con 0x7fcef40b36f0 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b1120 0x7fcef413ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b1120 0x7fcef413ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47342/0 (socket says 172.21.15.99:47342) 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 -- 172.21.15.99:0/86971973 learned_addr learned my addr 172.21.15.99:0/86971973 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 -- 172.21.15.99:0/86971973 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcef40b36f0 msgr2=0x7fcef4143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcef40b36f0 0x7fcef4143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 -- 172.21.15.99:0/86971973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcef40b3310 msgr2=0x7fcef41dac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcef40b3310 0x7fcef41dac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 -- 172.21.15.99:0/86971973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40094d0 con 0x7fcef40b1120 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef259c640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b1120 0x7fcef413ccf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcee40ae040 tx=0x7fcee401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fceeaffd640 1 -- 172.21.15.99:0/86971973 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40b6620 con 0x7fcef40b1120 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fceeaffd640 1 -- 172.21.15.99:0/86971973 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee40b67a0 con 0x7fcef40b1120 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef414d6b0 con 0x7fcef40b1120 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fceeaffd640 1 -- 172.21.15.99:0/86971973 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40b6b50 con 0x7fcef40b1120 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.943+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef41de3e0 con 0x7fcef40b1120 2024-01-19T05:19:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.947+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef40696e0 con 0x7fcef40b1120 2024-01-19T05:19:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.947+0000 7fceeaffd640 1 -- 172.21.15.99:0/86971973 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcee40b2040 con 0x7fcef40b1120 2024-01-19T05:19:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.947+0000 7fceeaffd640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fced4066530 0x7fced40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.947+0000 7fceeaffd640 1 -- 172.21.15.99:0/86971973 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcee411e220 con 0x7fcef40b1120 2024-01-19T05:19:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.947+0000 7fceebfff640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fced4066530 0x7fced40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.947+0000 7fceebfff640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fced4066530 0x7fced40689f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcef41409c0 tx=0x7fcedc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:04.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:04.951+0000 7fceeaffd640 1 -- 172.21.15.99:0/86971973 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcee40eb610 con 0x7fcef40b1120 2024-01-19T05:19:05.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.131+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcef41465a0 con 0x7fcef40b1120 2024-01-19T05:19:05.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:19:05.477 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:19:05.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.807+0000 7fceeaffd640 1 -- 172.21.15.99:0/86971973 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcee40eec30 con 0x7fcef40b1120 2024-01-19T05:19:05.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fced4066530 msgr2=0x7fced40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:05.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fced4066530 0x7fced40689f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcef41409c0 tx=0x7fcedc008040 comp rx=0 tx=0).stop 2024-01-19T05:19:05.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b1120 msgr2=0x7fcef413ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:05.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b1120 0x7fcef413ccf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcee40ae040 tx=0x7fcee401abe0 comp rx=0 tx=0).stop 2024-01-19T05:19:05.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 shutdown_connections 2024-01-19T05:19:05.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fced4066530 0x7fced40689f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:05.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcef40b36f0 0x7fcef4143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:05.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcef40b3310 0x7fcef41dac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:05.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 --2- 172.21.15.99:0/86971973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef40b1120 0x7fcef413ccf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:05.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 >> 172.21.15.99:0/86971973 conn(0x7fcef40b8080 msgr2=0x7fcef40b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:05.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 shutdown_connections 2024-01-19T05:19:05.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.811+0000 7fcef8bbb640 1 -- 172.21.15.99:0/86971973 wait complete. 2024-01-19T05:19:05.833 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-19T05:19:06.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.999+0000 7f12edbae640 1 Processor -- start 2024-01-19T05:19:06.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.999+0000 7f12edbae640 1 -- start start 2024-01-19T05:19:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.999+0000 7f12edbae640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12e806ebe0 0x7f12e8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.999+0000 7f12edbae640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.999+0000 7f12edbae640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e806f070 con 0x7f12e80b19f0 2024-01-19T05:19:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.999+0000 7f12edbae640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e8070680 con 0x7f12e806ebe0 2024-01-19T05:19:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:05.999+0000 7f12edbae640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8070410 con 0x7f12e8072320 2024-01-19T05:19:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e77fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f12e80b19f0 0x7f12e8144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47034/0 (socket says 172.21.15.99:47034) 2024-01-19T05:19:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e77fe640 1 -- 172.21.15.99:0/2891693345 learned_addr learned my addr 172.21.15.99:0/2891693345 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:06.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e6ffd640 1 --2- 172.21.15.99:0/2891693345 >> v2:172.21.15.99:3300/0 conn(0x7f12e806ebe0 0x7f12e8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e7fff640 1 --2- 172.21.15.99:0/2891693345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e67fc640 1 -- 172.21.15.99:0/2891693345 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950011424 0 0) 0x7f12d8001120 con 0x7f12e80b19f0 2024-01-19T05:19:06.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e67fc640 1 -- 172.21.15.99:0/2891693345 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d0003530 con 0x7f12e80b19f0 2024-01-19T05:19:06.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e6ffd640 1 -- 172.21.15.99:0/2891693345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 msgr2=0x7f12e814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:06.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e6ffd640 1 --2- 172.21.15.99:0/2891693345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e814ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e6ffd640 1 -- 172.21.15.99:0/2891693345 >> v1:172.21.15.99:6789/0 conn(0x7f12e80b19f0 legacy=0x7f12e8144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e6ffd640 1 -- 172.21.15.99:0/2891693345 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8144790 con 0x7f12e806ebe0 2024-01-19T05:19:06.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e6ffd640 1 --2- 172.21.15.99:0/2891693345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e806ebe0 0x7f12e8071de0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0097c0 tx=0x7f12dc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e014109f0a9348 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:06.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e67fc640 1 -- 172.21.15.99:0/2891693345 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0ac640 con 0x7f12e806ebe0 2024-01-19T05:19:06.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e67fc640 1 -- 172.21.15.99:0/2891693345 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc0ac7a0 con 0x7f12e806ebe0 2024-01-19T05:19:06.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.003+0000 7f12e67fc640 1 -- 172.21.15.99:0/2891693345 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0acb30 con 0x7f12e806ebe0 2024-01-19T05:19:06.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- 172.21.15.99:0/2891693345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e806ebe0 msgr2=0x7f12e8071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 --2- 172.21.15.99:0/2891693345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e806ebe0 0x7f12e8071de0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0097c0 tx=0x7f12dc01c3c0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- 172.21.15.99:0/2891693345 shutdown_connections 2024-01-19T05:19:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 --2- 172.21.15.99:0/2891693345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 --2- 172.21.15.99:0/2891693345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e806ebe0 0x7f12e8071de0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- 172.21.15.99:0/2891693345 >> 172.21.15.99:0/2891693345 conn(0x7f12e80b8080 msgr2=0x7f12e80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- 172.21.15.99:0/2891693345 shutdown_connections 2024-01-19T05:19:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- 172.21.15.99:0/2891693345 wait complete. 2024-01-19T05:19:06.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 Processor -- start 2024-01-19T05:19:06.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- start start 2024-01-19T05:19:06.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12e806ebe0 0x7f12e80ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e8131bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e80b19f0 0x7f12e812f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80b7320 con 0x7f12e80b19f0 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80b6560 con 0x7f12e806ebe0 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80b6840 con 0x7f12e8072320 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e80b19f0 0x7f12e812f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e80b19f0 0x7f12e812f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47364/0 (socket says 172.21.15.99:47364) 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 -- 172.21.15.99:0/652574202 learned_addr learned my addr 172.21.15.99:0/652574202 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e77fe640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12e806ebe0 0x7f12e80ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e6ffd640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e8131bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 -- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 msgr2=0x7f12e8131bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e8131bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 -- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12e806ebe0 msgr2=0x7f12e80ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12e806ebe0 0x7f12e80ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 -- 172.21.15.99:0/652574202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc009420 con 0x7f12e80b19f0 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e77fe640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12e806ebe0 0x7f12e80ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:06.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e6ffd640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e8131bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:06.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12e7fff640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e80b19f0 0x7f12e812f110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f12e0007e40 tx=0x7f12e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:06.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12cffff640 1 -- 172.21.15.99:0/652574202 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0014620 con 0x7f12e80b19f0 2024-01-19T05:19:06.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12cffff640 1 -- 172.21.15.99:0/652574202 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e000ee90 con 0x7f12e80b19f0 2024-01-19T05:19:06.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e80b6b20 con 0x7f12e80b19f0 2024-01-19T05:19:06.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12cffff640 1 -- 172.21.15.99:0/652574202 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00149e0 con 0x7f12e80b19f0 2024-01-19T05:19:06.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e80b60d0 con 0x7f12e80b19f0 2024-01-19T05:19:06.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.007+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e80696e0 con 0x7f12e80b19f0 2024-01-19T05:19:06.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.011+0000 7f12cffff640 1 -- 172.21.15.99:0/652574202 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f12e0014b40 con 0x7f12e80b19f0 2024-01-19T05:19:06.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.011+0000 7f12cffff640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f12d4066500 0x7f12d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.011+0000 7f12cffff640 1 -- 172.21.15.99:0/652574202 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f12e0084870 con 0x7f12e80b19f0 2024-01-19T05:19:06.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.011+0000 7f12e77fe640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f12d4066500 0x7f12d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.011+0000 7f12e77fe640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f12d4066500 0x7f12d40689c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f12d8007fd0 tx=0x7f12d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:06.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.015+0000 7f12cffff640 1 -- 172.21.15.99:0/652574202 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f12e0051b40 con 0x7f12e80b19f0 2024-01-19T05:19:06.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.159+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f12e81443d0 con 0x7f12e80b19f0 2024-01-19T05:19:06.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.815+0000 7f12cffff640 1 -- 172.21.15.99:0/652574202 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f12e0055160 con 0x7f12e80b19f0 2024-01-19T05:19:06.818 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-01-19T05:19:06.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.819+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f12d4066500 msgr2=0x7f12d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.819+0000 7f12edbae640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f12d4066500 0x7f12d40689c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f12d8007fd0 tx=0x7f12d8009040 comp rx=0 tx=0).stop 2024-01-19T05:19:06.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.819+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e80b19f0 msgr2=0x7f12e812f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.819+0000 7f12edbae640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e80b19f0 0x7f12e812f110 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f12e0007e40 tx=0x7f12e000e4b0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.823+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 shutdown_connections 2024-01-19T05:19:06.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.823+0000 7f12edbae640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f12d4066500 0x7f12d40689c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.823+0000 7f12edbae640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e80b19f0 0x7f12e812f110 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.823+0000 7f12edbae640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12e8072320 0x7f12e8131bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.823+0000 7f12edbae640 1 --2- 172.21.15.99:0/652574202 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12e806ebe0 0x7f12e80ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.823+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 >> 172.21.15.99:0/652574202 conn(0x7f12e80b8080 msgr2=0x7f12e81425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:06.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.823+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 shutdown_connections 2024-01-19T05:19:06.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.823+0000 7f12edbae640 1 -- 172.21.15.99:0/652574202 wait complete. 2024-01-19T05:19:06.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-19T05:19:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.963+0000 7f5949b2f640 1 Processor -- start 2024-01-19T05:19:06.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5949b2f640 1 -- start start 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5949b2f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59440b1870 0x7f5944143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5949b2f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944144000 0x7f594414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5949b2f640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59441444b0 con 0x7f59440b2ce0 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5949b2f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5944141000 con 0x7f59440b1870 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5949b2f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594406f620 con 0x7f5944144000 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5942ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59440b1870 0x7f5944143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f59437fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f59440b2ce0 0x7f5944071f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47046/0 (socket says 172.21.15.99:47046) 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f59437fe640 1 -- 172.21.15.99:0/3392464193 learned_addr learned my addr 172.21.15.99:0/3392464193 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5943fff640 1 --2- 172.21.15.99:0/3392464193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944144000 0x7f594414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5942ffd640 1 -- 172.21.15.99:0/3392464193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944144000 msgr2=0x7f594414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5942ffd640 1 --2- 172.21.15.99:0/3392464193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944144000 0x7f594414dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5942ffd640 1 -- 172.21.15.99:0/3392464193 >> v1:172.21.15.99:6789/0 conn(0x7f59440b2ce0 legacy=0x7f5944071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5942ffd640 1 -- 172.21.15.99:0/3392464193 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944143610 con 0x7f59440b1870 2024-01-19T05:19:06.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f59427fc640 1 -- 172.21.15.99:0/3392464193 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679009121 0 0) 0x7f59441444b0 con 0x7f59440b2ce0 2024-01-19T05:19:06.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f5942ffd640 1 --2- 172.21.15.99:0/3392464193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b1870 0x7f5944143ac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59380097c0 tx=0x7f593801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bc9f97fa35fe6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:06.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f59427fc640 1 -- 172.21.15.99:0/3392464193 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59380ab680 con 0x7f59440b1870 2024-01-19T05:19:06.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f59427fc640 1 -- 172.21.15.99:0/3392464193 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59380ab7e0 con 0x7f59440b1870 2024-01-19T05:19:06.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.967+0000 7f59427fc640 1 -- 172.21.15.99:0/3392464193 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59380abb70 con 0x7f59440b1870 2024-01-19T05:19:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- 172.21.15.99:0/3392464193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b1870 msgr2=0x7f5944143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 --2- 172.21.15.99:0/3392464193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b1870 0x7f5944143ac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59380097c0 tx=0x7f593801c480 comp rx=0 tx=0).stop 2024-01-19T05:19:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- 172.21.15.99:0/3392464193 shutdown_connections 2024-01-19T05:19:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 --2- 172.21.15.99:0/3392464193 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944144000 0x7f594414dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 --2- 172.21.15.99:0/3392464193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b1870 0x7f5944143ac0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- 172.21.15.99:0/3392464193 >> 172.21.15.99:0/3392464193 conn(0x7f59440b8080 msgr2=0x7f59440b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- 172.21.15.99:0/3392464193 shutdown_connections 2024-01-19T05:19:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- 172.21.15.99:0/3392464193 wait complete. 2024-01-19T05:19:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 Processor -- start 2024-01-19T05:19:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- start start 2024-01-19T05:19:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b2ce0 0x7f59441e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5944144000 0x7f5944071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944071f40 0x7f5944139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59441e0230 con 0x7f59440b2ce0 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59441dff00 con 0x7f5944144000 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5944070fa0 con 0x7f5944071f40 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b2ce0 0x7f59441e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b2ce0 0x7f59441e06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47396/0 (socket says 172.21.15.99:47396) 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 -- 172.21.15.99:0/1115863686 learned_addr learned my addr 172.21.15.99:0/1115863686 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5942ffd640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5944144000 0x7f5944071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5943fff640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944071f40 0x7f5944139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 -- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944071f40 msgr2=0x7f5944139be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944071f40 0x7f5944139be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 -- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5944144000 msgr2=0x7f5944071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5944144000 0x7f5944071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:06.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 -- 172.21.15.99:0/1115863686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009420 con 0x7f59440b2ce0 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5942ffd640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5944144000 0x7f5944071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f59437fe640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b2ce0 0x7f59441e06c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f59340011f0 tx=0x7f593400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f592bfff640 1 -- 172.21.15.99:0/1115863686 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59340074e0 con 0x7f59440b2ce0 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f592bfff640 1 -- 172.21.15.99:0/1115863686 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5934007640 con 0x7f59440b2ce0 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594413afe0 con 0x7f59440b2ce0 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f592bfff640 1 -- 172.21.15.99:0/1115863686 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934004a10 con 0x7f59440b2ce0 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594413c910 con 0x7f59440b2ce0 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.971+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594413ae40 con 0x7f59440b2ce0 2024-01-19T05:19:06.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.975+0000 7f592bfff640 1 -- 172.21.15.99:0/1115863686 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5934004b70 con 0x7f59440b2ce0 2024-01-19T05:19:06.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.975+0000 7f592bfff640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5930066500 0x7f59300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:06.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.975+0000 7f592bfff640 1 -- 172.21.15.99:0/1115863686 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f5934083300 con 0x7f59440b2ce0 2024-01-19T05:19:06.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.975+0000 7f5942ffd640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5930066500 0x7f59300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:06.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.975+0000 7f5942ffd640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5930066500 0x7f59300689c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f59380af000 tx=0x7f59380a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:06.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:06.979+0000 7f592bfff640 1 -- 172.21.15.99:0/1115863686 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f594413ae40 con 0x7f59440b2ce0 2024-01-19T05:19:07.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.131+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f594413ae40 con 0x7f59440b2ce0 2024-01-19T05:19:07.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.823+0000 7f592bfff640 1 -- 172.21.15.99:0/1115863686 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f594413ae40 con 0x7f59440b2ce0 2024-01-19T05:19:07.826 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-01-19T05:19:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5930066500 msgr2=0x7f59300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5930066500 0x7f59300689c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f59380af000 tx=0x7f59380a7000 comp rx=0 tx=0).stop 2024-01-19T05:19:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b2ce0 msgr2=0x7f59441e06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b2ce0 0x7f59441e06c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f59340011f0 tx=0x7f593400c9b0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 shutdown_connections 2024-01-19T05:19:07.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5930066500 0x7f59300689c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5944071f40 0x7f5944139be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5944144000 0x7f5944071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 --2- 172.21.15.99:0/1115863686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59440b2ce0 0x7f59441e06c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.827+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 >> 172.21.15.99:0/1115863686 conn(0x7f59440b8080 msgr2=0x7f59440aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:07.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.831+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 shutdown_connections 2024-01-19T05:19:07.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.831+0000 7f5949b2f640 1 -- 172.21.15.99:0/1115863686 wait complete. 2024-01-19T05:19:07.856 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-19T05:19:07.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.975+0000 7f1129221640 1 Processor -- start 2024-01-19T05:19:07.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.975+0000 7f1129221640 1 -- start start 2024-01-19T05:19:07.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.975+0000 7f1129221640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11240724f0 0x7f112414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:07.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.975+0000 7f1129221640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112406f070 con 0x7f11240b19f0 2024-01-19T05:19:07.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.975+0000 7f1129221640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1124070680 con 0x7f112406ebe0 2024-01-19T05:19:07.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.975+0000 7f1129221640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1124070410 con 0x7f11240724f0 2024-01-19T05:19:07.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1122d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f11240b19f0 0x7f1124144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47048/0 (socket says 172.21.15.99:47048) 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1122d9d640 1 -- 172.21.15.99:0/4265518347 learned_addr learned my addr 172.21.15.99:0/4265518347 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 --2- 172.21.15.99:0/4265518347 >> v2:172.21.15.157:3300/0 conn(0x7f11240724f0 0x7f112414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459513710 0 0) 0x7f111c0014a0 con 0x7f11240b19f0 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1110003530 con 0x7f11240b19f0 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057837515 0 0) 0x7f1110003530 con 0x7f11240b19f0 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 >> v2:172.21.15.157:3300/0 conn(0x7f11240724f0 msgr2=0x7f112414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 --2- 172.21.15.99:0/4265518347 >> v2:172.21.15.157:3300/0 conn(0x7f11240724f0 0x7f112414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 >> v1:172.21.15.157:6789/0 conn(0x7f112406ebe0 legacy=0x7f1124071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1124144790 con 0x7f11240b19f0 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f111c001b90 con 0x7f11240b19f0 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 >> v1:172.21.15.99:6789/0 conn(0x7f11240b19f0 legacy=0x7f1124144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1110003980 0x7f1110003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100047d0 0x7f1110004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:07.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100052b0 0x7f111000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1124070410 con 0x7f11100052b0 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111000c180 con 0x7f1110003980 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111000c340 con 0x7f11100047d0 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 --2- 172.21.15.99:0/4265518347 >> v2:172.21.15.157:3300/0 conn(0x7f11240724f0 0x7f112414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100052b0 0x7f111000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1122d9d640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1110003980 0x7f1110003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112259c640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100047d0 0x7f1110004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 -- 172.21.15.99:0/4265518347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100047d0 msgr2=0x7f1110004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100047d0 0x7f1110004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 -- 172.21.15.99:0/4265518347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1110003980 msgr2=0x7f1110003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1110003980 0x7f1110003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 -- 172.21.15.99:0/4265518347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110003530 con 0x7f11100052b0 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 -- 172.21.15.99:0/4265518347 reap_dead start 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f112359e640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100052b0 0x7f111000b990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1114009880 tx=0x7f111401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95de9f2dbdd0f292 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114004220 con 0x7f11100052b0 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1114004380 con 0x7f11100052b0 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.979+0000 7f1121d9b640 1 -- 172.21.15.99:0/4265518347 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114003860 con 0x7f11100052b0 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- 172.21.15.99:0/4265518347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100052b0 msgr2=0x7f111000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100052b0 0x7f111000b990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1114009880 tx=0x7f111401c5d0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- 172.21.15.99:0/4265518347 shutdown_connections 2024-01-19T05:19:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 --2- 172.21.15.99:0/4265518347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100052b0 0x7f111000b990 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- 172.21.15.99:0/4265518347 >> 172.21.15.99:0/4265518347 conn(0x7f11240b8080 msgr2=0x7f11240b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- 172.21.15.99:0/4265518347 shutdown_connections 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- 172.21.15.99:0/4265518347 wait complete. 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 Processor -- start 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- start start 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100052b0 0x7f11240ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11240ada70 0x7f11240a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11240a9fb0 0x7f11241dd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11240aa430 con 0x7f11240ada70 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11240ae260 con 0x7f11240a9fb0 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11240ac9e0 con 0x7f11100052b0 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11240ada70 0x7f11240a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11240ada70 0x7f11240a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47420/0 (socket says 172.21.15.99:47420) 2024-01-19T05:19:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 -- 172.21.15.99:0/1914136479 learned_addr learned my addr 172.21.15.99:0/1914136479 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 -- 172.21.15.99:0/1914136479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100052b0 msgr2=0x7f11240ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1122d9d640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100052b0 0x7f11240ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112359e640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11240a9fb0 0x7f11241dd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100052b0 0x7f11240ab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 -- 172.21.15.99:0/1914136479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11240a9fb0 msgr2=0x7f11241dd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11240a9fb0 0x7f11241dd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 -- 172.21.15.99:0/1914136479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11241400c0 con 0x7f11240ada70 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f112259c640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11240ada70 0x7f11240a9a70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f110c00e4b0 tx=0x7f110c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f111b7fe640 1 -- 172.21.15.99:0/1914136479 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0052e0 con 0x7f11240ada70 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f111b7fe640 1 -- 172.21.15.99:0/1914136479 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c005440 con 0x7f11240ada70 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f111b7fe640 1 -- 172.21.15.99:0/1914136479 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c003840 con 0x7f11240ada70 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11240ad460 con 0x7f11240ada70 2024-01-19T05:19:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11240aded0 con 0x7f11240ada70 2024-01-19T05:19:07.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.983+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11240a9790 con 0x7f11240ada70 2024-01-19T05:19:07.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.987+0000 7f111b7fe640 1 -- 172.21.15.99:0/1914136479 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f110c0039a0 con 0x7f11240ada70 2024-01-19T05:19:07.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.987+0000 7f111b7fe640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1104066500 0x7f11040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:07.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.987+0000 7f1122d9d640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1104066500 0x7f11040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:07.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.987+0000 7f111b7fe640 1 -- 172.21.15.99:0/1914136479 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f110c083810 con 0x7f11240ada70 2024-01-19T05:19:07.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.987+0000 7f1122d9d640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1104066500 0x7f11040689c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f111c001720 tx=0x7f111c002130 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:07.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:07.991+0000 7f111b7fe640 1 -- 172.21.15.99:0/1914136479 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f11240a9790 con 0x7f11240ada70 2024-01-19T05:19:08.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.155+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f11240696e0 con 0x7f11240ada70 2024-01-19T05:19:08.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.159+0000 7f111b7fe640 1 -- 172.21.15.99:0/1914136479 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f110c050e40 con 0x7f11240ada70 2024-01-19T05:19:08.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1104066500 msgr2=0x7f11040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:08.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1104066500 0x7f11040689c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f111c001720 tx=0x7f111c002130 comp rx=0 tx=0).stop 2024-01-19T05:19:08.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11240ada70 msgr2=0x7f11240a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:08.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11240ada70 0x7f11240a9a70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f110c00e4b0 tx=0x7f110c00e970 comp rx=0 tx=0).stop 2024-01-19T05:19:08.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 shutdown_connections 2024-01-19T05:19:08.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f1104066500 0x7f11040689c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11240a9fb0 0x7f11241dd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11240ada70 0x7f11240a9a70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 --2- 172.21.15.99:0/1914136479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11100052b0 0x7f11240ab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 >> 172.21.15.99:0/1914136479 conn(0x7f11240b8080 msgr2=0x7f11240b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:08.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 shutdown_connections 2024-01-19T05:19:08.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.163+0000 7f1129221640 1 -- 172.21.15.99:0/1914136479 wait complete. 2024-01-19T05:19:08.180 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-01-19T05:19:08.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.295+0000 7fba13953640 1 Processor -- start 2024-01-19T05:19:08.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.295+0000 7fba13953640 1 -- start start 2024-01-19T05:19:08.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.295+0000 7fba13953640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0b8f10 0x7fba0c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.295+0000 7fba13953640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fba0c13eb00 0x7fba0c147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.295+0000 7fba13953640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c0afa00 con 0x7fba0c0b92f0 2024-01-19T05:19:08.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.295+0000 7fba13953640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c06f3f0 con 0x7fba0c13eb00 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.295+0000 7fba13953640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c072c50 con 0x7fba0c0b8f10 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fba0c0b92f0 0x7fba0c0b3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47052/0 (socket says 172.21.15.99:47052) 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 -- 172.21.15.99:0/4263587414 learned_addr learned my addr 172.21.15.99:0/4263587414 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba10eee640 1 --2- 172.21.15.99:0/4263587414 >> v2:172.21.15.157:3300/0 conn(0x7fba0c13eb00 0x7fba0c147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba116ef640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0b8f10 0x7fba0c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365906377 0 0) 0x7fba0c0afa00 con 0x7fba0c0b92f0 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f8003530 con 0x7fba0c0b92f0 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970782876 0 0) 0x7fb9f8003530 con 0x7fba0c0b92f0 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0b8f10 msgr2=0x7fba0c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0b8f10 0x7fba0c13e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 >> v2:172.21.15.157:3300/0 conn(0x7fba0c13eb00 msgr2=0x7fba0c147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:08.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 --2- 172.21.15.99:0/4263587414 >> v2:172.21.15.157:3300/0 conn(0x7fba0c13eb00 0x7fba0c147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0b4c40 con 0x7fba0c0b92f0 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fba04001a00 con 0x7fba0c0b92f0 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 >> v1:172.21.15.99:6789/0 conn(0x7fba0c0b92f0 legacy=0x7fba0c0b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f8003980 0x7fb9f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0b8f10 0x7fb9f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9f8004d10 0x7fb9f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c06f3f0 con 0x7fb9f8004d10 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c072c50 con 0x7fb9f8003980 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f800b990 con 0x7fba0c0b8f10 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9f8004d10 0x7fb9f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba10eee640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0b8f10 0x7fb9f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba116ef640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f8003980 0x7fb9f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 -- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0b8f10 msgr2=0x7fb9f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:08.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0b8f10 0x7fb9f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 -- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f8003980 msgr2=0x7fb9f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:08.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9f8003980 0x7fb9f8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 -- 172.21.15.99:0/4263587414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8003530 con 0x7fb9f8004d10 2024-01-19T05:19:08.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba11ef0640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9f8004d10 0x7fb9f8005190 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fba0400a800 tx=0x7fba0401fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305f22f02a619e4a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:08.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040aa690 con 0x7fb9f8004d10 2024-01-19T05:19:08.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba040aa7f0 con 0x7fb9f8004d10 2024-01-19T05:19:08.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.299+0000 7fba03fff640 1 -- 172.21.15.99:0/4263587414 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040aabe0 con 0x7fb9f8004d10 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- 172.21.15.99:0/4263587414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9f8004d10 msgr2=0x7fb9f8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 --2- 172.21.15.99:0/4263587414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9f8004d10 0x7fb9f8005190 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fba0400a800 tx=0x7fba0401fa60 comp rx=0 tx=0).stop 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba11ef0640 1 -- 172.21.15.99:0/4263587414 reap_dead start 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- 172.21.15.99:0/4263587414 shutdown_connections 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- 172.21.15.99:0/4263587414 >> 172.21.15.99:0/4263587414 conn(0x7fba0c06adf0 msgr2=0x7fba0c0b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- 172.21.15.99:0/4263587414 shutdown_connections 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- 172.21.15.99:0/4263587414 wait complete. 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 Processor -- start 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- start start 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c13f2e0 0x7fba0c1da250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba0c141750 0x7fba0c1da790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0ae8e0 0x7fba0c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c1d9dc0 con 0x7fba0c13f2e0 2024-01-19T05:19:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c13f6c0 con 0x7fba0c141750 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c141c30 con 0x7fba0c0ae8e0 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c13f2e0 0x7fba0c1da250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c13f2e0 0x7fba0c1da250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47440/0 (socket says 172.21.15.99:47440) 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 -- 172.21.15.99:0/2996475331 learned_addr learned my addr 172.21.15.99:0/2996475331 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba10eee640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba0c141750 0x7fba0c1da790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba11ef0640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0ae8e0 0x7fba0c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 -- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0ae8e0 msgr2=0x7fba0c0aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0ae8e0 0x7fba0c0aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 -- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba0c141750 msgr2=0x7fba0c1da790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba0c141750 0x7fba0c1da790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 -- 172.21.15.99:0/2996475331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c140a70 con 0x7fba0c13f2e0 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba11ef0640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0ae8e0 0x7fba0c0aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba116ef640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c13f2e0 0x7fba0c1da250 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fba08011560 tx=0x7fba08011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba01ffb640 1 -- 172.21.15.99:0/2996475331 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08015930 con 0x7fba0c13f2e0 2024-01-19T05:19:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba01ffb640 1 -- 172.21.15.99:0/2996475331 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08015a90 con 0x7fba0c13f2e0 2024-01-19T05:19:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c1406d0 con 0x7fba0c13f2e0 2024-01-19T05:19:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba01ffb640 1 -- 172.21.15.99:0/2996475331 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08015e60 con 0x7fba0c13f2e0 2024-01-19T05:19:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c140f20 con 0x7fba0c13f2e0 2024-01-19T05:19:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.303+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c0696e0 con 0x7fba0c13f2e0 2024-01-19T05:19:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.307+0000 7fba01ffb640 1 -- 172.21.15.99:0/2996475331 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fba0800f460 con 0x7fba0c13f2e0 2024-01-19T05:19:08.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.307+0000 7fba01ffb640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb9f0066500 0x7fb9f00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:08.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.307+0000 7fba01ffb640 1 -- 172.21.15.99:0/2996475331 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba08084300 con 0x7fba0c13f2e0 2024-01-19T05:19:08.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.307+0000 7fba10eee640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb9f0066500 0x7fb9f00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:08.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.307+0000 7fba10eee640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb9f0066500 0x7fb9f00689c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba0c147870 tx=0x7fb9fc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:08.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.311+0000 7fba01ffb640 1 -- 172.21.15.99:0/2996475331 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fba08051930 con 0x7fba0c13f2e0 2024-01-19T05:19:08.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.523+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) v1 -- 0x7fba0c142020 con 0x7fba0c13f2e0 2024-01-19T05:19:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.827+0000 7fba01ffb640 1 -- 172.21.15.99:0/2996475331 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v84) v1 ==== 134+0+0 (secure 0 0 0) 0x7fba08054f50 con 0x7fba0c13f2e0 2024-01-19T05:19:08.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb9f0066500 msgr2=0x7fb9f00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:08.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb9f0066500 0x7fb9f00689c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba0c147870 tx=0x7fb9fc008040 comp rx=0 tx=0).stop 2024-01-19T05:19:08.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c13f2e0 msgr2=0x7fba0c1da250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c13f2e0 0x7fba0c1da250 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fba08011560 tx=0x7fba08011a20 comp rx=0 tx=0).stop 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 shutdown_connections 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb9f0066500 0x7fb9f00689c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fba0c0ae8e0 0x7fba0c0aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba0c141750 0x7fba0c1da790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 --2- 172.21.15.99:0/2996475331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0c13f2e0 0x7fba0c1da250 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 >> 172.21.15.99:0/2996475331 conn(0x7fba0c06adf0 msgr2=0x7fba0c0b87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 shutdown_connections 2024-01-19T05:19:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:08.831+0000 7fba13953640 1 -- 172.21.15.99:0/2996475331 wait complete. 2024-01-19T05:19:08.852 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed ... ERROR 2024-01-19T05:19:08.852 INFO:tasks.cephfs_test_runner: 2024-01-19T05:19:08.852 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-19T05:19:08.852 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-01-19T05:19:08.852 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-01-19T05:19:08.852 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-19T05:19:08.852 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-19T05:19:08.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi099 with status 127: 'cephfs-shell -b /tmp/test-cephfs23h9w1gt' 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner: 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-19T05:19:08.853 INFO:tasks.cephfs_test_runner:Ran 1 test in 40.927s 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-01-19T05:19:08.854 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi099 with status 127: 'cephfs-shell -b /tmp/test-cephfs23h9w1gt' 2024-01-19T05:19:08.855 INFO:tasks.cephfs_test_runner: 2024-01-19T05:19:08.856 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-01-19T05:19:09.088 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6776adbfd8a7491c803e1ec86db72777 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_0edf41a622739843d6b978b179ff3227b476dd9d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-01-19T05:19:09.090 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-19T05:19:09.098 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-01-19T05:19:09.108 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-01-19T05:19:09.108 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-19T05:19:09.108 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-19T05:19:09.125 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336496k,nr_inodes=4084124,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18653 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-19T05:19:09.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:19:09.126 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-01-19T05:19:09.172 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-19T05:19:09.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:19:09.173 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-19T05:19:09.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-19T05:19:09.229 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-01-19T05:19:09.437 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-19T05:19:09.445 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-19T05:19:09.446 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:19:09.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8cb6fa640 1 Processor -- start 2024-01-19T05:19:09.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8cb6fa640 1 -- start start 2024-01-19T05:19:09.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8cb6fa640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd8c40b2ce0 0x7fd8c4071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8cb6fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b1870 0x7fd8c4072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8cb6fa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd8c4143ac0 0x7fd8c4143f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8cb6fa640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c4141000 con 0x7fd8c40b2ce0 2024-01-19T05:19:09.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8cb6fa640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c41444b0 con 0x7fd8c4143ac0 2024-01-19T05:19:09.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8cb6fa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c406f620 con 0x7fd8c40b1870 2024-01-19T05:19:09.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9496640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd8c40b2ce0 0x7fd8c4071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9496640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd8c40b2ce0 0x7fd8c4071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47450/0 (socket says 172.21.15.99:47450) 2024-01-19T05:19:09.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9496640 1 -- 172.21.15.99:0/2191341945 learned_addr learned my addr 172.21.15.99:0/2191341945 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:09.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c8c95640 1 --2- 172.21.15.99:0/2191341945 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b1870 0x7fd8c4072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9c97640 1 --2- 172.21.15.99:0/2191341945 >> v2:172.21.15.157:3300/0 conn(0x7fd8c4143ac0 0x7fd8c4143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9496640 1 -- 172.21.15.99:0/2191341945 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b1870 msgr2=0x7fd8c4072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:09.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9496640 1 --2- 172.21.15.99:0/2191341945 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b1870 0x7fd8c4072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9496640 1 -- 172.21.15.99:0/2191341945 >> v2:172.21.15.157:3300/0 conn(0x7fd8c4143ac0 msgr2=0x7fd8c4143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:09.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9496640 1 --2- 172.21.15.99:0/2191341945 >> v2:172.21.15.157:3300/0 conn(0x7fd8c4143ac0 0x7fd8c4143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.571+0000 7fd8c9496640 1 -- 172.21.15.99:0/2191341945 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4143610 con 0x7fd8c40b2ce0 2024-01-19T05:19:09.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c9496640 1 --2- 172.21.15.99:0/2191341945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c40b2ce0 0x7fd8c4071f00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8c406ef10 tx=0x7fd8b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71152a9204e8c071 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:09.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8b7fff640 1 -- 172.21.15.99:0/2191341945 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80aa620 con 0x7fd8c40b2ce0 2024-01-19T05:19:09.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8b7fff640 1 -- 172.21.15.99:0/2191341945 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80aa780 con 0x7fd8c40b2ce0 2024-01-19T05:19:09.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8b7fff640 1 -- 172.21.15.99:0/2191341945 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80aab10 con 0x7fd8c40b2ce0 2024-01-19T05:19:09.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/2191341945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c40b2ce0 msgr2=0x7fd8c4071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/2191341945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c40b2ce0 0x7fd8c4071f00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8c406ef10 tx=0x7fd8b801c500 comp rx=0 tx=0).stop 2024-01-19T05:19:09.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/2191341945 shutdown_connections 2024-01-19T05:19:09.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/2191341945 >> v2:172.21.15.157:3300/0 conn(0x7fd8c4143ac0 0x7fd8c4143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/2191341945 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b1870 0x7fd8c4072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/2191341945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c40b2ce0 0x7fd8c4071f00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/2191341945 >> 172.21.15.99:0/2191341945 conn(0x7fd8c40b8080 msgr2=0x7fd8c40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/2191341945 shutdown_connections 2024-01-19T05:19:09.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/2191341945 wait complete. 2024-01-19T05:19:09.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 Processor -- start 2024-01-19T05:19:09.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- start start 2024-01-19T05:19:09.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b2ce0 0x7fd8c4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c4143ac0 0x7fd8c41de660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8c41deba0 0x7fd8c413ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41479e0 con 0x7fd8c4143ac0 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41df030 con 0x7fd8c41deba0 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8cb6fa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4148730 con 0x7fd8c40b2ce0 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c4143ac0 0x7fd8c41de660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c4143ac0 0x7fd8c41de660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47466/0 (socket says 172.21.15.99:47466) 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 -- 172.21.15.99:0/3892832250 learned_addr learned my addr 172.21.15.99:0/3892832250 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 -- 172.21.15.99:0/3892832250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b2ce0 msgr2=0x7fd8c4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b2ce0 0x7fd8c4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 -- 172.21.15.99:0/3892832250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8c41deba0 msgr2=0x7fd8c413ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8c41deba0 0x7fd8c413ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 -- 172.21.15.99:0/3892832250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80094d0 con 0x7fd8c4143ac0 2024-01-19T05:19:09.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.575+0000 7fd8c8c95640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c4143ac0 0x7fd8c41de660 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000fd80 tx=0x7fd8c000d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:09.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8b5ffb640 1 -- 172.21.15.99:0/3892832250 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011650 con 0x7fd8c4143ac0 2024-01-19T05:19:09.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8b5ffb640 1 -- 172.21.15.99:0/3892832250 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c00117b0 con 0x7fd8c4143ac0 2024-01-19T05:19:09.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c4148a10 con 0x7fd8c4143ac0 2024-01-19T05:19:09.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8b5ffb640 1 -- 172.21.15.99:0/3892832250 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011b20 con 0x7fd8c4143ac0 2024-01-19T05:19:09.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c4148450 con 0x7fd8c4143ac0 2024-01-19T05:19:09.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c4148040 con 0x7fd8c4143ac0 2024-01-19T05:19:09.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8b5ffb640 1 -- 172.21.15.99:0/3892832250 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd8c0011c80 con 0x7fd8c4143ac0 2024-01-19T05:19:09.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8b5ffb640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8a8066500 0x7fd8a80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8b5ffb640 1 -- 172.21.15.99:0/3892832250 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8c0086720 con 0x7fd8c4143ac0 2024-01-19T05:19:09.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8c9496640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8a8066500 0x7fd8a80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.579+0000 7fd8c9496640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8a8066500 0x7fd8a80689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80ae000 tx=0x7fd8b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:09.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.583+0000 7fd8b5ffb640 1 -- 172.21.15.99:0/3892832250 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd8c4148040 con 0x7fd8c4143ac0 2024-01-19T05:19:09.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.739+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8c4148040 con 0x7fd8a8066500 2024-01-19T05:19:09.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.739+0000 7fd8b5ffb640 1 -- 172.21.15.99:0/3892832250 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49467 (secure 0 0 0) 0x7fd8c4148040 con 0x7fd8a8066500 2024-01-19T05:19:09.743 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:09.743 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:19:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8a8066500 msgr2=0x7fd8a80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8a8066500 0x7fd8a80689c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80ae000 tx=0x7fd8b8008040 comp rx=0 tx=0).stop 2024-01-19T05:19:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c4143ac0 msgr2=0x7fd8c41de660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c4143ac0 0x7fd8c41de660 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000fd80 tx=0x7fd8c000d6c0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 shutdown_connections 2024-01-19T05:19:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fd8a8066500 0x7fd8a80689c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8c41deba0 0x7fd8c413ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8c4143ac0 0x7fd8c41de660 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 --2- 172.21.15.99:0/3892832250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8c40b2ce0 0x7fd8c4070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 >> 172.21.15.99:0/3892832250 conn(0x7fd8c40b8080 msgr2=0x7fd8c41407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 shutdown_connections 2024-01-19T05:19:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.743+0000 7fd8cb6fa640 1 -- 172.21.15.99:0/3892832250 wait complete. 2024-01-19T05:19:09.761 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-01-19T05:19:09.361720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240732,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733988,"statfs":{"total":773094113280,"available":772847603712,"internally_reserved":0,"allocated":3870720,"data_stored":2200499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10732,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001521"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.455108+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:48.455108+0000","last_peered":"2024-01-19T05:18:48.455108+0000","last_clean":"2024-01-19T05:18:48.455108+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:48.455108+0000","last_undegraded":"2024-01-19T05:18:48.455108+0000","last_fullsized":"2024-01-19T05:18:48.455108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335596,"statfs":{"total":96636764160,"available":96599650304,"internally_reserved":0,"allocated":921600,"data_stored":714446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.85499999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.0800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.024}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1240000000000001}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1559999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.75}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.242}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.028},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.2709999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1950000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.4930000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0700000000000001}]},{"osd":1,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.355},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.387},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.28}]},{"osd":7,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":134101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.028}]},{"osd":6,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.075},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.2589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":130139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.442},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.871}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.133},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.159}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.99099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":134101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.628},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":714356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.62},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.054}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.999},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.91000000000000003}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:19:09.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:19:09.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.879+0000 7fa8d4a2e640 1 Processor -- start 2024-01-19T05:19:09.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.879+0000 7fa8d4a2e640 1 -- start start 2024-01-19T05:19:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.879+0000 7fa8d4a2e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d00b19f0 0x7fa8d006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.879+0000 7fa8d4a2e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d0070680 con 0x7fa8d00724f0 2024-01-19T05:19:09.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.879+0000 7fa8d4a2e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d0070410 con 0x7fa8d0144c70 2024-01-19T05:19:09.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.879+0000 7fa8d4a2e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0144790 con 0x7fa8d00b19f0 2024-01-19T05:19:09.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8ced9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa8d00724f0 0x7fa8d014ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47068/0 (socket says 172.21.15.99:47068) 2024-01-19T05:19:09.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8ced9d640 1 -- 172.21.15.99:0/2238821967 learned_addr learned my addr 172.21.15.99:0/2238821967 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:09.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8ce59c640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d00b19f0 0x7fa8d006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196452082 0 0) 0x7fa8d0070680 con 0x7fa8d00724f0 2024-01-19T05:19:09.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b8003530 con 0x7fa8d00724f0 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2080309466 0 0) 0x7fa8b8003530 con 0x7fa8d00724f0 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d00b19f0 msgr2=0x7fa8d006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d00b19f0 0x7fa8d006ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 >> v1:172.21.15.157:6789/0 conn(0x7fa8d0144c70 legacy=0x7fa8d0071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d006f2b0 con 0x7fa8d00724f0 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fa8c8001a00 con 0x7fa8d00724f0 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 >> v1:172.21.15.99:6789/0 conn(0x7fa8d00724f0 legacy=0x7fa8d014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8b80039b0 0x7fa8b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d00b19f0 0x7fa8b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0144790 con 0x7fa8b80047d0 2024-01-19T05:19:09.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b800bac0 con 0x7fa8b80039b0 2024-01-19T05:19:09.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b800bc80 con 0x7fa8d00b19f0 2024-01-19T05:19:09.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cdd9b640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8ce59c640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8b80039b0 0x7fa8b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8ced9d640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d00b19f0 0x7fa8b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cdd9b640 1 -- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d00b19f0 msgr2=0x7fa8b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:09.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cdd9b640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d00b19f0 0x7fa8b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cdd9b640 1 -- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8b80039b0 msgr2=0x7fa8b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:09.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cdd9b640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8b80039b0 0x7fa8b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cdd9b640 1 -- 172.21.15.99:0/2238821967 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8003530 con 0x7fa8b80047d0 2024-01-19T05:19:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cdd9b640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8b8004c50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4001750 tx=0x7fa8c401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b996b275c2e7d78 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40052d0 con 0x7fa8b80047d0 2024-01-19T05:19:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4005430 con 0x7fa8b80047d0 2024-01-19T05:19:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.883+0000 7fa8cd59a640 1 -- 172.21.15.99:0/2238821967 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4003820 con 0x7fa8b80047d0 2024-01-19T05:19:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2238821967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 msgr2=0x7fa8b8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 --2- 172.21.15.99:0/2238821967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8b8004c50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4001750 tx=0x7fa8c401c370 comp rx=0 tx=0).stop 2024-01-19T05:19:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ced9d640 1 -- 172.21.15.99:0/2238821967 reap_dead start 2024-01-19T05:19:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2238821967 shutdown_connections 2024-01-19T05:19:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2238821967 >> 172.21.15.99:0/2238821967 conn(0x7fa8d00b8080 msgr2=0x7fa8d00b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2238821967 shutdown_connections 2024-01-19T05:19:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2238821967 wait complete. 2024-01-19T05:19:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 Processor -- start 2024-01-19T05:19:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- start start 2024-01-19T05:19:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8d01e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d014f0d0 0x7fa8d013be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8d014f550 0x7fa8d013c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01e1880 con 0x7fa8b80047d0 2024-01-19T05:19:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d014ecb0 con 0x7fa8d014f550 2024-01-19T05:19:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0071d90 con 0x7fa8d014f0d0 2024-01-19T05:19:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8d01e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8d01e0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47482/0 (socket says 172.21.15.99:47482) 2024-01-19T05:19:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 -- 172.21.15.99:0/2759945420 learned_addr learned my addr 172.21.15.99:0/2759945420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8cdd9b640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d014f0d0 0x7fa8d013be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ced9d640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8d014f550 0x7fa8d013c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 -- 172.21.15.99:0/2759945420 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d014f0d0 msgr2=0x7fa8d013be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d014f0d0 0x7fa8d013be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 -- 172.21.15.99:0/2759945420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8d014f550 msgr2=0x7fa8d013c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8d014f550 0x7fa8d013c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 -- 172.21.15.99:0/2759945420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d014b1a0 con 0x7fa8b80047d0 2024-01-19T05:19:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8ce59c640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8d01e0af0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00115e0 tx=0x7fa8c0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8beffd640 1 -- 172.21.15.99:0/2759945420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000f8f0 con 0x7fa8b80047d0 2024-01-19T05:19:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8beffd640 1 -- 172.21.15.99:0/2759945420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c000fa50 con 0x7fa8b80047d0 2024-01-19T05:19:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d01e11c0 con 0x7fa8b80047d0 2024-01-19T05:19:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8beffd640 1 -- 172.21.15.99:0/2759945420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000fdc0 con 0x7fa8b80047d0 2024-01-19T05:19:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.887+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d013c9c0 con 0x7fa8b80047d0 2024-01-19T05:19:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.891+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d01e1030 con 0x7fa8b80047d0 2024-01-19T05:19:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.891+0000 7fa8beffd640 1 -- 172.21.15.99:0/2759945420 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa8c0015460 con 0x7fa8b80047d0 2024-01-19T05:19:09.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.891+0000 7fa8beffd640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8b0066500 0x7fa8b00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:09.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.891+0000 7fa8beffd640 1 -- 172.21.15.99:0/2759945420 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa8c0084280 con 0x7fa8b80047d0 2024-01-19T05:19:09.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.891+0000 7fa8cdd9b640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8b0066500 0x7fa8b00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:09.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.891+0000 7fa8cdd9b640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8b0066500 0x7fa8b00689c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0070810 tx=0x7fa8c40011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:09.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:09.895+0000 7fa8beffd640 1 -- 172.21.15.99:0/2759945420 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa8c0051960 con 0x7fa8b80047d0 2024-01-19T05:19:10.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.051+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8d0145460 con 0x7fa8b0066500 2024-01-19T05:19:10.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.051+0000 7fa8beffd640 1 -- 172.21.15.99:0/2759945420 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49467 (secure 0 0 0) 0x7fa8c4005150 con 0x7fa8b0066500 2024-01-19T05:19:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:10.054 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:19:10.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8b0066500 msgr2=0x7fa8b00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8b0066500 0x7fa8b00689c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0070810 tx=0x7fa8c40011a0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 msgr2=0x7fa8d01e0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8d01e0af0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00115e0 tx=0x7fa8c0011aa0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 shutdown_connections 2024-01-19T05:19:10.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa8b0066500 0x7fa8b00689c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8d014f550 0x7fa8d013c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8d014f0d0 0x7fa8d013be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 --2- 172.21.15.99:0/2759945420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8b80047d0 0x7fa8d01e0af0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 >> 172.21.15.99:0/2759945420 conn(0x7fa8d00b8080 msgr2=0x7fa8d0070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:10.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 shutdown_connections 2024-01-19T05:19:10.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.055+0000 7fa8d4a2e640 1 -- 172.21.15.99:0/2759945420 wait complete. 2024-01-19T05:19:10.073 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-01-19T05:19:09.361720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240732,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733988,"statfs":{"total":773094113280,"available":772847603712,"internally_reserved":0,"allocated":3870720,"data_stored":2200499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10732,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001521"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.455108+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:48.455108+0000","last_peered":"2024-01-19T05:18:48.455108+0000","last_clean":"2024-01-19T05:18:48.455108+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:48.455108+0000","last_undegraded":"2024-01-19T05:18:48.455108+0000","last_fullsized":"2024-01-19T05:18:48.455108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335596,"statfs":{"total":96636764160,"available":96599650304,"internally_reserved":0,"allocated":921600,"data_stored":714446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.85499999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.0800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.024}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1240000000000001}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1559999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.75}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.242}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.028},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.2709999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1950000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.4930000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0700000000000001}]},{"osd":1,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.355},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.387},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.28}]},{"osd":7,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":134101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.028}]},{"osd":6,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.075},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.2589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":130139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.442},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.871}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.133},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.159}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.99099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":134101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.628},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":714356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.62},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.054}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.999},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.91000000000000003}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:19:10.074 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-19T05:19:10.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:19:10.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.191+0000 7fca078f1640 1 Processor -- start 2024-01-19T05:19:10.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.191+0000 7fca078f1640 1 -- start start 2024-01-19T05:19:10.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca078f1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca000b3310 0x7fca000b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca078f1640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0006ed10 con 0x7fca000b1120 2024-01-19T05:19:10.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca078f1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca001471b0 con 0x7fca000b36f0 2024-01-19T05:19:10.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca078f1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca000b22b0 con 0x7fca000b3310 2024-01-19T05:19:10.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca05e8e640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fca000b1120 0x7fca00146aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47082/0 (socket says 172.21.15.99:47082) 2024-01-19T05:19:10.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca05e8e640 1 -- 172.21.15.99:0/1282830253 learned_addr learned my addr 172.21.15.99:0/1282830253 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:10.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca0568d640 1 --2- 172.21.15.99:0/1282830253 >> v2:172.21.15.157:3300/0 conn(0x7fca000b3310 0x7fca000b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289030633 0 0) 0x7fca0006ed10 con 0x7fca000b1120 2024-01-19T05:19:10.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ec003530 con 0x7fca000b1120 2024-01-19T05:19:10.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3547267399 0 0) 0x7fc9ec003530 con 0x7fca000b1120 2024-01-19T05:19:10.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 >> v2:172.21.15.157:3300/0 conn(0x7fca000b3310 msgr2=0x7fca000b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:10.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 --2- 172.21.15.99:0/1282830253 >> v2:172.21.15.157:3300/0 conn(0x7fca000b3310 0x7fca000b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 >> v1:172.21.15.157:6789/0 conn(0x7fca000b36f0 legacy=0x7fca00146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca000b16d0 con 0x7fca000b1120 2024-01-19T05:19:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fc9f8001a00 con 0x7fca000b1120 2024-01-19T05:19:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 >> v1:172.21.15.99:6789/0 conn(0x7fca000b1120 legacy=0x7fca00146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec003b50 0x7fc9ec003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9ec0088b0 0x7fc9ec00ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec00b5e0 0x7fc9ec00daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca000b22b0 con 0x7fc9ec0088b0 2024-01-19T05:19:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec00e380 con 0x7fc9ec003b50 2024-01-19T05:19:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec00e540 con 0x7fc9ec00b5e0 2024-01-19T05:19:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca04e8c640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9ec0088b0 0x7fc9ec00ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca0568d640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec003b50 0x7fc9ec003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca05e8e640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec00b5e0 0x7fc9ec00daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca04e8c640 1 -- 172.21.15.99:0/1282830253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec00b5e0 msgr2=0x7fc9ec00daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca04e8c640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec00b5e0 0x7fc9ec00daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca04e8c640 1 -- 172.21.15.99:0/1282830253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec003b50 msgr2=0x7fc9ec003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca04e8c640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec003b50 0x7fc9ec003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca04e8c640 1 -- 172.21.15.99:0/1282830253 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec003530 con 0x7fc9ec0088b0 2024-01-19T05:19:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.195+0000 7fca05e8e640 1 -- 172.21.15.99:0/1282830253 reap_dead start 2024-01-19T05:19:10.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca04e8c640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9ec0088b0 0x7fc9ec00ad40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0001780 tx=0x7fc9f001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02ed3f9c405aab6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:10.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f00052d0 con 0x7fc9ec0088b0 2024-01-19T05:19:10.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f00a7050 con 0x7fc9ec0088b0 2024-01-19T05:19:10.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fc9f7fff640 1 -- 172.21.15.99:0/1282830253 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0003600 con 0x7fc9ec0088b0 2024-01-19T05:19:10.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- 172.21.15.99:0/1282830253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9ec0088b0 msgr2=0x7fc9ec00ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9ec0088b0 0x7fc9ec00ad40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0001780 tx=0x7fc9f001c3d0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- 172.21.15.99:0/1282830253 shutdown_connections 2024-01-19T05:19:10.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 --2- 172.21.15.99:0/1282830253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9ec0088b0 0x7fc9ec00ad40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- 172.21.15.99:0/1282830253 >> 172.21.15.99:0/1282830253 conn(0x7fca000b8080 msgr2=0x7fca000b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- 172.21.15.99:0/1282830253 shutdown_connections 2024-01-19T05:19:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- 172.21.15.99:0/1282830253 wait complete. 2024-01-19T05:19:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 Processor -- start 2024-01-19T05:19:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- start start 2024-01-19T05:19:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec0088b0 0x7fca000accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca000ab460 0x7fca001de3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca00142810 0x7fca000a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca000ad2f0 con 0x7fca00142810 2024-01-19T05:19:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca001ddbd0 con 0x7fca000ab460 2024-01-19T05:19:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca001ddeb0 con 0x7fc9ec0088b0 2024-01-19T05:19:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca00142810 0x7fca000a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca00142810 0x7fca000a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47502/0 (socket says 172.21.15.99:47502) 2024-01-19T05:19:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 -- 172.21.15.99:0/131268129 learned_addr learned my addr 172.21.15.99:0/131268129 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca04e8c640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca000ab460 0x7fca001de3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca0568d640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec0088b0 0x7fca000accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 -- 172.21.15.99:0/131268129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec0088b0 msgr2=0x7fca000accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec0088b0 0x7fca000accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 -- 172.21.15.99:0/131268129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca000ab460 msgr2=0x7fca001de3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca000ab460 0x7fca001de3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 -- 172.21.15.99:0/131268129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca001de910 con 0x7fca00142810 2024-01-19T05:19:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca05e8e640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca00142810 0x7fca000a94b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fca000af3b0 tx=0x7fc9f8007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fc9f5ffb640 1 -- 172.21.15.99:0/131268129 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800ea20 con 0x7fca00142810 2024-01-19T05:19:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fc9f5ffb640 1 -- 172.21.15.99:0/131268129 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f800eba0 con 0x7fca00142810 2024-01-19T05:19:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca000aa8a0 con 0x7fca00142810 2024-01-19T05:19:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fc9f5ffb640 1 -- 172.21.15.99:0/131268129 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8013420 con 0x7fca00142810 2024-01-19T05:19:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.199+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca00142e50 con 0x7fca00142810 2024-01-19T05:19:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.203+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca001dda30 con 0x7fca00142810 2024-01-19T05:19:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.203+0000 7fc9f5ffb640 1 -- 172.21.15.99:0/131268129 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc9f8013580 con 0x7fca00142810 2024-01-19T05:19:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.203+0000 7fc9f5ffb640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc9e4066500 0x7fc9e40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.203+0000 7fc9f5ffb640 1 -- 172.21.15.99:0/131268129 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc9f8083d60 con 0x7fca00142810 2024-01-19T05:19:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.203+0000 7fca0568d640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc9e4066500 0x7fc9e40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.203+0000 7fca0568d640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc9e4066500 0x7fc9e40689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009b50 tx=0x7fc9fc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:10.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.207+0000 7fc9f5ffb640 1 -- 172.21.15.99:0/131268129 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fca001dda30 con 0x7fca00142810 2024-01-19T05:19:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.359+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca001dda30 con 0x7fc9e4066500 2024-01-19T05:19:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fc9f5ffb640 1 -- 172.21.15.99:0/131268129 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49467 (secure 0 0 0) 0x7fca001dda30 con 0x7fc9e4066500 2024-01-19T05:19:10.365 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:19:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc9e4066500 msgr2=0x7fc9e40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc9e4066500 0x7fc9e40689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009b50 tx=0x7fc9fc008040 comp rx=0 tx=0).stop 2024-01-19T05:19:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca00142810 msgr2=0x7fca000a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca00142810 0x7fca000a94b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fca000af3b0 tx=0x7fc9f8007ba0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 shutdown_connections 2024-01-19T05:19:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fc9e4066500 0x7fc9e40689c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca00142810 0x7fca000a94b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca000ab460 0x7fca001de3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 --2- 172.21.15.99:0/131268129 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc9ec0088b0 0x7fca000accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 >> 172.21.15.99:0/131268129 conn(0x7fca000b8080 msgr2=0x7fca000af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 shutdown_connections 2024-01-19T05:19:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.363+0000 7fca078f1640 1 -- 172.21.15.99:0/131268129 wait complete. 2024-01-19T05:19:10.383 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-01-19T05:19:09.361720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240732,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733988,"statfs":{"total":773094113280,"available":772847603712,"internally_reserved":0,"allocated":3870720,"data_stored":2200499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10732,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001521"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-19T05:18:48.455108+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:18:48.455108+0000","last_peered":"2024-01-19T05:18:48.455108+0000","last_clean":"2024-01-19T05:18:48.455108+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:18:48.455108+0000","last_undegraded":"2024-01-19T05:18:48.455108+0000","last_fullsized":"2024-01-19T05:18:48.455108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335596,"statfs":{"total":96636764160,"available":96599650304,"internally_reserved":0,"allocated":921600,"data_stored":714446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.85499999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.0800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.024}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1240000000000001}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1559999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.75}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.242}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.028},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.2709999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1950000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":124092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.4930000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0700000000000001}]},{"osd":1,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.355},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.387},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.28}]},{"osd":7,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":134101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.028}]},{"osd":6,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.075},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.2589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":130139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.442},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.871}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.133},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.159}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.99099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":134101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.628},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":714356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.62},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.054}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.999},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.91000000000000003}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:19:10.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-19T05:19:10.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb61d2c7640 1 Processor -- start 2024-01-19T05:19:10.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb61d2c7640 1 -- start start 2024-01-19T05:19:10.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb61d2c7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb61806a940 0x7fb6180af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb61d2c7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61809bc20 0x7fb61814a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb61d2c7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb61814abd0 0x7fb618146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb61d2c7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180b0270 con 0x7fb61806a940 2024-01-19T05:19:10.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb61d2c7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61809e5b0 con 0x7fb61814abd0 2024-01-19T05:19:10.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb61d2c7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb618146a60 con 0x7fb61809bc20 2024-01-19T05:19:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb616ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb61806a940 0x7fb6180af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb616ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb61806a940 0x7fb6180af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47508/0 (socket says 172.21.15.99:47508) 2024-01-19T05:19:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb616ffd640 1 -- 172.21.15.99:0/3123920907 learned_addr learned my addr 172.21.15.99:0/3123920907 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb6167fc640 1 --2- 172.21.15.99:0/3123920907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61809bc20 0x7fb61814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb6177fe640 1 --2- 172.21.15.99:0/3123920907 >> v2:172.21.15.157:3300/0 conn(0x7fb61814abd0 0x7fb618146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb616ffd640 1 -- 172.21.15.99:0/3123920907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61809bc20 msgr2=0x7fb61814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb616ffd640 1 --2- 172.21.15.99:0/3123920907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61809bc20 0x7fb61814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb616ffd640 1 -- 172.21.15.99:0/3123920907 >> v2:172.21.15.157:3300/0 conn(0x7fb61814abd0 msgr2=0x7fb618146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:10.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb616ffd640 1 --2- 172.21.15.99:0/3123920907 >> v2:172.21.15.157:3300/0 conn(0x7fb61814abd0 0x7fb618146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.499+0000 7fb616ffd640 1 -- 172.21.15.99:0/3123920907 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61806ad20 con 0x7fb61806a940 2024-01-19T05:19:10.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb616ffd640 1 --2- 172.21.15.99:0/3123920907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61806a940 0x7fb6180af890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb61806af10 tx=0x7fb60801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5981fae662f7dc8a server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:10.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb615ffb640 1 -- 172.21.15.99:0/3123920907 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6080ac600 con 0x7fb61806a940 2024-01-19T05:19:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb615ffb640 1 -- 172.21.15.99:0/3123920907 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6080a8050 con 0x7fb61806a940 2024-01-19T05:19:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb615ffb640 1 -- 172.21.15.99:0/3123920907 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6080ac980 con 0x7fb61806a940 2024-01-19T05:19:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- 172.21.15.99:0/3123920907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61806a940 msgr2=0x7fb6180af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/3123920907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61806a940 0x7fb6180af890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb61806af10 tx=0x7fb60801c3e0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- 172.21.15.99:0/3123920907 shutdown_connections 2024-01-19T05:19:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/3123920907 >> v2:172.21.15.157:3300/0 conn(0x7fb61814abd0 0x7fb618146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/3123920907 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61809bc20 0x7fb61814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/3123920907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61806a940 0x7fb6180af890 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- 172.21.15.99:0/3123920907 >> 172.21.15.99:0/3123920907 conn(0x7fb618066ef0 msgr2=0x7fb6180b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:10.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- 172.21.15.99:0/3123920907 shutdown_connections 2024-01-19T05:19:10.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- 172.21.15.99:0/3123920907 wait complete. 2024-01-19T05:19:10.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 Processor -- start 2024-01-19T05:19:10.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- start start 2024-01-19T05:19:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61806a940 0x7fb61809d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb61809bc20 0x7fb61813bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61814abd0 0x7fb6181e23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61813b810 con 0x7fb61814abd0 2024-01-19T05:19:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61813df30 con 0x7fb61809bc20 2024-01-19T05:19:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61813d080 con 0x7fb61806a940 2024-01-19T05:19:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61814abd0 0x7fb6181e23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61814abd0 0x7fb6181e23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47518/0 (socket says 172.21.15.99:47518) 2024-01-19T05:19:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 -- 172.21.15.99:0/2911666309 learned_addr learned my addr 172.21.15.99:0/2911666309 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb616ffd640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61806a940 0x7fb61809d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6167fc640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb61809bc20 0x7fb61813bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 -- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61806a940 msgr2=0x7fb61809d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61806a940 0x7fb61809d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 -- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb61809bc20 msgr2=0x7fb61813bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb61809bc20 0x7fb61813bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 -- 172.21.15.99:0/2911666309 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080094d0 con 0x7fb61814abd0 2024-01-19T05:19:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6167fc640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb61809bc20 0x7fb61813bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:19:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb616ffd640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61806a940 0x7fb61809d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:19:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb6177fe640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61814abd0 0x7fb6181e23b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb610007e60 tx=0x7fb61000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb5ff7fe640 1 -- 172.21.15.99:0/2911666309 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610014420 con 0x7fb61814abd0 2024-01-19T05:19:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb5ff7fe640 1 -- 172.21.15.99:0/2911666309 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6100145a0 con 0x7fb61814abd0 2024-01-19T05:19:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61813d360 con 0x7fb61814abd0 2024-01-19T05:19:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb5ff7fe640 1 -- 172.21.15.99:0/2911666309 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610014950 con 0x7fb61814abd0 2024-01-19T05:19:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.503+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb618148f00 con 0x7fb61814abd0 2024-01-19T05:19:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.507+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61813b9c0 con 0x7fb61814abd0 2024-01-19T05:19:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.507+0000 7fb5ff7fe640 1 -- 172.21.15.99:0/2911666309 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb610014ab0 con 0x7fb61814abd0 2024-01-19T05:19:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.507+0000 7fb5ff7fe640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb604066530 0x7fb6040689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.507+0000 7fb5ff7fe640 1 -- 172.21.15.99:0/2911666309 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb610084440 con 0x7fb61814abd0 2024-01-19T05:19:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.507+0000 7fb616ffd640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb604066530 0x7fb6040689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.507+0000 7fb616ffd640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb604066530 0x7fb6040689f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb6080ae000 tx=0x7fb608008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:10.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.511+0000 7fb5ff7fe640 1 -- 172.21.15.99:0/2911666309 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb61813b9c0 con 0x7fb61814abd0 2024-01-19T05:19:10.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.667+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb61813dd60 con 0x7fb61814abd0 2024-01-19T05:19:10.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.667+0000 7fb5ff7fe640 1 -- 172.21.15.99:0/2911666309 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12951 (secure 0 0 0) 0x7fb610055460 con 0x7fb61814abd0 2024-01-19T05:19:10.669 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:10.670 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":32,"fsid":"7f059d9d-1406-48ae-9584-fdafb673a966","created":"2024-01-19T05:17:38.801046+0000","modified":"2024-01-19T05:19:07.821184+0000","last_up_change":"2024-01-19T05:17:49.913569+0000","last_in_change":"2024-01-19T05:17:41.084449+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-19T05:17:51.415642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3e1137c2-1d10-46da-b03b-9f0131b4079d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6801","nonce":131365086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6803","nonce":131365086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6807","nonce":131365086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":131365086},{"type":"v1","addr":"172.21.15.99:6805","nonce":131365086}]},"public_addr":"172.21.15.99:6801/131365086","cluster_addr":"172.21.15.99:6803/131365086","heartbeat_back_addr":"172.21.15.99:6807/131365086","heartbeat_front_addr":"172.21.15.99:6805/131365086","state":["exists","up"]},{"osd":1,"uuid":"5473ae2a-79d7-411e-8551-0896d5e2aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6814","nonce":2851887188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6817","nonce":2851887188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6823","nonce":2851887188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6819","nonce":2851887188},{"type":"v1","addr":"172.21.15.99:6821","nonce":2851887188}]},"public_addr":"172.21.15.99:6814/2851887188","cluster_addr":"172.21.15.99:6817/2851887188","heartbeat_back_addr":"172.21.15.99:6823/2851887188","heartbeat_front_addr":"172.21.15.99:6821/2851887188","state":["exists","up"]},{"osd":2,"uuid":"ebfdc59e-70db-4653-95a4-346861bfc163","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6825","nonce":296546613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6827","nonce":296546613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6831","nonce":296546613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":296546613},{"type":"v1","addr":"172.21.15.99:6829","nonce":296546613}]},"public_addr":"172.21.15.99:6825/296546613","cluster_addr":"172.21.15.99:6827/296546613","heartbeat_back_addr":"172.21.15.99:6831/296546613","heartbeat_front_addr":"172.21.15.99:6829/296546613","state":["exists","up"]},{"osd":3,"uuid":"774fc446-ece5-4d47-999b-c9fa2944406d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6809","nonce":3419007009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6811","nonce":3419007009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6820","nonce":3419007009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":3419007009},{"type":"v1","addr":"172.21.15.99:6815","nonce":3419007009}]},"public_addr":"172.21.15.99:6809/3419007009","cluster_addr":"172.21.15.99:6811/3419007009","heartbeat_back_addr":"172.21.15.99:6820/3419007009","heartbeat_front_addr":"172.21.15.99:6815/3419007009","state":["exists","up"]},{"osd":4,"uuid":"833e0894-f106-4e5f-8155-3f87d376049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6809","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6812","nonce":888701730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6813","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6815","nonce":888701730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6828","nonce":888701730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6819","nonce":888701730},{"type":"v1","addr":"172.21.15.157:6822","nonce":888701730}]},"public_addr":"172.21.15.157:6812/888701730","cluster_addr":"172.21.15.157:6815/888701730","heartbeat_back_addr":"172.21.15.157:6828/888701730","heartbeat_front_addr":"172.21.15.157:6822/888701730","state":["exists","up"]},{"osd":5,"uuid":"f6a00115-e637-45a7-9d24-5f5bb30e51d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6807","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6818","nonce":3649552388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6824","nonce":3649552388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6831","nonce":3649552388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6827","nonce":3649552388},{"type":"v1","addr":"172.21.15.157:6829","nonce":3649552388}]},"public_addr":"172.21.15.157:6818/3649552388","cluster_addr":"172.21.15.157:6824/3649552388","heartbeat_back_addr":"172.21.15.157:6831/3649552388","heartbeat_front_addr":"172.21.15.157:6829/3649552388","state":["exists","up"]},{"osd":6,"uuid":"27988014-20fd-4bd0-86c1-41f6d45f2e13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6811","nonce":536345226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6816","nonce":536345226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6823","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6826","nonce":536345226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6817","nonce":536345226},{"type":"v1","addr":"172.21.15.157:6820","nonce":536345226}]},"public_addr":"172.21.15.157:6811/536345226","cluster_addr":"172.21.15.157:6816/536345226","heartbeat_back_addr":"172.21.15.157:6826/536345226","heartbeat_front_addr":"172.21.15.157:6820/536345226","state":["exists","up"]},{"osd":7,"uuid":"b421bd1f-4b28-447a-ac33-926bd9c2dca0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6801","nonce":2904682777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6803","nonce":2904682777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6810","nonce":2904682777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2904682777},{"type":"v1","addr":"172.21.15.157:6805","nonce":2904682777}]},"public_addr":"172.21.15.157:6801/2904682777","cluster_addr":"172.21.15.157:6803/2904682777","heartbeat_back_addr":"172.21.15.157:6810/2904682777","heartbeat_front_addr":"172.21.15.157:6805/2904682777","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.643213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.637953+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.735367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.728526+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.670238+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.564979+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.675779+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-19T05:17:46.724369+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6835/3566081214":"2024-01-20T05:19:04.804336+0000","172.21.15.99:6834/3566081214":"2024-01-20T05:19:04.804336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-19T05:19:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb604066530 msgr2=0x7fb6040689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb604066530 0x7fb6040689f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb6080ae000 tx=0x7fb608008040 comp rx=0 tx=0).stop 2024-01-19T05:19:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61814abd0 msgr2=0x7fb6181e23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61814abd0 0x7fb6181e23b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb610007e60 tx=0x7fb61000e4b0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 shutdown_connections 2024-01-19T05:19:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb604066530 0x7fb6040689f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb61814abd0 0x7fb6181e23b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb61809bc20 0x7fb61813bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 --2- 172.21.15.99:0/2911666309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb61806a940 0x7fb61809d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 >> 172.21.15.99:0/2911666309 conn(0x7fb618066ef0 msgr2=0x7fb6180af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 shutdown_connections 2024-01-19T05:19:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:10.671+0000 7fb61d2c7640 1 -- 172.21.15.99:0/2911666309 wait complete. 2024-01-19T05:19:11.688 INFO:tasks.ceph:Scrubbing osd.0 2024-01-19T05:19:11.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:19:11.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac73ad640 1 Processor -- start 2024-01-19T05:19:11.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac73ad640 1 -- start start 2024-01-19T05:19:11.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac73ad640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2ac00b5e70 0x7f2ac01407e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac73ad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac0140d20 0x7f2ac0151160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac73ad640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac006c6c0 con 0x7f2ac00b7570 2024-01-19T05:19:11.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac73ad640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac014a540 con 0x7f2ac00b5e70 2024-01-19T05:19:11.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac73ad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac006cc60 con 0x7f2ac0140d20 2024-01-19T05:19:11.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac594a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac0140d20 0x7f2ac0151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac4948640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2ac00b5e70 0x7f2ac01407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac594a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac0140d20 0x7f2ac0151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.99:39964/0 (socket says 172.21.15.99:39964) 2024-01-19T05:19:11.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac4948640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2ac00b5e70 0x7f2ac01407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:32904/0 (socket says 172.21.15.99:32904) 2024-01-19T05:19:11.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac594a640 1 -- 172.21.15.99:0/1618917514 learned_addr learned my addr 172.21.15.99:0/1618917514 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:11.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac5149640 1 --1- 172.21.15.99:0/1618917514 >> v1:172.21.15.157:6789/0 conn(0x7f2ac00b7570 0x7f2ac0149e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:56732/0 (socket says 172.21.15.99:56732) 2024-01-19T05:19:11.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac4948640 1 -- 172.21.15.99:0/1618917514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac0140d20 msgr2=0x7f2ac0151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:11.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac4948640 1 --2- 172.21.15.99:0/1618917514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac0140d20 0x7f2ac0151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac4948640 1 -- 172.21.15.99:0/1618917514 >> v1:172.21.15.157:6789/0 conn(0x7f2ac00b7570 legacy=0x7f2ac0149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.823+0000 7f2ac4948640 1 -- 172.21.15.99:0/1618917514 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac00b62d0 con 0x7f2ac00b5e70 2024-01-19T05:19:11.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac4948640 1 --2- 172.21.15.99:0/1618917514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ac00b5e70 0x7f2ac01407e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00097c0 tx=0x7f2ab001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a95aca8de9e7f1f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:11.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ab7fff640 1 -- 172.21.15.99:0/1618917514 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00ab400 con 0x7f2ac00b5e70 2024-01-19T05:19:11.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ab7fff640 1 -- 172.21.15.99:0/1618917514 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00a7050 con 0x7f2ac00b5e70 2024-01-19T05:19:11.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ab7fff640 1 -- 172.21.15.99:0/1618917514 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00ab780 con 0x7f2ac00b5e70 2024-01-19T05:19:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 -- 172.21.15.99:0/1618917514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ac00b5e70 msgr2=0x7f2ac01407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 --2- 172.21.15.99:0/1618917514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ac00b5e70 0x7f2ac01407e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00097c0 tx=0x7f2ab001c480 comp rx=0 tx=0).stop 2024-01-19T05:19:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 -- 172.21.15.99:0/1618917514 shutdown_connections 2024-01-19T05:19:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 --2- 172.21.15.99:0/1618917514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac0140d20 0x7f2ac0151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 --2- 172.21.15.99:0/1618917514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ac00b5e70 0x7f2ac01407e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 -- 172.21.15.99:0/1618917514 >> 172.21.15.99:0/1618917514 conn(0x7f2ac00ba700 msgr2=0x7f2ac00b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 -- 172.21.15.99:0/1618917514 shutdown_connections 2024-01-19T05:19:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 -- 172.21.15.99:0/1618917514 wait complete. 2024-01-19T05:19:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 Processor -- start 2024-01-19T05:19:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.827+0000 7f2ac73ad640 1 -- start start 2024-01-19T05:19:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ac00b7570 0x7f2ac0146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ac0140d20 0x7f2ac01df380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac00b4290 0x7f2ac01df8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac01e3480 con 0x7f2ac0140d20 2024-01-19T05:19:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac013c400 con 0x7f2ac00b7570 2024-01-19T05:19:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac009db20 con 0x7f2ac00b4290 2024-01-19T05:19:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ac0140d20 0x7f2ac01df380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ac0140d20 0x7f2ac01df380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47532/0 (socket says 172.21.15.99:47532) 2024-01-19T05:19:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 -- 172.21.15.99:0/157229013 learned_addr learned my addr 172.21.15.99:0/157229013 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac5149640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ac00b7570 0x7f2ac0146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac594a640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac00b4290 0x7f2ac01df8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 -- 172.21.15.99:0/157229013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac00b4290 msgr2=0x7f2ac01df8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2ac00b4290 0x7f2ac01df8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 -- 172.21.15.99:0/157229013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ac00b7570 msgr2=0x7f2ac0146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ac00b7570 0x7f2ac0146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 -- 172.21.15.99:0/157229013 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0009420 con 0x7f2ac0140d20 2024-01-19T05:19:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac4948640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ac0140d20 0x7f2ac01df380 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00ae040 tx=0x7f2ab001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0006e20 con 0x7f2ac0140d20 2024-01-19T05:19:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab0004030 con 0x7f2ac0140d20 2024-01-19T05:19:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00043e0 con 0x7f2ac0140d20 2024-01-19T05:19:11.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac01e2dd0 con 0x7f2ac0140d20 2024-01-19T05:19:11.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac0099cd0 con 0x7f2ac0140d20 2024-01-19T05:19:11.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ac009cc30 con 0x7f2ac0140d20 2024-01-19T05:19:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2ab0003620 con 0x7f2ac0140d20 2024-01-19T05:19:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.831+0000 7f2ab5ffb640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa4066530 0x7f2aa40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ab011d9c0 con 0x7f2ac0140d20 2024-01-19T05:19:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ac5149640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa4066530 0x7f2aa40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ab5ffb640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7f2aa406c390 0x7f2aa406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 --> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2aa406ee60 con 0x7f2aa406c390 2024-01-19T05:19:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ab011de10 con 0x7f2ac0140d20 2024-01-19T05:19:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ac594a640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7f2aa406c390 0x7f2aa406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ac5149640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa4066530 0x7f2aa40689f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ac01e04b0 tx=0x7f2abc007e90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ac594a640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7f2aa406c390 0x7f2aa406e7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.835+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 <== osd.0 v2:172.21.15.99:6800/131365086 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2aa406ee60 con 0x7f2aa406c390 2024-01-19T05:19:11.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 --> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ac01e35c0 con 0x7f2aa406c390 2024-01-19T05:19:11.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ab5ffb640 1 -- 172.21.15.99:0/157229013 <== osd.0 v2:172.21.15.99:6800/131365086 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2ac01e35c0 con 0x7f2aa406c390 2024-01-19T05:19:11.853 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:19:11.853 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:19:11.853 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:19:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7f2aa406c390 msgr2=0x7f2aa406e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6800/131365086,v1:172.21.15.99:6801/131365086] conn(0x7f2aa406c390 0x7f2aa406e7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa4066530 msgr2=0x7f2aa40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2aa4066530 0x7f2aa40689f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ac01e04b0 tx=0x7f2abc007e90 comp rx=0 tx=0).stop 2024-01-19T05:19:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ac0140d20 msgr2=0x7f2ac01df380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 --2- 172.21.15.99:0/157229013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ac0140d20 0x7f2ac01df380 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00ae040 tx=0x7f2ab001acc0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac594a640 1 -- 172.21.15.99:0/157229013 reap_dead start 2024-01-19T05:19:11.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 shutdown_connections 2024-01-19T05:19:11.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 >> 172.21.15.99:0/157229013 conn(0x7f2ac00ba700 msgr2=0x7f2ac01494f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:11.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 shutdown_connections 2024-01-19T05:19:11.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.851+0000 7f2ac73ad640 1 -- 172.21.15.99:0/157229013 wait complete. 2024-01-19T05:19:11.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-19T05:19:11.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19ef1e6640 1 Processor -- start 2024-01-19T05:19:11.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19ef1e6640 1 -- start start 2024-01-19T05:19:11.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19ef1e6640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19e806ebe0 0x7f19e8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19ef1e6640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e806f070 con 0x7f19e8072320 2024-01-19T05:19:11.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19ef1e6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e8070680 con 0x7f19e80b19f0 2024-01-19T05:19:11.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19ef1e6640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e8070410 con 0x7f19e806ebe0 2024-01-19T05:19:11.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19e7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19e806ebe0 0x7f19e8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19ed783640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f19e8072320 0x7f19e814ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35328/0 (socket says 172.21.15.99:35328) 2024-01-19T05:19:11.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19ed783640 1 -- 172.21.15.99:0/802890006 learned_addr learned my addr 172.21.15.99:0/802890006 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:11.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19e77fe640 1 -- 172.21.15.99:0/802890006 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297614840 0 0) 0x7f19e00014a0 con 0x7f19e8072320 2024-01-19T05:19:11.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19e77fe640 1 -- 172.21.15.99:0/802890006 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d0003530 con 0x7f19e8072320 2024-01-19T05:19:11.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19e7fff640 1 -- 172.21.15.99:0/802890006 >> v1:172.21.15.157:6789/0 conn(0x7f19e80b19f0 legacy=0x7f19e8144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19e7fff640 1 -- 172.21.15.99:0/802890006 >> v1:172.21.15.99:6789/0 conn(0x7f19e8072320 legacy=0x7f19e814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.983+0000 7f19e7fff640 1 -- 172.21.15.99:0/802890006 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8144790 con 0x7f19e806ebe0 2024-01-19T05:19:11.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19e7fff640 1 --2- 172.21.15.99:0/802890006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e806ebe0 0x7f19e8071de0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19d80097c0 tx=0x7f19d801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a499015be31882 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:11.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19e77fe640 1 -- 172.21.15.99:0/802890006 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80ac640 con 0x7f19e806ebe0 2024-01-19T05:19:11.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19e77fe640 1 -- 172.21.15.99:0/802890006 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d80ac7a0 con 0x7f19e806ebe0 2024-01-19T05:19:11.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19e77fe640 1 -- 172.21.15.99:0/802890006 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80acb30 con 0x7f19e806ebe0 2024-01-19T05:19:11.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- 172.21.15.99:0/802890006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e806ebe0 msgr2=0x7f19e8071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 --2- 172.21.15.99:0/802890006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e806ebe0 0x7f19e8071de0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19d80097c0 tx=0x7f19d801c3c0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- 172.21.15.99:0/802890006 shutdown_connections 2024-01-19T05:19:11.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 --2- 172.21.15.99:0/802890006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e806ebe0 0x7f19e8071de0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- 172.21.15.99:0/802890006 >> 172.21.15.99:0/802890006 conn(0x7f19e80b8080 msgr2=0x7f19e80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:11.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- 172.21.15.99:0/802890006 shutdown_connections 2024-01-19T05:19:11.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- 172.21.15.99:0/802890006 wait complete. 2024-01-19T05:19:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 Processor -- start 2024-01-19T05:19:11.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- start start 2024-01-19T05:19:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19e806ebe0 0x7f19e8132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19e8072320 0x7f19e813aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e80b19f0 0x7f19e80b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e813c8a0 con 0x7f19e80b19f0 2024-01-19T05:19:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81e0cf0 con 0x7f19e806ebe0 2024-01-19T05:19:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81e06a0 con 0x7f19e8072320 2024-01-19T05:19:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e80b19f0 0x7f19e80b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e80b19f0 0x7f19e80b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57784/0 (socket says 172.21.15.99:57784) 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 -- 172.21.15.99:0/246421479 learned_addr learned my addr 172.21.15.99:0/246421479 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ecf82640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19e806ebe0 0x7f19e8132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19e7fff640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19e8072320 0x7f19e813aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 -- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19e8072320 msgr2=0x7f19e813aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19e8072320 0x7f19e813aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 -- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19e806ebe0 msgr2=0x7f19e8132800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19e806ebe0 0x7f19e8132800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 -- 172.21.15.99:0/246421479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8009420 con 0x7f19e80b19f0 2024-01-19T05:19:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ecf82640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19e806ebe0 0x7f19e8132800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ed783640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e80b19f0 0x7f19e80b5e80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f19e000cb40 tx=0x7f19e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19e57fa640 1 -- 172.21.15.99:0/246421479 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e000aca0 con 0x7f19e80b19f0 2024-01-19T05:19:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19e57fa640 1 -- 172.21.15.99:0/246421479 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e000ae00 con 0x7f19e80b19f0 2024-01-19T05:19:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e81e0980 con 0x7f19e80b19f0 2024-01-19T05:19:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19e57fa640 1 -- 172.21.15.99:0/246421479 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0012620 con 0x7f19e80b19f0 2024-01-19T05:19:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.987+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80b7080 con 0x7f19e80b19f0 2024-01-19T05:19:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.991+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e81e0500 con 0x7f19e80b19f0 2024-01-19T05:19:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.991+0000 7f19e57fa640 1 -- 172.21.15.99:0/246421479 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f19e0007070 con 0x7f19e80b19f0 2024-01-19T05:19:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.991+0000 7f19e57fa640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19d4066500 0x7f19d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.991+0000 7f19e57fa640 1 -- 172.21.15.99:0/246421479 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f19e0083a50 con 0x7f19e80b19f0 2024-01-19T05:19:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.991+0000 7f19ecf82640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19d4066500 0x7f19d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.991+0000 7f19ecf82640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19d4066500 0x7f19d40689c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f19e8133020 tx=0x7f19dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:11.995+0000 7f19e57fa640 1 -- 172.21.15.99:0/246421479 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f19e81e0500 con 0x7f19e80b19f0 2024-01-19T05:19:12.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.147+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f19e8072730 con 0x7f19d4066500 2024-01-19T05:19:12.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.147+0000 7f19e57fa640 1 -- 172.21.15.99:0/246421479 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f19dc001c60 con 0x7f19d4066500 2024-01-19T05:19:12.150 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 0 to deep-scrub 2024-01-19T05:19:12.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19d4066500 msgr2=0x7f19d40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19d4066500 0x7f19d40689c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f19e8133020 tx=0x7f19dc009040 comp rx=0 tx=0).stop 2024-01-19T05:19:12.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e80b19f0 msgr2=0x7f19e80b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e80b19f0 0x7f19e80b5e80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f19e000cb40 tx=0x7f19e000a060 comp rx=0 tx=0).stop 2024-01-19T05:19:12.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 shutdown_connections 2024-01-19T05:19:12.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f19d4066500 0x7f19d40689c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19e80b19f0 0x7f19e80b5e80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19e8072320 0x7f19e813aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 --2- 172.21.15.99:0/246421479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19e806ebe0 0x7f19e8132800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 >> 172.21.15.99:0/246421479 conn(0x7f19e80b8080 msgr2=0x7f19e80735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:12.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 shutdown_connections 2024-01-19T05:19:12.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.151+0000 7f19ef1e6640 1 -- 172.21.15.99:0/246421479 wait complete. 2024-01-19T05:19:12.167 INFO:tasks.ceph:Scrubbing osd.1 2024-01-19T05:19:12.167 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:19:12.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b96a7640 1 Processor -- start 2024-01-19T05:19:12.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b96a7640 1 -- start start 2024-01-19T05:19:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b96a7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40acad0 0x7f69b40b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b96a7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f69b40725b0 0x7f69b4146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b96a7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f69b40b22b0 0x7f69b41473f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b96a7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b4141020 con 0x7f69b40b22b0 2024-01-19T05:19:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b96a7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b40ae1a0 con 0x7f69b40725b0 2024-01-19T05:19:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b96a7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40aceb0 con 0x7f69b40acad0 2024-01-19T05:19:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b37fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f69b40b22b0 0x7f69b41473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b37fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f69b40b22b0 0x7f69b41473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57800/0 (socket says 172.21.15.99:57800) 2024-01-19T05:19:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b37fe640 1 -- 172.21.15.99:0/2084814619 learned_addr learned my addr 172.21.15.99:0/2084814619 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b2ffd640 1 --2- 172.21.15.99:0/2084814619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40acad0 0x7f69b40b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b27fc640 1 --2- 172.21.15.99:0/2084814619 >> v2:172.21.15.157:3300/0 conn(0x7f69b40725b0 0x7f69b4146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b37fe640 1 -- 172.21.15.99:0/2084814619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40acad0 msgr2=0x7f69b40b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b37fe640 1 --2- 172.21.15.99:0/2084814619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40acad0 0x7f69b40b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b37fe640 1 -- 172.21.15.99:0/2084814619 >> v2:172.21.15.157:3300/0 conn(0x7f69b40725b0 msgr2=0x7f69b4146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b37fe640 1 --2- 172.21.15.99:0/2084814619 >> v2:172.21.15.157:3300/0 conn(0x7f69b40725b0 0x7f69b4146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b37fe640 1 -- 172.21.15.99:0/2084814619 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40aefc0 con 0x7f69b40b22b0 2024-01-19T05:19:12.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.287+0000 7f69b27fc640 1 --2- 172.21.15.99:0/2084814619 >> v2:172.21.15.157:3300/0 conn(0x7f69b40725b0 0x7f69b4146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:12.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b37fe640 1 --2- 172.21.15.99:0/2084814619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40b22b0 0x7f69b41473f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f69b406ad30 tx=0x7f69a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfd0773a5f7f7ba server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b1ffb640 1 -- 172.21.15.99:0/2084814619 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40aa5f0 con 0x7f69b40b22b0 2024-01-19T05:19:12.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b1ffb640 1 -- 172.21.15.99:0/2084814619 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a40aa750 con 0x7f69b40b22b0 2024-01-19T05:19:12.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b1ffb640 1 -- 172.21.15.99:0/2084814619 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40aaae0 con 0x7f69b40b22b0 2024-01-19T05:19:12.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- 172.21.15.99:0/2084814619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40b22b0 msgr2=0x7f69b41473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 --2- 172.21.15.99:0/2084814619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40b22b0 0x7f69b41473f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f69b406ad30 tx=0x7f69a401c4d0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- 172.21.15.99:0/2084814619 shutdown_connections 2024-01-19T05:19:12.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 --2- 172.21.15.99:0/2084814619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40b22b0 0x7f69b41473f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 --2- 172.21.15.99:0/2084814619 >> v2:172.21.15.157:3300/0 conn(0x7f69b40725b0 0x7f69b4146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 --2- 172.21.15.99:0/2084814619 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40acad0 0x7f69b40b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- 172.21.15.99:0/2084814619 >> 172.21.15.99:0/2084814619 conn(0x7f69b40b8080 msgr2=0x7f69b40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:12.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- 172.21.15.99:0/2084814619 shutdown_connections 2024-01-19T05:19:12.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- 172.21.15.99:0/2084814619 wait complete. 2024-01-19T05:19:12.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 Processor -- start 2024-01-19T05:19:12.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- start start 2024-01-19T05:19:12.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40acad0 0x7f69b4148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40b22b0 0x7f69b4141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69b4142610 0x7f69b4142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4142fe0 con 0x7f69b40acad0 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4071260 con 0x7f69b4142610 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b96a7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4140190 con 0x7f69b40b22b0 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40acad0 0x7f69b4148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40acad0 0x7f69b4148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57808/0 (socket says 172.21.15.99:57808) 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b2ffd640 1 -- 172.21.15.99:0/1899515209 learned_addr learned my addr 172.21.15.99:0/1899515209 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b27fc640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40b22b0 0x7f69b4141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b2ffd640 1 -- 172.21.15.99:0/1899515209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40b22b0 msgr2=0x7f69b4141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b2ffd640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40b22b0 0x7f69b4141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b2ffd640 1 -- 172.21.15.99:0/1899515209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69b4142610 msgr2=0x7f69b4142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.291+0000 7f69b37fe640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69b4142610 0x7f69b4142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b2ffd640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69b4142610 0x7f69b4142aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b2ffd640 1 -- 172.21.15.99:0/1899515209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40094d0 con 0x7f69b40acad0 2024-01-19T05:19:12.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b27fc640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69b40b22b0 0x7f69b4141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:12.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b2ffd640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40acad0 0x7f69b4148e10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69ac007ec0 tx=0x7f69ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac014620 con 0x7f69b40acad0 2024-01-19T05:19:12.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac0147a0 con 0x7f69b40acad0 2024-01-19T05:19:12.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac014b50 con 0x7f69b40acad0 2024-01-19T05:19:12.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b4071530 con 0x7f69b40acad0 2024-01-19T05:19:12.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b4141b30 con 0x7f69b40acad0 2024-01-19T05:19:12.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69b414a570 con 0x7f69b40acad0 2024-01-19T05:19:12.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f69ac014cb0 con 0x7f69b40acad0 2024-01-19T05:19:12.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f69a0066500 0x7f69a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f69ac085370 con 0x7f69b40acad0 2024-01-19T05:19:12.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b27fc640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f69a0066500 0x7f69a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f69a006c360 0x7f69a006e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 --> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69a006ee30 con 0x7f69a006c360 2024-01-19T05:19:12.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69ac0857c0 con 0x7f69b40acad0 2024-01-19T05:19:12.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b37fe640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f69a006c360 0x7f69a006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b27fc640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f69a0066500 0x7f69a00689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f69b4144730 tx=0x7f69a8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f69b37fe640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f69a006c360 0x7f69a006e780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.295+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 <== osd.1 v2:172.21.15.99:6812/2851887188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f69a006ee30 con 0x7f69a006c360 2024-01-19T05:19:12.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 --> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f69b4142330 con 0x7f69a006c360 2024-01-19T05:19:12.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f699b7fe640 1 -- 172.21.15.99:0/1899515209 <== osd.1 v2:172.21.15.99:6812/2851887188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f69b4142330 con 0x7f69a006c360 2024-01-19T05:19:12.311 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:19:12.312 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:19:12.312 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:19:12.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f69a006c360 msgr2=0x7f69a006e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6812/2851887188,v1:172.21.15.99:6814/2851887188] conn(0x7f69a006c360 0x7f69a006e780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f69a0066500 msgr2=0x7f69a00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f69a0066500 0x7f69a00689c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f69b4144730 tx=0x7f69a8008040 comp rx=0 tx=0).stop 2024-01-19T05:19:12.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40acad0 msgr2=0x7f69b4148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 --2- 172.21.15.99:0/1899515209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69b40acad0 0x7f69b4148e10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69ac007ec0 tx=0x7f69ac00e4b0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b37fe640 1 -- 172.21.15.99:0/1899515209 reap_dead start 2024-01-19T05:19:12.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 shutdown_connections 2024-01-19T05:19:12.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 >> 172.21.15.99:0/1899515209 conn(0x7f69b40b8080 msgr2=0x7f69b4145f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:12.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 shutdown_connections 2024-01-19T05:19:12.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.311+0000 7f69b96a7640 1 -- 172.21.15.99:0/1899515209 wait complete. 2024-01-19T05:19:12.326 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-19T05:19:12.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ec1dbf640 1 Processor -- start 2024-01-19T05:19:12.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ec1dbf640 1 -- start start 2024-01-19T05:19:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ec1dbf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8ebc0b7570 0x7f8ebc0b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ec1dbf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 0x7f8ebc1407e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ec1dbf640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ebc06c6c0 con 0x7f8ebc14a290 2024-01-19T05:19:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ec1dbf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ebc06cc60 con 0x7f8ebc0b7570 2024-01-19T05:19:12.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ec1dbf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc0b6540 con 0x7f8ebc149e30 2024-01-19T05:19:12.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebbfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8ebc14a290 0x7f8ebc070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35336/0 (socket says 172.21.15.99:35336) 2024-01-19T05:19:12.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebbfff640 1 -- 172.21.15.99:0/3472140371 learned_addr learned my addr 172.21.15.99:0/3472140371 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:12.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebb7fe640 1 --2- 172.21.15.99:0/3472140371 >> v2:172.21.15.157:3300/0 conn(0x7f8ebc0b7570 0x7f8ebc0b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebaffd640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 0x7f8ebc1407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202879604 0 0) 0x7f8ebc06c6c0 con 0x7f8ebc14a290 2024-01-19T05:19:12.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea8003530 con 0x7f8ebc14a290 2024-01-19T05:19:12.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918543843 0 0) 0x7f8ea8003530 con 0x7f8ebc14a290 2024-01-19T05:19:12.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 msgr2=0x7f8ebc1407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 0x7f8ebc1407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 >> v2:172.21.15.157:3300/0 conn(0x7f8ebc0b7570 msgr2=0x7f8ebc0b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 --2- 172.21.15.99:0/3472140371 >> v2:172.21.15.157:3300/0 conn(0x7f8ebc0b7570 0x7f8ebc0b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc0b7950 con 0x7f8ebc14a290 2024-01-19T05:19:12.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f8eac001680 con 0x7f8ebc14a290 2024-01-19T05:19:12.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 >> v1:172.21.15.99:6789/0 conn(0x7f8ebc14a290 legacy=0x7f8ebc070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 0x7f8ea8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea8003f00 0x7f8ea80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8004d10 0x7f8ea8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc06cc60 con 0x7f8ea8003f00 2024-01-19T05:19:12.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc0b6540 con 0x7f8ea8004d10 2024-01-19T05:19:12.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea800b990 con 0x7f8ebc149e30 2024-01-19T05:19:12.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebaffd640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea8003f00 0x7f8ea80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebb7fe640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 0x7f8ea8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebbfff640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8004d10 0x7f8ea8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebaffd640 1 -- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 msgr2=0x7f8ea8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebaffd640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 0x7f8ea8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebaffd640 1 -- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8004d10 msgr2=0x7f8ea8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebaffd640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8004d10 0x7f8ea8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebaffd640 1 -- 172.21.15.99:0/3472140371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8003530 con 0x7f8ea8003f00 2024-01-19T05:19:12.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebb7fe640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc149e30 0x7f8ea8003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:12.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.439+0000 7f8ebbfff640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8004d10 0x7f8ea8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:12.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebaffd640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea8003f00 0x7f8ea80047d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009ae0 tx=0x7f8ea401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3395bcf08922b74 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40a5530 con 0x7f8ea8003f00 2024-01-19T05:19:12.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40a5690 con 0x7f8ea8003f00 2024-01-19T05:19:12.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8eba7fc640 1 -- 172.21.15.99:0/3472140371 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40a5a40 con 0x7f8ea8003f00 2024-01-19T05:19:12.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/3472140371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea8003f00 msgr2=0x7f8ea80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 --2- 172.21.15.99:0/3472140371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea8003f00 0x7f8ea80047d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009ae0 tx=0x7f8ea401c9f0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 -- 172.21.15.99:0/3472140371 reap_dead start 2024-01-19T05:19:12.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/3472140371 shutdown_connections 2024-01-19T05:19:12.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/3472140371 >> 172.21.15.99:0/3472140371 conn(0x7f8ebc0ba700 msgr2=0x7f8ebc0b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:12.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/3472140371 shutdown_connections 2024-01-19T05:19:12.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/3472140371 wait complete. 2024-01-19T05:19:12.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 Processor -- start 2024-01-19T05:19:12.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- start start 2024-01-19T05:19:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8003f00 0x7f8ebc1df4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc1477f0 0x7f8ebc141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ebc142440 0x7f8ebc09fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc143950 con 0x7f8ebc142440 2024-01-19T05:19:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc1428d0 con 0x7f8ea8003f00 2024-01-19T05:19:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ec1dbf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc141a20 con 0x7f8ebc1477f0 2024-01-19T05:19:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ebc142440 0x7f8ebc09fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ebc142440 0x7f8ebc09fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57830/0 (socket says 172.21.15.99:57830) 2024-01-19T05:19:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 -- 172.21.15.99:0/1007215446 learned_addr learned my addr 172.21.15.99:0/1007215446 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebaffd640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc1477f0 0x7f8ebc141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebb7fe640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8003f00 0x7f8ebc1df4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 -- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc1477f0 msgr2=0x7f8ebc141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc1477f0 0x7f8ebc141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 -- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8003f00 msgr2=0x7f8ebc1df4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8003f00 0x7f8ebc1df4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebbfff640 1 -- 172.21.15.99:0/1007215446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc06d270 con 0x7f8ebc142440 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.443+0000 7f8ebb7fe640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8003f00 0x7f8ebc1df4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8ebbfff640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ebc142440 0x7f8ebc09fb10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc14aef0 tx=0x7f8eac010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8eb3fff640 1 -- 172.21.15.99:0/1007215446 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00eac0 con 0x7f8ebc142440 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8eb3fff640 1 -- 172.21.15.99:0/1007215446 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac00ec40 con 0x7f8ebc142440 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ebc1dfe50 con 0x7f8ebc142440 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8eb3fff640 1 -- 172.21.15.99:0/1007215446 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac015400 con 0x7f8ebc142440 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ebc1e0130 con 0x7f8ebc142440 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ebc067bf0 con 0x7f8ebc142440 2024-01-19T05:19:12.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8eb3fff640 1 -- 172.21.15.99:0/1007215446 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8eac01e3b0 con 0x7f8ebc142440 2024-01-19T05:19:12.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8eb3fff640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8e9c066500 0x7f8e9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8eb3fff640 1 -- 172.21.15.99:0/1007215446 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8eac0866e0 con 0x7f8ebc142440 2024-01-19T05:19:12.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8ebb7fe640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8e9c066500 0x7f8e9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.447+0000 7f8ebb7fe640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8e9c066500 0x7f8e9c0689c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4007520 tx=0x7f8eb400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.451+0000 7f8eb3fff640 1 -- 172.21.15.99:0/1007215446 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8eac053d10 con 0x7f8ebc142440 2024-01-19T05:19:12.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ebc06d0f0 con 0x7f8e9c066500 2024-01-19T05:19:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8eb3fff640 1 -- 172.21.15.99:0/1007215446 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8eb400f040 con 0x7f8e9c066500 2024-01-19T05:19:12.608 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 1 to deep-scrub 2024-01-19T05:19:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8e9c066500 msgr2=0x7f8e9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8e9c066500 0x7f8e9c0689c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4007520 tx=0x7f8eb400b040 comp rx=0 tx=0).stop 2024-01-19T05:19:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ebc142440 msgr2=0x7f8ebc09fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ebc142440 0x7f8ebc09fb10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc14aef0 tx=0x7f8eac010ca0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 shutdown_connections 2024-01-19T05:19:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f8e9c066500 0x7f8e9c0689c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ebc142440 0x7f8ebc09fb10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ebc1477f0 0x7f8ebc141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 --2- 172.21.15.99:0/1007215446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ea8003f00 0x7f8ebc1df4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 >> 172.21.15.99:0/1007215446 conn(0x7f8ebc0ba700 msgr2=0x7f8ebc0b8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 shutdown_connections 2024-01-19T05:19:12.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.607+0000 7f8ec1dbf640 1 -- 172.21.15.99:0/1007215446 wait complete. 2024-01-19T05:19:12.626 INFO:tasks.ceph:Scrubbing osd.2 2024-01-19T05:19:12.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:19:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212c4cf640 1 Processor -- start 2024-01-19T05:19:12.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212c4cf640 1 -- start start 2024-01-19T05:19:12.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212c4cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f212406ddf0 0x7f21241446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212c4cf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f212413ebc0 0x7f212414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212c4cf640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2124071880 con 0x7f2124144c20 2024-01-19T05:19:12.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212c4cf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21240715e0 con 0x7f212413ebc0 2024-01-19T05:19:12.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212c4cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2124145080 con 0x7f212406ddf0 2024-01-19T05:19:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129a6a640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2124144c20 0x7f212413e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35348/0 (socket says 172.21.15.99:35348) 2024-01-19T05:19:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129a6a640 1 -- 172.21.15.99:0/839625397 learned_addr learned my addr 172.21.15.99:0/839625397 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892505717 0 0) 0x7f2124071880 con 0x7f2124144c20 2024-01-19T05:19:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2110003530 con 0x7f2124144c20 2024-01-19T05:19:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212a26b640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f212406ddf0 0x7f21241446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212aa6c640 1 --2- 172.21.15.99:0/839625397 >> v2:172.21.15.157:3300/0 conn(0x7f212413ebc0 0x7f212414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2303273731 0 0) 0x7f2110003530 con 0x7f2124144c20 2024-01-19T05:19:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f212406ddf0 msgr2=0x7f21241446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f212406ddf0 0x7f21241446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 >> v2:172.21.15.157:3300/0 conn(0x7f212413ebc0 msgr2=0x7f212414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 --2- 172.21.15.99:0/839625397 >> v2:172.21.15.157:3300/0 conn(0x7f212413ebc0 0x7f212414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212406e1d0 con 0x7f2124144c20 2024-01-19T05:19:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f2114001680 con 0x7f2124144c20 2024-01-19T05:19:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212aa6c640 1 --2- 172.21.15.99:0/839625397 >> v2:172.21.15.157:3300/0 conn(0x7f212413ebc0 0x7f212414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:19:12.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 >> v1:172.21.15.99:6789/0 conn(0x7f2124144c20 legacy=0x7f212413e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2110003980 0x7f2110003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21100047d0 0x7f2110004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2110005190 0x7f211000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21240715e0 con 0x7f21100047d0 2024-01-19T05:19:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124145080 con 0x7f2110005190 2024-01-19T05:19:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211000c060 con 0x7f2110003980 2024-01-19T05:19:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212a26b640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f212406ddf0 0x7f21241446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:19:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129a6a640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21100047d0 0x7f2110004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129a6a640 1 -- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2110003980 msgr2=0x7f2110003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129a6a640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2110003980 0x7f2110003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129a6a640 1 -- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2110005190 msgr2=0x7f211000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f212aa6c640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2110005190 0x7f211000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129a6a640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2110005190 0x7f211000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.747+0000 7f2129a6a640 1 -- 172.21.15.99:0/839625397 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110003530 con 0x7f21100047d0 2024-01-19T05:19:12.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f2129a6a640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21100047d0 0x7f2110004c50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f211400c210 tx=0x7f211401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32738921b4cfca server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21140058e0 con 0x7f21100047d0 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114005a40 con 0x7f21100047d0 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f2129269640 1 -- 172.21.15.99:0/839625397 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114005e50 con 0x7f21100047d0 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- 172.21.15.99:0/839625397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21100047d0 msgr2=0x7f2110004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 --2- 172.21.15.99:0/839625397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21100047d0 0x7f2110004c50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f211400c210 tx=0x7f211401cc30 comp rx=0 tx=0).stop 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212aa6c640 1 -- 172.21.15.99:0/839625397 reap_dead start 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- 172.21.15.99:0/839625397 shutdown_connections 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- 172.21.15.99:0/839625397 >> 172.21.15.99:0/839625397 conn(0x7f21240ba100 msgr2=0x7f21240ba510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- 172.21.15.99:0/839625397 shutdown_connections 2024-01-19T05:19:12.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- 172.21.15.99:0/839625397 wait complete. 2024-01-19T05:19:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 Processor -- start 2024-01-19T05:19:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- start start 2024-01-19T05:19:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21100047d0 0x7f2124141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f212413f8e0 0x7f212413fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21241de720 0x7f21241deba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212409c820 con 0x7f212413f8e0 2024-01-19T05:19:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124140f90 con 0x7f21241de720 2024-01-19T05:19:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f212c4cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21241402a0 con 0x7f21100047d0 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f2129a6a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f212413f8e0 0x7f212413fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f2129a6a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f212413f8e0 0x7f212413fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57848/0 (socket says 172.21.15.99:57848) 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.751+0000 7f2129a6a640 1 -- 172.21.15.99:0/2291932987 learned_addr learned my addr 172.21.15.99:0/2291932987 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212aa6c640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21241de720 0x7f21241deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212a26b640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21100047d0 0x7f2124141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f2129a6a640 1 -- 172.21.15.99:0/2291932987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21100047d0 msgr2=0x7f2124141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f2129a6a640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f21100047d0 0x7f2124141c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f2129a6a640 1 -- 172.21.15.99:0/2291932987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21241de720 msgr2=0x7f21241deba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f2129a6a640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21241de720 0x7f21241deba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f2129a6a640 1 -- 172.21.15.99:0/2291932987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21241414a0 con 0x7f212413f8e0 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212aa6c640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21241de720 0x7f21241deba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f2129a6a640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f212413f8e0 0x7f212413fd60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2114007040 tx=0x7f2110005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21140a5820 con 0x7f212413f8e0 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21140a5980 con 0x7f212413f8e0 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212409c160 con 0x7f212413f8e0 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21140a5cf0 con 0x7f212413f8e0 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21241411c0 con 0x7f212413f8e0 2024-01-19T05:19:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f212409cc10 con 0x7f212413f8e0 2024-01-19T05:19:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f21140047f0 con 0x7f212413f8e0 2024-01-19T05:19:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2108066500 0x7f21080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f211411d970 con 0x7f212413f8e0 2024-01-19T05:19:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212a26b640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2108066500 0x7f21080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7f210806c360 0x7f210806e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 --> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f210806ee30 con 0x7f210806c360 2024-01-19T05:19:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f211411ddc0 con 0x7f212413f8e0 2024-01-19T05:19:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212aa6c640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7f210806c360 0x7f210806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212a26b640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2108066500 0x7f21080689c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2120006aa0 tx=0x7f2120008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f212aa6c640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7f210806c360 0x7f210806e780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.755+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 <== osd.2 v2:172.21.15.99:6824/296546613 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f210806ee30 con 0x7f210806c360 2024-01-19T05:19:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.767+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 --> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f212409c960 con 0x7f210806c360 2024-01-19T05:19:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f211affd640 1 -- 172.21.15.99:0/2291932987 <== osd.2 v2:172.21.15.99:6824/296546613 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f212409c960 con 0x7f210806c360 2024-01-19T05:19:12.771 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:19:12.771 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:19:12.771 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:19:12.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7f210806c360 msgr2=0x7f210806e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6824/296546613,v1:172.21.15.99:6825/296546613] conn(0x7f210806c360 0x7f210806e780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2108066500 msgr2=0x7f21080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f2108066500 0x7f21080689c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2120006aa0 tx=0x7f2120008040 comp rx=0 tx=0).stop 2024-01-19T05:19:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f212413f8e0 msgr2=0x7f212413fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 --2- 172.21.15.99:0/2291932987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f212413f8e0 0x7f212413fd60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2114007040 tx=0x7f2110005800 comp rx=0 tx=0).stop 2024-01-19T05:19:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212aa6c640 1 -- 172.21.15.99:0/2291932987 reap_dead start 2024-01-19T05:19:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 shutdown_connections 2024-01-19T05:19:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 >> 172.21.15.99:0/2291932987 conn(0x7f21240ba100 msgr2=0x7f21240ba510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 shutdown_connections 2024-01-19T05:19:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.771+0000 7f212c4cf640 1 -- 172.21.15.99:0/2291932987 wait complete. 2024-01-19T05:19:12.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-19T05:19:12.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbe9d3640 1 Processor -- start 2024-01-19T05:19:12.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbe9d3640 1 -- start start 2024-01-19T05:19:12.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbe9d3640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbbb806ccf0 0x7fbbb8144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbe9d3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbbb80b3a10 0x7fbbb80ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbe9d3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 0x7fbbb8146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbe9d3640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb8143dc0 con 0x7fbbb806ccf0 2024-01-19T05:19:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbe9d3640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb80b3ea0 con 0x7fbbb80b3a10 2024-01-19T05:19:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbe9d3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb806d0d0 con 0x7fbbb80aea40 2024-01-19T05:19:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbbb806ccf0 0x7fbbb8144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbbb806ccf0 0x7fbbb8144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57850/0 (socket says 172.21.15.99:57850) 2024-01-19T05:19:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb7fff640 1 -- 172.21.15.99:0/577996019 learned_addr learned my addr 172.21.15.99:0/577996019 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb77fe640 1 --2- 172.21.15.99:0/577996019 >> v2:172.21.15.157:3300/0 conn(0x7fbbb80b3a10 0x7fbbb80ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbbcf70640 1 --2- 172.21.15.99:0/577996019 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 0x7fbbb8146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb7fff640 1 -- 172.21.15.99:0/577996019 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 msgr2=0x7fbbb8146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb7fff640 1 --2- 172.21.15.99:0/577996019 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 0x7fbbb8146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb7fff640 1 -- 172.21.15.99:0/577996019 >> v2:172.21.15.157:3300/0 conn(0x7fbbb80b3a10 msgr2=0x7fbbb80ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb7fff640 1 --2- 172.21.15.99:0/577996019 >> v2:172.21.15.157:3300/0 conn(0x7fbbb80b3a10 0x7fbbb80ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb7fff640 1 -- 172.21.15.99:0/577996019 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8143770 con 0x7fbbb806ccf0 2024-01-19T05:19:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.891+0000 7fbbb77fe640 1 --2- 172.21.15.99:0/577996019 >> v2:172.21.15.157:3300/0 conn(0x7fbbb80b3a10 0x7fbbb80ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:12.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 --2- 172.21.15.99:0/577996019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb8144250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80b5920 tx=0x7fbbb001c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1738b31ebe162f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb6ffd640 1 -- 172.21.15.99:0/577996019 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00a6500 con 0x7fbbb806ccf0 2024-01-19T05:19:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb6ffd640 1 -- 172.21.15.99:0/577996019 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb00a6660 con 0x7fbbb806ccf0 2024-01-19T05:19:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb6ffd640 1 -- 172.21.15.99:0/577996019 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00a69f0 con 0x7fbbb806ccf0 2024-01-19T05:19:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/577996019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 msgr2=0x7fbbb8144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/577996019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb8144250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80b5920 tx=0x7fbbb001c650 comp rx=0 tx=0).stop 2024-01-19T05:19:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/577996019 shutdown_connections 2024-01-19T05:19:12.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/577996019 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 0x7fbbb8146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/577996019 >> v2:172.21.15.157:3300/0 conn(0x7fbbb80b3a10 0x7fbbb80ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/577996019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb8144250 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/577996019 >> 172.21.15.99:0/577996019 conn(0x7fbbb8066ef0 msgr2=0x7fbbb80b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/577996019 shutdown_connections 2024-01-19T05:19:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/577996019 wait complete. 2024-01-19T05:19:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 Processor -- start 2024-01-19T05:19:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- start start 2024-01-19T05:19:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 0x7fbbb81451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbb80b3a10 0x7fbbb81371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb814fde0 con 0x7fbbb806ccf0 2024-01-19T05:19:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb81e2000 con 0x7fbbb80b3a10 2024-01-19T05:19:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbe9d3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb81e22e0 con 0x7fbbb80aea40 2024-01-19T05:19:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb814e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57860/0 (socket says 172.21.15.99:57860) 2024-01-19T05:19:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 -- 172.21.15.99:0/1305430240 learned_addr learned my addr 172.21.15.99:0/1305430240 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 -- 172.21.15.99:0/1305430240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 msgr2=0x7fbbb81451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb77fe640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 0x7fbbb81451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbbcf70640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbb80b3a10 0x7fbbb81371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 0x7fbbb81451e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 -- 172.21.15.99:0/1305430240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbb80b3a10 msgr2=0x7fbbb81371a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbb80b3a10 0x7fbbb81371a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:12.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 -- 172.21.15.99:0/1305430240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb0009b30 con 0x7fbbb806ccf0 2024-01-19T05:19:12.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.895+0000 7fbbb7fff640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb814e3e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbbb001ad00 tx=0x7fbbb00193f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbb4ff9640 1 -- 172.21.15.99:0/1305430240 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00b4070 con 0x7fbbb806ccf0 2024-01-19T05:19:12.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbb4ff9640 1 -- 172.21.15.99:0/1305430240 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0009290 con 0x7fbbb806ccf0 2024-01-19T05:19:12.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbb4ff9640 1 -- 172.21.15.99:0/1305430240 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00a6a10 con 0x7fbbb806ccf0 2024-01-19T05:19:12.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb81e25c0 con 0x7fbbb806ccf0 2024-01-19T05:19:12.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb814c4c0 con 0x7fbbb806ccf0 2024-01-19T05:19:12.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb806b770 con 0x7fbbb806ccf0 2024-01-19T05:19:12.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbb4ff9640 1 -- 172.21.15.99:0/1305430240 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbbb00b8070 con 0x7fbbb806ccf0 2024-01-19T05:19:12.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbb4ff9640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbba4066500 0x7fbba40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:12.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbb77fe640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbba4066500 0x7fbba40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:12.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbb4ff9640 1 -- 172.21.15.99:0/1305430240 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbbb00aa070 con 0x7fbbb806ccf0 2024-01-19T05:19:12.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.899+0000 7fbbb77fe640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbba4066500 0x7fbba40689c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbb813cde0 tx=0x7fbbac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:12.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:12.903+0000 7fbbb4ff9640 1 -- 172.21.15.99:0/1305430240 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fbbb00eaef0 con 0x7fbbb806ccf0 2024-01-19T05:19:13.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbb81e2170 con 0x7fbba4066500 2024-01-19T05:19:13.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbb4ff9640 1 -- 172.21.15.99:0/1305430240 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbbb81e2170 con 0x7fbba4066500 2024-01-19T05:19:13.060 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 2 to deep-scrub 2024-01-19T05:19:13.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbba4066500 msgr2=0x7fbba40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbba4066500 0x7fbba40689c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbb813cde0 tx=0x7fbbac008040 comp rx=0 tx=0).stop 2024-01-19T05:19:13.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 msgr2=0x7fbbb814e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb814e3e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbbb001ad00 tx=0x7fbbb00193f0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 shutdown_connections 2024-01-19T05:19:13.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fbba4066500 0x7fbba40689c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbb80b3a10 0x7fbbb81371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbb80aea40 0x7fbbb81451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 --2- 172.21.15.99:0/1305430240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbb806ccf0 0x7fbbb814e3e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 >> 172.21.15.99:0/1305430240 conn(0x7fbbb8066ef0 msgr2=0x7fbbb806a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 shutdown_connections 2024-01-19T05:19:13.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.059+0000 7fbbbe9d3640 1 -- 172.21.15.99:0/1305430240 wait complete. 2024-01-19T05:19:13.077 INFO:tasks.ceph:Scrubbing osd.3 2024-01-19T05:19:13.077 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:19:13.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.187+0000 7f76ec5d3640 1 Processor -- start 2024-01-19T05:19:13.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.187+0000 7f76ec5d3640 1 -- start start 2024-01-19T05:19:13.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f76e406ebe0 0x7f76e4071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e4072320 0x7f76e414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e406f070 con 0x7f76e40b19f0 2024-01-19T05:19:13.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e4070680 con 0x7f76e406ebe0 2024-01-19T05:19:13.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4070410 con 0x7f76e4072320 2024-01-19T05:19:13.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e9b6e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f76e406ebe0 0x7f76e4071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ea36f640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f76e40b19f0 0x7f76e4144c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35362/0 (socket says 172.21.15.99:35362) 2024-01-19T05:19:13.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e9b6e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f76e406ebe0 0x7f76e4071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57862/0 (socket says 172.21.15.99:57862) 2024-01-19T05:19:13.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ea36f640 1 -- 172.21.15.99:0/126378411 learned_addr learned my addr 172.21.15.99:0/126378411 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:13.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76eab70640 1 --2- 172.21.15.99:0/126378411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e4072320 0x7f76e414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e9b6e640 1 -- 172.21.15.99:0/126378411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e4072320 msgr2=0x7f76e414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:13.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e9b6e640 1 --2- 172.21.15.99:0/126378411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e4072320 0x7f76e414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e9b6e640 1 -- 172.21.15.99:0/126378411 >> v1:172.21.15.99:6789/0 conn(0x7f76e40b19f0 legacy=0x7f76e4144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e936d640 1 -- 172.21.15.99:0/126378411 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269588591 0 0) 0x7f76dc0014a0 con 0x7f76e40b19f0 2024-01-19T05:19:13.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e9b6e640 1 -- 172.21.15.99:0/126378411 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4144790 con 0x7f76e406ebe0 2024-01-19T05:19:13.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e9b6e640 1 --2- 172.21.15.99:0/126378411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 0x7f76e4071de0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76d80097c0 tx=0x7f76d801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a909e9a8ef734a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e936d640 1 -- 172.21.15.99:0/126378411 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80ac640 con 0x7f76e406ebe0 2024-01-19T05:19:13.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e936d640 1 -- 172.21.15.99:0/126378411 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d80ac7a0 con 0x7f76e406ebe0 2024-01-19T05:19:13.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76e936d640 1 -- 172.21.15.99:0/126378411 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80acb30 con 0x7f76e406ebe0 2024-01-19T05:19:13.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 -- 172.21.15.99:0/126378411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 msgr2=0x7f76e4071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 --2- 172.21.15.99:0/126378411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 0x7f76e4071de0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76d80097c0 tx=0x7f76d801c3c0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 -- 172.21.15.99:0/126378411 shutdown_connections 2024-01-19T05:19:13.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 --2- 172.21.15.99:0/126378411 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e4072320 0x7f76e414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 --2- 172.21.15.99:0/126378411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 0x7f76e4071de0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.191+0000 7f76ec5d3640 1 -- 172.21.15.99:0/126378411 >> 172.21.15.99:0/126378411 conn(0x7f76e40b8080 msgr2=0x7f76e40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- 172.21.15.99:0/126378411 shutdown_connections 2024-01-19T05:19:13.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- 172.21.15.99:0/126378411 wait complete. 2024-01-19T05:19:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 Processor -- start 2024-01-19T05:19:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- start start 2024-01-19T05:19:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 0x7f76e40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e4072320 0x7f76e41410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76e40b19f0 0x7f76e41df140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40b0620 con 0x7f76e406ebe0 2024-01-19T05:19:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e413f680 con 0x7f76e40b19f0 2024-01-19T05:19:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40b0d30 con 0x7f76e4072320 2024-01-19T05:19:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 0x7f76e40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 0x7f76e40b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57868/0 (socket says 172.21.15.99:57868) 2024-01-19T05:19:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 -- 172.21.15.99:0/396569288 learned_addr learned my addr 172.21.15.99:0/396569288 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 -- 172.21.15.99:0/396569288 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e4072320 msgr2=0x7f76e41410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f76e4072320 0x7f76e41410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 -- 172.21.15.99:0/396569288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76e40b19f0 msgr2=0x7f76e41df140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76e40b19f0 0x7f76e41df140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 -- 172.21.15.99:0/396569288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8009420 con 0x7f76e406ebe0 2024-01-19T05:19:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ea36f640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 0x7f76e40b00e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00c7c0 tx=0x7f76dc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00a5e0 con 0x7f76e406ebe0 2024-01-19T05:19:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc00a760 con 0x7f76e406ebe0 2024-01-19T05:19:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e40b14d0 con 0x7f76e406ebe0 2024-01-19T05:19:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00ab10 con 0x7f76e406ebe0 2024-01-19T05:19:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e4140c30 con 0x7f76e406ebe0 2024-01-19T05:19:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76e4072730 con 0x7f76e406ebe0 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.195+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f76dc00ac70 con 0x7f76e406ebe0 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76e2ffd640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f76d0066500 0x7f76d00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f76dc083150 con 0x7f76e406ebe0 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76e9b6e640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f76d0066500 0x7f76d00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76e2ffd640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7f76d006c360 0x7f76d006e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 --> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76d006ee30 con 0x7f76d006c360 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76dc085810 con 0x7f76e406ebe0 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76eab70640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7f76d006c360 0x7f76d006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76e9b6e640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f76d0066500 0x7f76d00689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ae000 tx=0x7f76d8004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76eab70640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7f76d006c360 0x7f76d006e780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.199+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 <== osd.3 v2:172.21.15.99:6808/3419007009 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f76d006ee30 con 0x7f76d006c360 2024-01-19T05:19:13.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 --> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f76e406f590 con 0x7f76d006c360 2024-01-19T05:19:13.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76e2ffd640 1 -- 172.21.15.99:0/396569288 <== osd.3 v2:172.21.15.99:6808/3419007009 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f76d40099d0 con 0x7f76d006c360 2024-01-19T05:19:13.213 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:19:13.213 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:19:13.213 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:19:13.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7f76d006c360 msgr2=0x7f76d006e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6808/3419007009,v1:172.21.15.99:6809/3419007009] conn(0x7f76d006c360 0x7f76d006e780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f76d0066500 msgr2=0x7f76d00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f76d0066500 0x7f76d00689c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ae000 tx=0x7f76d8004740 comp rx=0 tx=0).stop 2024-01-19T05:19:13.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 msgr2=0x7f76e40b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 --2- 172.21.15.99:0/396569288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76e406ebe0 0x7f76e40b00e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00c7c0 tx=0x7f76dc00cc80 comp rx=0 tx=0).stop 2024-01-19T05:19:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76eab70640 1 -- 172.21.15.99:0/396569288 reap_dead start 2024-01-19T05:19:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 shutdown_connections 2024-01-19T05:19:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 >> 172.21.15.99:0/396569288 conn(0x7f76e40b8080 msgr2=0x7f76e40b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 shutdown_connections 2024-01-19T05:19:13.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.211+0000 7f76ec5d3640 1 -- 172.21.15.99:0/396569288 wait complete. 2024-01-19T05:19:13.227 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-19T05:19:13.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa2064e1640 1 Processor -- start 2024-01-19T05:19:13.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa2064e1640 1 -- start start 2024-01-19T05:19:13.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa2064e1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200072510 0x7fa2001415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa2064e1640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa200141b00 0x7fa20014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa2064e1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2001485b0 con 0x7fa20006e150 2024-01-19T05:19:13.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa2064e1640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20006e530 con 0x7fa200141b00 2024-01-19T05:19:13.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa2064e1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa200147f60 con 0x7fa200072510 2024-01-19T05:19:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa204a7e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa200141b00 0x7fa20014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa204a7e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa200141b00 0x7fa20014eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57872/0 (socket says 172.21.15.99:57872) 2024-01-19T05:19:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa204a7e640 1 -- 172.21.15.99:0/4210485701 learned_addr learned my addr 172.21.15.99:0/4210485701 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa1ff7fe640 1 --2- 172.21.15.99:0/4210485701 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200072510 0x7fa2001415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa204a7e640 1 -- 172.21.15.99:0/4210485701 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200072510 msgr2=0x7fa2001415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa204a7e640 1 --2- 172.21.15.99:0/4210485701 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200072510 0x7fa2001415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa204a7e640 1 -- 172.21.15.99:0/4210485701 >> v1:172.21.15.157:6789/0 conn(0x7fa20006e150 legacy=0x7fa200144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.327+0000 7fa204a7e640 1 -- 172.21.15.99:0/4210485701 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200148240 con 0x7fa200141b00 2024-01-19T05:19:13.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa204a7e640 1 --2- 172.21.15.99:0/4210485701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa200141b00 0x7fa20014eef0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009e50 tx=0x7fa1f801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0084d80822b3d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1feffd640 1 -- 172.21.15.99:0/4210485701 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80a5700 con 0x7fa200141b00 2024-01-19T05:19:13.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1feffd640 1 -- 172.21.15.99:0/4210485701 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f80a5860 con 0x7fa200141b00 2024-01-19T05:19:13.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1feffd640 1 -- 172.21.15.99:0/4210485701 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80a5bf0 con 0x7fa200141b00 2024-01-19T05:19:13.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- 172.21.15.99:0/4210485701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa200141b00 msgr2=0x7fa20014eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 --2- 172.21.15.99:0/4210485701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa200141b00 0x7fa20014eef0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009e50 tx=0x7fa1f801c8e0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- 172.21.15.99:0/4210485701 shutdown_connections 2024-01-19T05:19:13.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 --2- 172.21.15.99:0/4210485701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa200141b00 0x7fa20014eef0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 --2- 172.21.15.99:0/4210485701 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200072510 0x7fa2001415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- 172.21.15.99:0/4210485701 >> 172.21.15.99:0/4210485701 conn(0x7fa2000ba500 msgr2=0x7fa2000ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- 172.21.15.99:0/4210485701 shutdown_connections 2024-01-19T05:19:13.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- 172.21.15.99:0/4210485701 wait complete. 2024-01-19T05:19:13.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 Processor -- start 2024-01-19T05:19:13.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- start start 2024-01-19T05:19:13.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20006e150 0x7fa20006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa200072510 0x7fa2001e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200141b00 0x7fa20013ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20013f210 con 0x7fa20006e150 2024-01-19T05:19:13.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20006c050 con 0x7fa200072510 2024-01-19T05:19:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa2064e1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20006d720 con 0x7fa200141b00 2024-01-19T05:19:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20006e150 0x7fa20006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20006e150 0x7fa20006c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57884/0 (socket says 172.21.15.99:57884) 2024-01-19T05:19:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 -- 172.21.15.99:0/789426809 learned_addr learned my addr 172.21.15.99:0/789426809 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 -- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200141b00 msgr2=0x7fa20013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa204a7e640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200141b00 0x7fa20013ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200141b00 0x7fa20013ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 -- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa200072510 msgr2=0x7fa2001e20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1ff7fe640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa200072510 0x7fa2001e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa200072510 0x7fa2001e20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 -- 172.21.15.99:0/789426809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009b30 con 0x7fa20006e150 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1ff7fe640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa200072510 0x7fa2001e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.331+0000 7fa1fffff640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20006e150 0x7fa20006c7e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000b410 tx=0x7fa1f000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa1fcff9640 1 -- 172.21.15.99:0/789426809 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0004020 con 0x7fa20006e150 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa1fcff9640 1 -- 172.21.15.99:0/789426809 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0004180 con 0x7fa20006e150 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20013eea0 con 0x7fa20006e150 2024-01-19T05:19:13.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa1fcff9640 1 -- 172.21.15.99:0/789426809 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0011630 con 0x7fa20006e150 2024-01-19T05:19:13.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2000999f0 con 0x7fa20006e150 2024-01-19T05:19:13.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20006d580 con 0x7fa20006e150 2024-01-19T05:19:13.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa1fcff9640 1 -- 172.21.15.99:0/789426809 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa1f0011790 con 0x7fa20006e150 2024-01-19T05:19:13.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa1fcff9640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa1ec066500 0x7fa1ec0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa1fcff9640 1 -- 172.21.15.99:0/789426809 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa1f0083850 con 0x7fa20006e150 2024-01-19T05:19:13.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa1ff7fe640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa1ec066500 0x7fa1ec0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.335+0000 7fa1ff7fe640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa1ec066500 0x7fa1ec0689c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4006fd0 tx=0x7fa1f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.339+0000 7fa1fcff9640 1 -- 172.21.15.99:0/789426809 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa20006d580 con 0x7fa20006e150 2024-01-19T05:19:13.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa20006d580 con 0x7fa1ec066500 2024-01-19T05:19:13.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa1fcff9640 1 -- 172.21.15.99:0/789426809 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa20006d580 con 0x7fa1ec066500 2024-01-19T05:19:13.487 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 3 to deep-scrub 2024-01-19T05:19:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa1ec066500 msgr2=0x7fa1ec0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa1ec066500 0x7fa1ec0689c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4006fd0 tx=0x7fa1f4008040 comp rx=0 tx=0).stop 2024-01-19T05:19:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20006e150 msgr2=0x7fa20006c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20006e150 0x7fa20006c7e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000b410 tx=0x7fa1f000b8d0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 shutdown_connections 2024-01-19T05:19:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa1ec066500 0x7fa1ec0689c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa200141b00 0x7fa20013ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa200072510 0x7fa2001e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 --2- 172.21.15.99:0/789426809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20006e150 0x7fa20006c7e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 >> 172.21.15.99:0/789426809 conn(0x7fa2000ba500 msgr2=0x7fa2000b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 shutdown_connections 2024-01-19T05:19:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.487+0000 7fa2064e1640 1 -- 172.21.15.99:0/789426809 wait complete. 2024-01-19T05:19:13.504 INFO:tasks.ceph:Scrubbing osd.4 2024-01-19T05:19:13.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:19:13.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f85b9640 1 Processor -- start 2024-01-19T05:19:13.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f85b9640 1 -- start start 2024-01-19T05:19:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f85b9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93f00b19f0 0x7f93f006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f85b9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f93f0144c70 0x7f93f0145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f85b9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f0070680 con 0x7f93f0071de0 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f85b9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f0070410 con 0x7f93f00b19f0 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f85b9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f0144790 con 0x7f93f0144c70 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f6355640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93f00b19f0 0x7f93f006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f6355640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93f00b19f0 0x7f93f006ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57886/0 (socket says 172.21.15.99:57886) 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f6355640 1 -- 172.21.15.99:0/825641914 learned_addr learned my addr 172.21.15.99:0/825641914 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f5b54640 1 --2- 172.21.15.99:0/825641914 >> v2:172.21.15.157:3300/0 conn(0x7f93f0144c70 0x7f93f0145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f6355640 1 -- 172.21.15.99:0/825641914 >> v2:172.21.15.157:3300/0 conn(0x7f93f0144c70 msgr2=0x7f93f0145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:13.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.627+0000 7f93f6355640 1 --2- 172.21.15.99:0/825641914 >> v2:172.21.15.157:3300/0 conn(0x7f93f0144c70 0x7f93f0145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f6355640 1 -- 172.21.15.99:0/825641914 >> v1:172.21.15.157:6789/0 conn(0x7f93f0071de0 legacy=0x7f93f00721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f6355640 1 -- 172.21.15.99:0/825641914 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f006f2b0 con 0x7f93f00b19f0 2024-01-19T05:19:13.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f6355640 1 --2- 172.21.15.99:0/825641914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 0x7f93f006ebe0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f93f0072cc0 tx=0x7f93ec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82def3816b0fb812 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f5353640 1 -- 172.21.15.99:0/825641914 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0ab610 con 0x7f93f00b19f0 2024-01-19T05:19:13.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f5353640 1 -- 172.21.15.99:0/825641914 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec0ab770 con 0x7f93f00b19f0 2024-01-19T05:19:13.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f5353640 1 -- 172.21.15.99:0/825641914 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0abb00 con 0x7f93f00b19f0 2024-01-19T05:19:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f85b9640 1 -- 172.21.15.99:0/825641914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 msgr2=0x7f93f006ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f85b9640 1 --2- 172.21.15.99:0/825641914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 0x7f93f006ebe0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f93f0072cc0 tx=0x7f93ec01c470 comp rx=0 tx=0).stop 2024-01-19T05:19:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f85b9640 1 -- 172.21.15.99:0/825641914 shutdown_connections 2024-01-19T05:19:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f85b9640 1 --2- 172.21.15.99:0/825641914 >> v2:172.21.15.157:3300/0 conn(0x7f93f0144c70 0x7f93f0145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f85b9640 1 --2- 172.21.15.99:0/825641914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 0x7f93f006ebe0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f85b9640 1 -- 172.21.15.99:0/825641914 >> 172.21.15.99:0/825641914 conn(0x7f93f00b8080 msgr2=0x7f93f00b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f85b9640 1 -- 172.21.15.99:0/825641914 shutdown_connections 2024-01-19T05:19:13.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.631+0000 7f93f85b9640 1 -- 172.21.15.99:0/825641914 wait complete. 2024-01-19T05:19:13.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 Processor -- start 2024-01-19T05:19:13.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 -- start start 2024-01-19T05:19:13.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93f0071de0 0x7f93f01438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 0x7f93f01dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93f0144c70 0x7f93f01dd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f013c090 con 0x7f93f00b19f0 2024-01-19T05:19:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0140740 con 0x7f93f0144c70 2024-01-19T05:19:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0140a20 con 0x7f93f0071de0 2024-01-19T05:19:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 0x7f93f01dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 0x7f93f01dcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57900/0 (socket says 172.21.15.99:57900) 2024-01-19T05:19:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 -- 172.21.15.99:0/2006787556 learned_addr learned my addr 172.21.15.99:0/2006787556 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 -- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93f0071de0 msgr2=0x7f93f01438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93f0071de0 0x7f93f01438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 -- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93f0144c70 msgr2=0x7f93f01dd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93f0144c70 0x7f93f01dd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 -- 172.21.15.99:0/2006787556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec0094d0 con 0x7f93f00b19f0 2024-01-19T05:19:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f5b54640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 0x7f93f01dcde0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d800 tx=0x7f93e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000b6c0 con 0x7f93f00b19f0 2024-01-19T05:19:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e000b820 con 0x7f93f00b19f0 2024-01-19T05:19:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f0140d00 con 0x7f93f00b19f0 2024-01-19T05:19:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000bb90 con 0x7f93f00b19f0 2024-01-19T05:19:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f0140410 con 0x7f93f00b19f0 2024-01-19T05:19:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93f01408b0 con 0x7f93f00b19f0 2024-01-19T05:19:13.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f93e000bcf0 con 0x7f93f00b19f0 2024-01-19T05:19:13.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93d4066530 0x7f93d40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f93e0084ae0 con 0x7f93f00b19f0 2024-01-19T05:19:13.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f6355640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93d4066530 0x7f93d40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f93d406c390 0x7f93d406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 --> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93d406ee60 con 0x7f93d406c390 2024-01-19T05:19:13.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93e0084f30 con 0x7f93f00b19f0 2024-01-19T05:19:13.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f6355640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93d4066530 0x7f93d40689f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0af000 tx=0x7f93ec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.635+0000 7f93f6b56640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f93d406c390 0x7f93d406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.639+0000 7f93f6b56640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f93d406c390 0x7f93d406e7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.639+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 <== osd.4 v2:172.21.15.157:6809/888701730 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f93d406ee60 con 0x7f93d406c390 2024-01-19T05:19:13.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 --> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93f00696e0 con 0x7f93d406c390 2024-01-19T05:19:13.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93e6ffd640 1 -- 172.21.15.99:0/2006787556 <== osd.4 v2:172.21.15.157:6809/888701730 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f93f00696e0 con 0x7f93d406c390 2024-01-19T05:19:13.654 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:19:13.654 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:19:13.654 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:19:13.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f93d406c390 msgr2=0x7f93d406e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.157:6809/888701730,v1:172.21.15.157:6812/888701730] conn(0x7f93d406c390 0x7f93d406e7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93d4066530 msgr2=0x7f93d40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f93d4066530 0x7f93d40689f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0af000 tx=0x7f93ec008040 comp rx=0 tx=0).stop 2024-01-19T05:19:13.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 msgr2=0x7f93f01dcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 --2- 172.21.15.99:0/2006787556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93f00b19f0 0x7f93f01dcde0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d800 tx=0x7f93e000dcc0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f6b56640 1 -- 172.21.15.99:0/2006787556 reap_dead start 2024-01-19T05:19:13.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 shutdown_connections 2024-01-19T05:19:13.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.651+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 >> 172.21.15.99:0/2006787556 conn(0x7f93f00b8080 msgr2=0x7f93f0070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.655+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 shutdown_connections 2024-01-19T05:19:13.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.655+0000 7f93f85b9640 1 -- 172.21.15.99:0/2006787556 wait complete. 2024-01-19T05:19:13.670 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-19T05:19:13.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.779+0000 7fb752890640 1 Processor -- start 2024-01-19T05:19:13.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.779+0000 7fb752890640 1 -- start start 2024-01-19T05:19:13.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb752890640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c0b9170 0x7fb74c0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb752890640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb74c0b0c30 0x7fb74c143af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb752890640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74c0b9550 con 0x7fb74c0b10b0 2024-01-19T05:19:13.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb752890640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74c0b2db0 con 0x7fb74c0b0c30 2024-01-19T05:19:13.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb752890640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0afd00 con 0x7fb74c0b9170 2024-01-19T05:19:13.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb74c0b10b0 0x7fb74c0b3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35372/0 (socket says 172.21.15.99:35372) 2024-01-19T05:19:13.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 -- 172.21.15.99:0/699653048 learned_addr learned my addr 172.21.15.99:0/699653048 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:13.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74b7fe640 1 --2- 172.21.15.99:0/699653048 >> v2:172.21.15.157:3300/0 conn(0x7fb74c0b0c30 0x7fb74c143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773427395 0 0) 0x7fb74c0b9550 con 0x7fb74c0b10b0 2024-01-19T05:19:13.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb738003530 con 0x7fb74c0b10b0 2024-01-19T05:19:13.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74bfff640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c0b9170 0x7fb74c0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2370476537 0 0) 0x7fb738003530 con 0x7fb74c0b10b0 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c0b9170 msgr2=0x7fb74c0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c0b9170 0x7fb74c0b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 >> v2:172.21.15.157:3300/0 conn(0x7fb74c0b0c30 msgr2=0x7fb74c143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 --2- 172.21.15.99:0/699653048 >> v2:172.21.15.157:3300/0 conn(0x7fb74c0b0c30 0x7fb74c143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c0b01f0 con 0x7fb74c0b10b0 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7fb744001680 con 0x7fb74c0b10b0 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 >> v1:172.21.15.99:6789/0 conn(0x7fb74c0b10b0 legacy=0x7fb74c0b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c0b9170 0x7fb738003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb738003f00 0x7fb7380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb738004d10 0x7fb738005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0b2db0 con 0x7fb738004d10 2024-01-19T05:19:13.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0afd00 con 0x7fb738003f00 2024-01-19T05:19:13.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73800ba90 con 0x7fb74c0b9170 2024-01-19T05:19:13.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb738004d10 0x7fb738005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74bfff640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c0b9170 0x7fb738003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 -- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c0b9170 msgr2=0x7fb738003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:13.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c0b9170 0x7fb738003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 -- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb738003f00 msgr2=0x7fb7380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:13.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb738003f00 0x7fb7380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 -- 172.21.15.99:0/699653048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738003530 con 0x7fb738004d10 2024-01-19T05:19:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb750e2d640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb738004d10 0x7fb738005190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c270 tx=0x7fb74401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cee503c4fff58c server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744005ae0 con 0x7fb738004d10 2024-01-19T05:19:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440ab070 con 0x7fb738004d10 2024-01-19T05:19:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.783+0000 7fb74affd640 1 -- 172.21.15.99:0/699653048 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744007070 con 0x7fb738004d10 2024-01-19T05:19:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- 172.21.15.99:0/699653048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb738004d10 msgr2=0x7fb738005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 --2- 172.21.15.99:0/699653048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb738004d10 0x7fb738005190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c270 tx=0x7fb74401f3b0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 -- 172.21.15.99:0/699653048 reap_dead start 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- 172.21.15.99:0/699653048 shutdown_connections 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- 172.21.15.99:0/699653048 >> 172.21.15.99:0/699653048 conn(0x7fb74c06adf0 msgr2=0x7fb74c0b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- 172.21.15.99:0/699653048 shutdown_connections 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- 172.21.15.99:0/699653048 wait complete. 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 Processor -- start 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- start start 2024-01-19T05:19:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb74c1ced50 0x7fb74c1cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c1cf130 0x7fb74c1cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb74c1ce3d0 0x7fb74c140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c070c60 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c1d0030 con 0x7fb74c1ced50 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c1ccad0 con 0x7fb74c1cf130 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb74c1ce3d0 0x7fb74c140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb74c1ce3d0 0x7fb74c140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57920/0 (socket says 172.21.15.99:57920) 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 -- 172.21.15.99:0/531644809 learned_addr learned my addr 172.21.15.99:0/531644809 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb74bfff640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb74c1ced50 0x7fb74c1cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb74b7fe640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c1cf130 0x7fb74c1cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 -- 172.21.15.99:0/531644809 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c1cf130 msgr2=0x7fb74c1cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c1cf130 0x7fb74c1cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 -- 172.21.15.99:0/531644809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb74c1ced50 msgr2=0x7fb74c1cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb74c1ced50 0x7fb74c1cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 -- 172.21.15.99:0/531644809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c1d02b0 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb750e2d640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb74c1ce3d0 0x7fb74c140a30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c270 tx=0x7fb738005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb748ff9640 1 -- 172.21.15.99:0/531644809 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440b6070 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb748ff9640 1 -- 172.21.15.99:0/531644809 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744001c60 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c1d0590 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb748ff9640 1 -- 172.21.15.99:0/531644809 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744005d20 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c1cd970 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.787+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c1cdb60 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.791+0000 7fb748ff9640 1 -- 172.21.15.99:0/531644809 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb7440ad020 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.791+0000 7fb748ff9640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb72c066500 0x7fb72c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.791+0000 7fb748ff9640 1 -- 172.21.15.99:0/531644809 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb744120870 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.791+0000 7fb74bfff640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb72c066500 0x7fb72c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:13.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.791+0000 7fb74bfff640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb72c066500 0x7fb72c0689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c800 tx=0x7fb73c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:13.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.795+0000 7fb748ff9640 1 -- 172.21.15.99:0/531644809 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb7440ee020 con 0x7fb74c1ce3d0 2024-01-19T05:19:13.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.943+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb74c0b4a40 con 0x7fb72c066500 2024-01-19T05:19:13.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.943+0000 7fb748ff9640 1 -- 172.21.15.99:0/531644809 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb73c00cde0 con 0x7fb72c066500 2024-01-19T05:19:13.945 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 4 to deep-scrub 2024-01-19T05:19:13.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb72c066500 msgr2=0x7fb72c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb72c066500 0x7fb72c0689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c800 tx=0x7fb73c008040 comp rx=0 tx=0).stop 2024-01-19T05:19:13.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb74c1ce3d0 msgr2=0x7fb74c140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb74c1ce3d0 0x7fb74c140a30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c270 tx=0x7fb738005800 comp rx=0 tx=0).stop 2024-01-19T05:19:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 shutdown_connections 2024-01-19T05:19:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fb72c066500 0x7fb72c0689c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb74c1ce3d0 0x7fb74c140a30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb74c1cf130 0x7fb74c1cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 --2- 172.21.15.99:0/531644809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb74c1ced50 0x7fb74c1cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 >> 172.21.15.99:0/531644809 conn(0x7fb74c06adf0 msgr2=0x7fb74c0b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 shutdown_connections 2024-01-19T05:19:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:13.947+0000 7fb752890640 1 -- 172.21.15.99:0/531644809 wait complete. 2024-01-19T05:19:13.962 INFO:tasks.ceph:Scrubbing osd.5 2024-01-19T05:19:13.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:19:14.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.071+0000 7f83bed5d640 1 Processor -- start 2024-01-19T05:19:14.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.071+0000 7f83bed5d640 1 -- start start 2024-01-19T05:19:14.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bed5d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b8140780 0x7f83b8140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bed5d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f83b814f1b0 0x7f83b81515a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bed5d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80b87f0 con 0x7f83b80b96f0 2024-01-19T05:19:14.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bed5d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b8141120 con 0x7f83b814f1b0 2024-01-19T05:19:14.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bed5d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80b9ad0 con 0x7f83b8140780 2024-01-19T05:19:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bd2fa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f83b814f1b0 0x7f83b81515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b8140780 0x7f83b8140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bcaf9640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f83b80b96f0 0x7f83b80b7700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.99:44098/0 (socket says 172.21.15.99:44098) 2024-01-19T05:19:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bd2fa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f83b814f1b0 0x7f83b81515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:57608/0 (socket says 172.21.15.99:57608) 2024-01-19T05:19:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bcaf9640 1 -- 172.21.15.99:0/3746688118 learned_addr learned my addr 172.21.15.99:0/3746688118 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bd2fa640 1 -- 172.21.15.99:0/3746688118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b8140780 msgr2=0x7f83b8140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bd2fa640 1 --2- 172.21.15.99:0/3746688118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b8140780 0x7f83b8140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bd2fa640 1 -- 172.21.15.99:0/3746688118 >> v1:172.21.15.157:6789/0 conn(0x7f83b80b96f0 legacy=0x7f83b80b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bd2fa640 1 -- 172.21.15.99:0/3746688118 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80b81e0 con 0x7f83b814f1b0 2024-01-19T05:19:14.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83b7fff640 1 --2- 172.21.15.99:0/3746688118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b8140780 0x7f83b8140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-19T05:19:14.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83bd2fa640 1 --2- 172.21.15.99:0/3746688118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83b814f1b0 0x7f83b81515a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f83b00097c0 tx=0x7f83b001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7805f4f1be3b2d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.075+0000 7f83b77fe640 1 -- 172.21.15.99:0/3746688118 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b00ab680 con 0x7f83b814f1b0 2024-01-19T05:19:14.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b77fe640 1 -- 172.21.15.99:0/3746688118 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b00ab7e0 con 0x7f83b814f1b0 2024-01-19T05:19:14.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b77fe640 1 -- 172.21.15.99:0/3746688118 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b00abb70 con 0x7f83b814f1b0 2024-01-19T05:19:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- 172.21.15.99:0/3746688118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83b814f1b0 msgr2=0x7f83b81515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 --2- 172.21.15.99:0/3746688118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83b814f1b0 0x7f83b81515a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f83b00097c0 tx=0x7f83b001c480 comp rx=0 tx=0).stop 2024-01-19T05:19:14.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- 172.21.15.99:0/3746688118 shutdown_connections 2024-01-19T05:19:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 --2- 172.21.15.99:0/3746688118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83b814f1b0 0x7f83b81515a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 --2- 172.21.15.99:0/3746688118 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b8140780 0x7f83b8140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- 172.21.15.99:0/3746688118 >> 172.21.15.99:0/3746688118 conn(0x7f83b809e600 msgr2=0x7f83b80b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- 172.21.15.99:0/3746688118 shutdown_connections 2024-01-19T05:19:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- 172.21.15.99:0/3746688118 wait complete. 2024-01-19T05:19:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 Processor -- start 2024-01-19T05:19:14.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- start start 2024-01-19T05:19:14.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83b80b96f0 0x7f83b81381d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8140780 0x7f83b813a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b814f1b0 0x7f83b813ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b809bf10 con 0x7f83b8140780 2024-01-19T05:19:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b809c890 con 0x7f83b80b96f0 2024-01-19T05:19:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b809cb70 con 0x7f83b814f1b0 2024-01-19T05:19:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8140780 0x7f83b813a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8140780 0x7f83b813a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57934/0 (socket says 172.21.15.99:57934) 2024-01-19T05:19:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 -- 172.21.15.99:0/2789316493 learned_addr learned my addr 172.21.15.99:0/2789316493 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bcaf9640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83b80b96f0 0x7f83b81381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bd2fa640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b814f1b0 0x7f83b813ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 -- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b814f1b0 msgr2=0x7f83b813ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83b814f1b0 0x7f83b813ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 -- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83b80b96f0 msgr2=0x7f83b81381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83b80b96f0 0x7f83b81381d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 -- 172.21.15.99:0/2789316493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009420 con 0x7f83b8140780 2024-01-19T05:19:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b7fff640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8140780 0x7f83b813a8a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00ebe0 tx=0x7f83ac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00eee0 con 0x7f83b8140780 2024-01-19T05:19:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00cc30 con 0x7f83b8140780 2024-01-19T05:19:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b0009420 con 0x7f83b8140780 2024-01-19T05:19:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac013470 con 0x7f83b8140780 2024-01-19T05:19:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.079+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8138d60 con 0x7f83b8140780 2024-01-19T05:19:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83b80a1600 con 0x7f83b8140780 2024-01-19T05:19:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f83ac0135d0 con 0x7f83b8140780 2024-01-19T05:19:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83b57fa640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f83a4066500 0x7f83a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f83ac083e40 con 0x7f83b8140780 2024-01-19T05:19:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83bcaf9640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f83a4066500 0x7f83a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83b57fa640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f83a406c360 0x7f83a406e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 --> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83a406ee30 con 0x7f83a406c360 2024-01-19T05:19:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83ac086500 con 0x7f83b8140780 2024-01-19T05:19:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83bcaf9640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f83a4066500 0x7f83a40689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f83a80012f0 tx=0x7f83a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83bd2fa640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f83a406c360 0x7f83a406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83bd2fa640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f83a406c360 0x7f83a406e780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.083+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 <== osd.5 v2:172.21.15.157:6807/3649552388 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f83a406ee30 con 0x7f83a406c360 2024-01-19T05:19:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 --> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f83b809bb80 con 0x7f83a406c360 2024-01-19T05:19:14.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83b57fa640 1 -- 172.21.15.99:0/2789316493 <== osd.5 v2:172.21.15.157:6807/3649552388 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f83b00ab620 con 0x7f83a406c360 2024-01-19T05:19:14.100 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:19:14.100 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:19:14.100 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:19:14.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f83a406c360 msgr2=0x7f83a406e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.157:6807/3649552388,v1:172.21.15.157:6818/3649552388] conn(0x7f83a406c360 0x7f83a406e780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f83a4066500 msgr2=0x7f83a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f83a4066500 0x7f83a40689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f83a80012f0 tx=0x7f83a8009040 comp rx=0 tx=0).stop 2024-01-19T05:19:14.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8140780 msgr2=0x7f83b813a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 --2- 172.21.15.99:0/2789316493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8140780 0x7f83b813a8a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00ebe0 tx=0x7f83ac00c520 comp rx=0 tx=0).stop 2024-01-19T05:19:14.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bd2fa640 1 -- 172.21.15.99:0/2789316493 reap_dead start 2024-01-19T05:19:14.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 shutdown_connections 2024-01-19T05:19:14.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 >> 172.21.15.99:0/2789316493 conn(0x7f83b809e600 msgr2=0x7f83b80ba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 shutdown_connections 2024-01-19T05:19:14.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.099+0000 7f83bed5d640 1 -- 172.21.15.99:0/2789316493 wait complete. 2024-01-19T05:19:14.115 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-19T05:19:14.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.223+0000 7fa5fb0ae640 1 Processor -- start 2024-01-19T05:19:14.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.223+0000 7fa5fb0ae640 1 -- start start 2024-01-19T05:19:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5fb0ae640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa5f40b19f0 0x7fa5f406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5fb0ae640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 0x7fa5f4145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5fb0ae640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f4070680 con 0x7fa5f4144c70 2024-01-19T05:19:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5fb0ae640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f4070410 con 0x7fa5f40b19f0 2024-01-19T05:19:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5fb0ae640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4144790 con 0x7fa5f40724f0 2024-01-19T05:19:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f3fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa5f4144c70 0x7fa5f4071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35386/0 (socket says 172.21.15.99:35386) 2024-01-19T05:19:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f8e4a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa5f40b19f0 0x7fa5f406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f3fff640 1 -- 172.21.15.99:0/1436726338 learned_addr learned my addr 172.21.15.99:0/1436726338 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:14.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f964b640 1 --2- 172.21.15.99:0/1436726338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 0x7fa5f4145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f8e4a640 1 -- 172.21.15.99:0/1436726338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 msgr2=0x7fa5f4145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:14.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f8e4a640 1 --2- 172.21.15.99:0/1436726338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 0x7fa5f4145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f37fe640 1 -- 172.21.15.99:0/1436726338 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822109426 0 0) 0x7fa5f4070680 con 0x7fa5f4144c70 2024-01-19T05:19:14.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f8e4a640 1 -- 172.21.15.99:0/1436726338 >> v1:172.21.15.99:6789/0 conn(0x7fa5f4144c70 legacy=0x7fa5f4071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f8e4a640 1 -- 172.21.15.99:0/1436726338 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f406f2b0 con 0x7fa5f40b19f0 2024-01-19T05:19:14.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f8e4a640 1 --2- 172.21.15.99:0/1436726338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f406ebe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009d90 tx=0x7fa5ec01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4232478ae09196 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f37fe640 1 -- 172.21.15.99:0/1436726338 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0a5960 con 0x7fa5f40b19f0 2024-01-19T05:19:14.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f37fe640 1 -- 172.21.15.99:0/1436726338 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0a5ac0 con 0x7fa5f40b19f0 2024-01-19T05:19:14.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.227+0000 7fa5f37fe640 1 -- 172.21.15.99:0/1436726338 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0a5e50 con 0x7fa5f40b19f0 2024-01-19T05:19:14.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/1436726338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 msgr2=0x7fa5f406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/1436726338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f406ebe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009d90 tx=0x7fa5ec01c8c0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/1436726338 shutdown_connections 2024-01-19T05:19:14.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/1436726338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 0x7fa5f4145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/1436726338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f406ebe0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/1436726338 >> 172.21.15.99:0/1436726338 conn(0x7fa5f40b8080 msgr2=0x7fa5f40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/1436726338 shutdown_connections 2024-01-19T05:19:14.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/1436726338 wait complete. 2024-01-19T05:19:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 Processor -- start 2024-01-19T05:19:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- start start 2024-01-19T05:19:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 0x7fa5f41df110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f413d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f4144c70 0x7fa5f40b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41dffc0 con 0x7fa5f40b19f0 2024-01-19T05:19:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f414ec10 con 0x7fa5f4144c70 2024-01-19T05:19:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41df970 con 0x7fa5f40724f0 2024-01-19T05:19:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f413d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f413d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57944/0 (socket says 172.21.15.99:57944) 2024-01-19T05:19:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 -- 172.21.15.99:0/518280051 learned_addr learned my addr 172.21.15.99:0/518280051 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 -- 172.21.15.99:0/518280051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 msgr2=0x7fa5f41df110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 0x7fa5f41df110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 -- 172.21.15.99:0/518280051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f4144c70 msgr2=0x7fa5f40b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f4144c70 0x7fa5f40b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 -- 172.21.15.99:0/518280051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec009a70 con 0x7fa5f40b19f0 2024-01-19T05:19:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f3fff640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f413d630 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80011f0 tx=0x7fa5e800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f17fa640 1 -- 172.21.15.99:0/518280051 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80074e0 con 0x7fa5f40b19f0 2024-01-19T05:19:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f17fa640 1 -- 172.21.15.99:0/518280051 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8007640 con 0x7fa5f40b19f0 2024-01-19T05:19:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f41dfc50 con 0x7fa5f40b19f0 2024-01-19T05:19:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5f17fa640 1 -- 172.21.15.99:0/518280051 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8004a10 con 0x7fa5f40b19f0 2024-01-19T05:19:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f41df650 con 0x7fa5f40b19f0 2024-01-19T05:19:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.231+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f40696e0 con 0x7fa5f40b19f0 2024-01-19T05:19:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.235+0000 7fa5f17fa640 1 -- 172.21.15.99:0/518280051 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa5e8004b70 con 0x7fa5f40b19f0 2024-01-19T05:19:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.235+0000 7fa5f17fa640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa5e0066500 0x7fa5e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.235+0000 7fa5f17fa640 1 -- 172.21.15.99:0/518280051 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa5e8083090 con 0x7fa5f40b19f0 2024-01-19T05:19:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.235+0000 7fa5f8e4a640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa5e0066500 0x7fa5e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.235+0000 7fa5f8e4a640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa5e0066500 0x7fa5e00689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0af000 tx=0x7fa5ec004ac0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.239+0000 7fa5f17fa640 1 -- 172.21.15.99:0/518280051 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa5e80506c0 con 0x7fa5f40b19f0 2024-01-19T05:19:14.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.383+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5f40aecd0 con 0x7fa5e0066500 2024-01-19T05:19:14.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.383+0000 7fa5f17fa640 1 -- 172.21.15.99:0/518280051 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa5f40aecd0 con 0x7fa5e0066500 2024-01-19T05:19:14.385 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 5 to deep-scrub 2024-01-19T05:19:14.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa5e0066500 msgr2=0x7fa5e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa5e0066500 0x7fa5e00689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0af000 tx=0x7fa5ec004ac0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 msgr2=0x7fa5f413d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f413d630 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80011f0 tx=0x7fa5e800c9b0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 shutdown_connections 2024-01-19T05:19:14.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa5e0066500 0x7fa5e00689c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5f4144c70 0x7fa5f40b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f40b19f0 0x7fa5f413d630 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 --2- 172.21.15.99:0/518280051 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5f40724f0 0x7fa5f41df110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 >> 172.21.15.99:0/518280051 conn(0x7fa5f40b8080 msgr2=0x7fa5f40ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 shutdown_connections 2024-01-19T05:19:14.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.387+0000 7fa5fb0ae640 1 -- 172.21.15.99:0/518280051 wait complete. 2024-01-19T05:19:14.402 INFO:tasks.ceph:Scrubbing osd.6 2024-01-19T05:19:14.402 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:19:14.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.519+0000 7fdd1efeb640 1 Processor -- start 2024-01-19T05:19:14.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.519+0000 7fdd1efeb640 1 -- start start 2024-01-19T05:19:14.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd1efeb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd180b19f0 0x7fdd1806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd1efeb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd18144c70 0x7fdd181450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd1efeb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18070680 con 0x7fdd18071de0 2024-01-19T05:19:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd1efeb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd18070410 con 0x7fdd18144c70 2024-01-19T05:19:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd1efeb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18144790 con 0x7fdd180b19f0 2024-01-19T05:19:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd17fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd18144c70 0x7fdd181450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd17fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd18144c70 0x7fdd181450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:57644/0 (socket says 172.21.15.99:57644) 2024-01-19T05:19:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd17fff640 1 -- 172.21.15.99:0/3138607375 learned_addr learned my addr 172.21.15.99:0/3138607375 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd1cd87640 1 --2- 172.21.15.99:0/3138607375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd180b19f0 0x7fdd1806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd17fff640 1 -- 172.21.15.99:0/3138607375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd180b19f0 msgr2=0x7fdd1806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd17fff640 1 --2- 172.21.15.99:0/3138607375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd180b19f0 0x7fdd1806ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd17fff640 1 -- 172.21.15.99:0/3138607375 >> v1:172.21.15.157:6789/0 conn(0x7fdd18071de0 legacy=0x7fdd18072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.523+0000 7fdd17fff640 1 -- 172.21.15.99:0/3138607375 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1806f2b0 con 0x7fdd18144c70 2024-01-19T05:19:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 --2- 172.21.15.99:0/3138607375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd18144c70 0x7fdd181450d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009870 tx=0x7fdd0801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b4964ae71bcc395 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd177fe640 1 -- 172.21.15.99:0/3138607375 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080ab610 con 0x7fdd18144c70 2024-01-19T05:19:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd177fe640 1 -- 172.21.15.99:0/3138607375 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd080ab770 con 0x7fdd18144c70 2024-01-19T05:19:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd177fe640 1 -- 172.21.15.99:0/3138607375 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080abb00 con 0x7fdd18144c70 2024-01-19T05:19:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3138607375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd18144c70 msgr2=0x7fdd181450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 --2- 172.21.15.99:0/3138607375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd18144c70 0x7fdd181450d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009870 tx=0x7fdd0801c4b0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3138607375 shutdown_connections 2024-01-19T05:19:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 --2- 172.21.15.99:0/3138607375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd18144c70 0x7fdd181450d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 --2- 172.21.15.99:0/3138607375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd180b19f0 0x7fdd1806ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3138607375 >> 172.21.15.99:0/3138607375 conn(0x7fdd180b8080 msgr2=0x7fdd180b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3138607375 shutdown_connections 2024-01-19T05:19:14.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3138607375 wait complete. 2024-01-19T05:19:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 Processor -- start 2024-01-19T05:19:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- start start 2024-01-19T05:19:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd18071de0 0x7fdd18143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd180b19f0 0x7fdd181439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd18144c70 0x7fdd18140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1813fa20 con 0x7fdd180b19f0 2024-01-19T05:19:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18140390 con 0x7fdd18071de0 2024-01-19T05:19:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1813ff00 con 0x7fdd18144c70 2024-01-19T05:19:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd180b19f0 0x7fdd181439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd180b19f0 0x7fdd181439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57946/0 (socket says 172.21.15.99:57946) 2024-01-19T05:19:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 -- 172.21.15.99:0/3261864311 learned_addr learned my addr 172.21.15.99:0/3261864311 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1cd87640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd18071de0 0x7fdd18143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1d588640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd18144c70 0x7fdd18140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 -- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd18144c70 msgr2=0x7fdd18140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd18144c70 0x7fdd18140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 -- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd18071de0 msgr2=0x7fdd18143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd18071de0 0x7fdd18143470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 -- 172.21.15.99:0/3261864311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080094d0 con 0x7fdd180b19f0 2024-01-19T05:19:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd17fff640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd180b19f0 0x7fdd181439b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdd080ad040 tx=0x7fdd0801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080be5f0 con 0x7fdd180b19f0 2024-01-19T05:19:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd080be770 con 0x7fdd180b19f0 2024-01-19T05:19:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd181e0b00 con 0x7fdd180b19f0 2024-01-19T05:19:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080beb20 con 0x7fdd180b19f0 2024-01-19T05:19:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.527+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1813fc20 con 0x7fdd180b19f0 2024-01-19T05:19:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd181e0d40 con 0x7fdd180b19f0 2024-01-19T05:19:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fdd080b43f0 con 0x7fdd180b19f0 2024-01-19T05:19:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd157fa640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdd04066500 0x7fdd040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdd0811e9f0 con 0x7fdd180b19f0 2024-01-19T05:19:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd1cd87640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdd04066500 0x7fdd040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd157fa640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7fdd0406c360 0x7fdd0406e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 --> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd0406ee30 con 0x7fdd0406c360 2024-01-19T05:19:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd081232c0 con 0x7fdd180b19f0 2024-01-19T05:19:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd1cd87640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdd04066500 0x7fdd040689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009af0 tx=0x7fdd0c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd1d588640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7fdd0406c360 0x7fdd0406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.531+0000 7fdd1d588640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7fdd0406c360 0x7fdd0406e780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.535+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 <== osd.6 v2:172.21.15.157:6808/536345226 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdd0406ee30 con 0x7fdd0406c360 2024-01-19T05:19:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 --> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdd180696e0 con 0x7fdd0406c360 2024-01-19T05:19:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd157fa640 1 -- 172.21.15.99:0/3261864311 <== osd.6 v2:172.21.15.157:6808/536345226 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdd180696e0 con 0x7fdd0406c360 2024-01-19T05:19:14.549 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:19:14.549 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:19:14.549 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:19:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7fdd0406c360 msgr2=0x7fdd0406e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.157:6808/536345226,v1:172.21.15.157:6811/536345226] conn(0x7fdd0406c360 0x7fdd0406e780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdd04066500 msgr2=0x7fdd040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fdd04066500 0x7fdd040689c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009af0 tx=0x7fdd0c008040 comp rx=0 tx=0).stop 2024-01-19T05:19:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd180b19f0 msgr2=0x7fdd181439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 --2- 172.21.15.99:0/3261864311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd180b19f0 0x7fdd181439b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdd080ad040 tx=0x7fdd0801acf0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1d588640 1 -- 172.21.15.99:0/3261864311 reap_dead start 2024-01-19T05:19:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 shutdown_connections 2024-01-19T05:19:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 >> 172.21.15.99:0/3261864311 conn(0x7fdd180b8080 msgr2=0x7fdd1813dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 shutdown_connections 2024-01-19T05:19:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.547+0000 7fdd1efeb640 1 -- 172.21.15.99:0/3261864311 wait complete. 2024-01-19T05:19:14.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-19T05:19:14.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e91f39640 1 Processor -- start 2024-01-19T05:19:14.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e91f39640 1 -- start start 2024-01-19T05:19:14.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e91f39640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5e8c0acad0 0x7f5e8c0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e91f39640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5e8c0725b0 0x7f5e8c146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e91f39640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c0ae1a0 con 0x7f5e8c0b22b0 2024-01-19T05:19:14.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e91f39640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c141020 con 0x7f5e8c0725b0 2024-01-19T05:19:14.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e91f39640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c0aceb0 con 0x7f5e8c0acad0 2024-01-19T05:19:14.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8affd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5e8c0725b0 0x7f5e8c146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8bfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5e8c0b22b0 0x7f5e8c149d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35396/0 (socket says 172.21.15.99:35396) 2024-01-19T05:19:14.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8bfff640 1 -- 172.21.15.99:0/1395012967 learned_addr learned my addr 172.21.15.99:0/1395012967 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:14.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8b7fe640 1 --2- 172.21.15.99:0/1395012967 >> v2:172.21.15.157:3300/0 conn(0x7f5e8c0acad0 0x7f5e8c0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8a7fc640 1 -- 172.21.15.99:0/1395012967 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673769832 0 0) 0x7f5e8c0ae1a0 con 0x7f5e8c0b22b0 2024-01-19T05:19:14.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8a7fc640 1 -- 172.21.15.99:0/1395012967 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e78003530 con 0x7f5e8c0b22b0 2024-01-19T05:19:14.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8affd640 1 -- 172.21.15.99:0/1395012967 >> v2:172.21.15.157:3300/0 conn(0x7f5e8c0acad0 msgr2=0x7f5e8c0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:14.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8affd640 1 --2- 172.21.15.99:0/1395012967 >> v2:172.21.15.157:3300/0 conn(0x7f5e8c0acad0 0x7f5e8c0b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8a7fc640 1 -- 172.21.15.99:0/1395012967 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4049157136 0 0) 0x7f5e78003530 con 0x7f5e8c0b22b0 2024-01-19T05:19:14.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8affd640 1 -- 172.21.15.99:0/1395012967 >> v1:172.21.15.99:6789/0 conn(0x7f5e8c0b22b0 legacy=0x7f5e8c149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.679+0000 7f5e8affd640 1 -- 172.21.15.99:0/1395012967 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0aefc0 con 0x7f5e8c0725b0 2024-01-19T05:19:14.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8affd640 1 --2- 172.21.15.99:0/1395012967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c0725b0 0x7f5e8c146eb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c06acb0 tx=0x7f5e7401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264482611e85fd97 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8a7fc640 1 -- 172.21.15.99:0/1395012967 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84001a00 con 0x7f5e8c0725b0 2024-01-19T05:19:14.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8a7fc640 1 -- 172.21.15.99:0/1395012967 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e740a7050 con 0x7f5e8c0725b0 2024-01-19T05:19:14.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8a7fc640 1 -- 172.21.15.99:0/1395012967 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e740ab600 con 0x7f5e8c0725b0 2024-01-19T05:19:14.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- 172.21.15.99:0/1395012967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c0725b0 msgr2=0x7f5e8c146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 --2- 172.21.15.99:0/1395012967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c0725b0 0x7f5e8c146eb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c06acb0 tx=0x7f5e7401c350 comp rx=0 tx=0).stop 2024-01-19T05:19:14.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- 172.21.15.99:0/1395012967 shutdown_connections 2024-01-19T05:19:14.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 --2- 172.21.15.99:0/1395012967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c0725b0 0x7f5e8c146eb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 --2- 172.21.15.99:0/1395012967 >> v2:172.21.15.157:3300/0 conn(0x7f5e8c0acad0 0x7f5e8c0b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- 172.21.15.99:0/1395012967 >> 172.21.15.99:0/1395012967 conn(0x7f5e8c0b8080 msgr2=0x7f5e8c0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- 172.21.15.99:0/1395012967 shutdown_connections 2024-01-19T05:19:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- 172.21.15.99:0/1395012967 wait complete. 2024-01-19T05:19:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 Processor -- start 2024-01-19T05:19:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- start start 2024-01-19T05:19:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e8c0acad0 0x7f5e8c1396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e8c0b22b0 0x7f5e8c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c140920 0x7f5e8c1e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b0d40 con 0x7f5e8c140920 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b0f30 con 0x7f5e8c0acad0 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b08b0 con 0x7f5e8c0b22b0 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c140920 0x7f5e8c1e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c140920 0x7f5e8c1e24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57960/0 (socket says 172.21.15.99:57960) 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 -- 172.21.15.99:0/3417151203 learned_addr learned my addr 172.21.15.99:0/3417151203 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8b7fe640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e8c0acad0 0x7f5e8c1396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8affd640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e8c0b22b0 0x7f5e8c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 -- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e8c0b22b0 msgr2=0x7f5e8c147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e8c0b22b0 0x7f5e8c147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 -- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e8c0acad0 msgr2=0x7f5e8c1396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e8c0acad0 0x7f5e8c1396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 -- 172.21.15.99:0/3417151203 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74009420 con 0x7f5e8c140920 2024-01-19T05:19:14.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8affd640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e8c0b22b0 0x7f5e8c147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:14.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8b7fe640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e8c0acad0 0x7f5e8c1396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:14.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e8bfff640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c140920 0x7f5e8c1e24a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5e84001570 tx=0x7f5e8400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e83fff640 1 -- 172.21.15.99:0/3417151203 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400ad40 con 0x7f5e8c140920 2024-01-19T05:19:14.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e83fff640 1 -- 172.21.15.99:0/3417151203 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e84012400 con 0x7f5e8c140920 2024-01-19T05:19:14.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c0afd50 con 0x7f5e8c140920 2024-01-19T05:19:14.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e83fff640 1 -- 172.21.15.99:0/3417151203 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840127b0 con 0x7f5e8c140920 2024-01-19T05:19:14.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.683+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c1499a0 con 0x7f5e8c140920 2024-01-19T05:19:14.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.687+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c0b0a40 con 0x7f5e8c140920 2024-01-19T05:19:14.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.687+0000 7f5e83fff640 1 -- 172.21.15.99:0/3417151203 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5e84012b20 con 0x7f5e8c140920 2024-01-19T05:19:14.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.687+0000 7f5e83fff640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e6c066500 0x7f5e6c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.687+0000 7f5e83fff640 1 -- 172.21.15.99:0/3417151203 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5e84084e20 con 0x7f5e8c140920 2024-01-19T05:19:14.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.687+0000 7f5e8b7fe640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e6c066500 0x7f5e6c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.687+0000 7f5e8b7fe640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e6c066500 0x7f5e6c0689c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009ae0 tx=0x7f5e7c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.691+0000 7f5e83fff640 1 -- 172.21.15.99:0/3417151203 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5e84052530 con 0x7f5e8c140920 2024-01-19T05:19:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.839+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e8c1540b0 con 0x7f5e6c066500 2024-01-19T05:19:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.839+0000 7f5e83fff640 1 -- 172.21.15.99:0/3417151203 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e7c004020 con 0x7f5e6c066500 2024-01-19T05:19:14.841 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 6 to deep-scrub 2024-01-19T05:19:14.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e6c066500 msgr2=0x7f5e6c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e6c066500 0x7f5e6c0689c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009ae0 tx=0x7f5e7c008040 comp rx=0 tx=0).stop 2024-01-19T05:19:14.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c140920 msgr2=0x7f5e8c1e24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c140920 0x7f5e8c1e24a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5e84001570 tx=0x7f5e8400a430 comp rx=0 tx=0).stop 2024-01-19T05:19:14.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 shutdown_connections 2024-01-19T05:19:14.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f5e6c066500 0x7f5e6c0689c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e8c140920 0x7f5e8c1e24a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5e8c0b22b0 0x7f5e8c147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 --2- 172.21.15.99:0/3417151203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e8c0acad0 0x7f5e8c1396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 >> 172.21.15.99:0/3417151203 conn(0x7f5e8c0b8080 msgr2=0x7f5e8c145d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 shutdown_connections 2024-01-19T05:19:14.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.843+0000 7f5e91f39640 1 -- 172.21.15.99:0/3417151203 wait complete. 2024-01-19T05:19:14.858 INFO:tasks.ceph:Scrubbing osd.7 2024-01-19T05:19:14.859 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-19T05:19:14.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa569688640 1 Processor -- start 2024-01-19T05:19:14.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa569688640 1 -- start start 2024-01-19T05:19:14.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa569688640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa5640b2ce0 0x7fa564071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa569688640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa5641441d0 0x7fa564072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa569688640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56406f620 con 0x7fa5640b1870 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa569688640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa564141000 con 0x7fa5641441d0 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa569688640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa564143610 con 0x7fa5640b2ce0 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa5627fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa5640b1870 0x7fa564143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35402/0 (socket says 172.21.15.99:35402) 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa5627fc640 1 -- 172.21.15.99:0/27985472 learned_addr learned my addr 172.21.15.99:0/27985472 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa5637fe640 1 --2- 172.21.15.99:0/27985472 >> v2:172.21.15.99:3300/0 conn(0x7fa5641441d0 0x7fa564072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa562ffd640 1 --2- 172.21.15.99:0/27985472 >> v2:172.21.15.157:3300/0 conn(0x7fa5640b2ce0 0x7fa564071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa561ffb640 1 -- 172.21.15.99:0/27985472 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528570812 0 0) 0x7fa56406f620 con 0x7fa5640b1870 2024-01-19T05:19:14.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa561ffb640 1 -- 172.21.15.99:0/27985472 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa550005740 con 0x7fa5640b1870 2024-01-19T05:19:14.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa5637fe640 1 -- 172.21.15.99:0/27985472 >> v2:172.21.15.157:3300/0 conn(0x7fa5640b2ce0 msgr2=0x7fa564071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:14.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa5637fe640 1 --2- 172.21.15.99:0/27985472 >> v2:172.21.15.157:3300/0 conn(0x7fa5640b2ce0 0x7fa564071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa5637fe640 1 -- 172.21.15.99:0/27985472 >> v1:172.21.15.99:6789/0 conn(0x7fa5640b1870 legacy=0x7fa564143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.979+0000 7fa5637fe640 1 -- 172.21.15.99:0/27985472 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5640b30c0 con 0x7fa5641441d0 2024-01-19T05:19:14.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5637fe640 1 --2- 172.21.15.99:0/27985472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 0x7fa564072440 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa5640b8f00 tx=0x7fa55c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7d692cdf153b84 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa561ffb640 1 -- 172.21.15.99:0/27985472 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a59a0 con 0x7fa5641441d0 2024-01-19T05:19:14.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa561ffb640 1 -- 172.21.15.99:0/27985472 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c0a5b00 con 0x7fa5641441d0 2024-01-19T05:19:14.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa561ffb640 1 -- 172.21.15.99:0/27985472 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a5e90 con 0x7fa5641441d0 2024-01-19T05:19:14.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- 172.21.15.99:0/27985472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 msgr2=0x7fa564072440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 --2- 172.21.15.99:0/27985472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 0x7fa564072440 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa5640b8f00 tx=0x7fa55c01c8e0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- 172.21.15.99:0/27985472 shutdown_connections 2024-01-19T05:19:14.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 --2- 172.21.15.99:0/27985472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 0x7fa564072440 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 --2- 172.21.15.99:0/27985472 >> v2:172.21.15.157:3300/0 conn(0x7fa5640b2ce0 0x7fa564071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- 172.21.15.99:0/27985472 >> 172.21.15.99:0/27985472 conn(0x7fa5640b8080 msgr2=0x7fa5640b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:14.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- 172.21.15.99:0/27985472 shutdown_connections 2024-01-19T05:19:14.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- 172.21.15.99:0/27985472 wait complete. 2024-01-19T05:19:14.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 Processor -- start 2024-01-19T05:19:14.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- start start 2024-01-19T05:19:14.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5640b2ce0 0x7fa5641df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 0x7fa564146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa564144bd0 0x7fa56414d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa564147860 con 0x7fa5641441d0 2024-01-19T05:19:14.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa564145060 con 0x7fa564144bd0 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa569688640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56413fb70 con 0x7fa5640b2ce0 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5627fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 0x7fa564146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5627fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 0x7fa564146580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57984/0 (socket says 172.21.15.99:57984) 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5627fc640 1 -- 172.21.15.99:0/67188031 learned_addr learned my addr 172.21.15.99:0/67188031 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5637fe640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa564144bd0 0x7fa56414d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa562ffd640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5640b2ce0 0x7fa5641df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5627fc640 1 -- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5640b2ce0 msgr2=0x7fa5641df7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5627fc640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5640b2ce0 0x7fa5641df7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5627fc640 1 -- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa564144bd0 msgr2=0x7fa56414d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5627fc640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa564144bd0 0x7fa56414d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5627fc640 1 -- 172.21.15.99:0/67188031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009a70 con 0x7fa5641441d0 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa5637fe640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa564144bd0 0x7fa56414d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.983+0000 7fa562ffd640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5640b2ce0 0x7fa5641df7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa5627fc640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 0x7fa564146580 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c480 tx=0x7fa55400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554005cf0 con 0x7fa5641441d0 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa554005e50 con 0x7fa5641441d0 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5641dece0 con 0x7fa5641441d0 2024-01-19T05:19:14.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554007290 con 0x7fa5641441d0 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5641defa0 con 0x7fa5641441d0 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5640b3b20 con 0x7fa5641441d0 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa5540073f0 con 0x7fa5641441d0 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa544066500 0x7fa5440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa554083150 con 0x7fa5641441d0 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa562ffd640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa544066500 0x7fa5440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fa54406c360 0x7fa54406e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 --> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa54406ee30 con 0x7fa54406c360 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5540857e0 con 0x7fa5641441d0 2024-01-19T05:19:14.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa5637fe640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fa54406c360 0x7fa54406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:14.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa562ffd640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa544066500 0x7fa5440689c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5640af4a0 tx=0x7fa54c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.987+0000 7fa5637fe640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fa54406c360 0x7fa54406e780 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:14.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:14.991+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 <== osd.7 v2:172.21.15.157:6800/2904682777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa54406ee30 con 0x7fa54406c360 2024-01-19T05:19:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 --> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5641deb60 con 0x7fa54406c360 2024-01-19T05:19:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa55b7fe640 1 -- 172.21.15.99:0/67188031 <== osd.7 v2:172.21.15.157:6800/2904682777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa55c0b8450 con 0x7fa54406c360 2024-01-19T05:19:15.005 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-19T05:19:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-19T05:19:15.006 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-19T05:19:15.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fa54406c360 msgr2=0x7fa54406e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.157:6800/2904682777,v1:172.21.15.157:6801/2904682777] conn(0x7fa54406c360 0x7fa54406e780 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa544066500 msgr2=0x7fa5440689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7fa544066500 0x7fa5440689c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5640af4a0 tx=0x7fa54c008040 comp rx=0 tx=0).stop 2024-01-19T05:19:15.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 msgr2=0x7fa564146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 --2- 172.21.15.99:0/67188031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5641441d0 0x7fa564146580 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c480 tx=0x7fa55400c940 comp rx=0 tx=0).stop 2024-01-19T05:19:15.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa5637fe640 1 -- 172.21.15.99:0/67188031 reap_dead start 2024-01-19T05:19:15.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 shutdown_connections 2024-01-19T05:19:15.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 >> 172.21.15.99:0/67188031 conn(0x7fa5640b8080 msgr2=0x7fa564141eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:15.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 shutdown_connections 2024-01-19T05:19:15.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.003+0000 7fa569688640 1 -- 172.21.15.99:0/67188031 wait complete. 2024-01-19T05:19:15.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-19T05:19:15.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c70cb640 1 Processor -- start 2024-01-19T05:19:15.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c70cb640 1 -- start start 2024-01-19T05:19:15.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c70cb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f72c00b19f0 0x7f72c006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c70cb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 0x7f72c0145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c70cb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0070680 con 0x7f72c0144c70 2024-01-19T05:19:15.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c70cb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c0070410 con 0x7f72c00b19f0 2024-01-19T05:19:15.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c70cb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0144790 con 0x7f72c00724f0 2024-01-19T05:19:15.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bffff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f72c0144c70 0x7f72c0071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35414/0 (socket says 172.21.15.99:35414) 2024-01-19T05:19:15.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bffff640 1 -- 172.21.15.99:0/555649034 learned_addr learned my addr 172.21.15.99:0/555649034 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-01-19T05:19:15.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c4e67640 1 --2- 172.21.15.99:0/555649034 >> v2:172.21.15.157:3300/0 conn(0x7f72c00b19f0 0x7f72c006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c5668640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 0x7f72c0145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234022894 0 0) 0x7f72c0070680 con 0x7f72c0144c70 2024-01-19T05:19:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a8003530 con 0x7f72c0144c70 2024-01-19T05:19:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2860851674 0 0) 0x7f72a8003530 con 0x7f72c0144c70 2024-01-19T05:19:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 msgr2=0x7f72c0145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 0x7f72c0145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 >> v2:172.21.15.157:3300/0 conn(0x7f72c00b19f0 msgr2=0x7f72c006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 --2- 172.21.15.99:0/555649034 >> v2:172.21.15.157:3300/0 conn(0x7f72c00b19f0 0x7f72c006ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c006f2b0 con 0x7f72c0144c70 2024-01-19T05:19:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2225574797 0 0) 0x7f72b0001680 con 0x7f72c0144c70 2024-01-19T05:19:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 >> v1:172.21.15.99:6789/0 conn(0x7f72c0144c70 legacy=0x7f72c0071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a8003980 0x7f72a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72a80047d0 0x7f72a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 0x7f72a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0070410 con 0x7f72a8003980 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0144790 con 0x7f72a80047d0 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a800b990 con 0x7f72c00724f0 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c4e67640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a8003980 0x7f72a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72bffff640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72a80047d0 0x7f72a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c5668640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 0x7f72a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c4e67640 1 -- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 msgr2=0x7f72a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c4e67640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 0x7f72a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c4e67640 1 -- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72a80047d0 msgr2=0x7f72a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:15.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c4e67640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72a80047d0 0x7f72a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c4e67640 1 -- 172.21.15.99:0/555649034 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8003530 con 0x7f72a8003980 2024-01-19T05:19:15.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.135+0000 7f72c5668640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72c00724f0 0x7f72a8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:15.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.139+0000 7f72c4e67640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a8003980 0x7f72a8003da0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009b10 tx=0x7f72b401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d829d58de4873d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:15.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.139+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b40a55b0 con 0x7f72a8003980 2024-01-19T05:19:15.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b40a5710 con 0x7f72a8003980 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72bf7fe640 1 -- 172.21.15.99:0/555649034 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b40a5ac0 con 0x7f72a8003980 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- 172.21.15.99:0/555649034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a8003980 msgr2=0x7f72a8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 --2- 172.21.15.99:0/555649034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a8003980 0x7f72a8003da0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009b10 tx=0x7f72b401ca40 comp rx=0 tx=0).stop 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 -- 172.21.15.99:0/555649034 reap_dead start 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- 172.21.15.99:0/555649034 shutdown_connections 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- 172.21.15.99:0/555649034 >> 172.21.15.99:0/555649034 conn(0x7f72c00b8080 msgr2=0x7f72c00b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- 172.21.15.99:0/555649034 shutdown_connections 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- 172.21.15.99:0/555649034 wait complete. 2024-01-19T05:19:15.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 Processor -- start 2024-01-19T05:19:15.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- start start 2024-01-19T05:19:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72a8003980 0x7f72c00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72c01e29e0 0x7f72c00b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c00b0d70 0x7f72c013f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00afbb0 con 0x7f72c00b0d70 2024-01-19T05:19:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c013d740 con 0x7f72c01e29e0 2024-01-19T05:19:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01e2e60 con 0x7f72a8003980 2024-01-19T05:19:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c00b0d70 0x7f72c013f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c00b0d70 0x7f72c013f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58008/0 (socket says 172.21.15.99:58008) 2024-01-19T05:19:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 -- 172.21.15.99:0/2732055021 learned_addr learned my addr 172.21.15.99:0/2732055021 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72bffff640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72c01e29e0 0x7f72c00b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c4e67640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72a8003980 0x7f72c00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 -- 172.21.15.99:0/2732055021 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72a8003980 msgr2=0x7f72c00affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72a8003980 0x7f72c00affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 -- 172.21.15.99:0/2732055021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72c01e29e0 msgr2=0x7f72c00b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72c01e29e0 0x7f72c00b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 -- 172.21.15.99:0/2732055021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00b11f0 con 0x7f72c00b0d70 2024-01-19T05:19:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c5668640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c00b0d70 0x7f72c013f8d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f72c00b8ce0 tx=0x7f72b800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72bd7fa640 1 -- 172.21.15.99:0/2732055021 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8017400 con 0x7f72c00b0d70 2024-01-19T05:19:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72bd7fa640 1 -- 172.21.15.99:0/2732055021 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b8011040 con 0x7f72c00b0d70 2024-01-19T05:19:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c00b1470 con 0x7f72c00b0d70 2024-01-19T05:19:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72bd7fa640 1 -- 172.21.15.99:0/2732055021 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8017780 con 0x7f72c00b0d70 2024-01-19T05:19:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.143+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c00af7d0 con 0x7f72c00b0d70 2024-01-19T05:19:15.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.147+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c006a870 con 0x7f72c00b0d70 2024-01-19T05:19:15.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.147+0000 7f72bd7fa640 1 -- 172.21.15.99:0/2732055021 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f72b80203b0 con 0x7f72c00b0d70 2024-01-19T05:19:15.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.147+0000 7f72bd7fa640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f72ac066530 0x7f72ac0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.147+0000 7f72bd7fa640 1 -- 172.21.15.99:0/2732055021 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72b8083ef0 con 0x7f72c00b0d70 2024-01-19T05:19:15.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.147+0000 7f72c4e67640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f72ac066530 0x7f72ac0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.147+0000 7f72c4e67640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f72ac066530 0x7f72ac0689f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f72b40af000 tx=0x7f72b40046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:15.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.151+0000 7f72bd7fa640 1 -- 172.21.15.99:0/2732055021 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f72b8051520 con 0x7f72c00b0d70 2024-01-19T05:19:15.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f72c00af630 con 0x7f72ac066530 2024-01-19T05:19:15.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72bd7fa640 1 -- 172.21.15.99:0/2732055021 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f72c00af630 con 0x7f72ac066530 2024-01-19T05:19:15.296 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 7 to deep-scrub 2024-01-19T05:19:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f72ac066530 msgr2=0x7f72ac0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f72ac066530 0x7f72ac0689f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f72b40af000 tx=0x7f72b40046d0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c00b0d70 msgr2=0x7f72c013f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c00b0d70 0x7f72c013f8d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f72c00b8ce0 tx=0x7f72b800f4a0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 shutdown_connections 2024-01-19T05:19:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f72ac066530 0x7f72ac0689f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72c00b0d70 0x7f72c013f8d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72c01e29e0 0x7f72c00b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 --2- 172.21.15.99:0/2732055021 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72a8003980 0x7f72c00affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 >> 172.21.15.99:0/2732055021 conn(0x7f72c00b8080 msgr2=0x7f72c013c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 shutdown_connections 2024-01-19T05:19:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.295+0000 7f72c70cb640 1 -- 172.21.15.99:0/2732055021 wait complete. 2024-01-19T05:19:15.312 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:19:15.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f370a52f640 1 Processor -- start 2024-01-19T05:19:15.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f370a52f640 1 -- start start 2024-01-19T05:19:15.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f370a52f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f370406ebe0 0x7f3704071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f370a52f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3704072320 0x7f370414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f370a52f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370406f070 con 0x7f37040b19f0 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f370a52f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3704070680 con 0x7f370406ebe0 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f370a52f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3704070410 con 0x7f3704072320 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f36fb7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f370406ebe0 0x7f3704071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f36fb7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f370406ebe0 0x7f3704071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58014/0 (socket says 172.21.15.99:58014) 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f36fb7fe640 1 -- 172.21.15.99:0/609415885 learned_addr learned my addr 172.21.15.99:0/609415885 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f3708acc640 1 --2- 172.21.15.99:0/609415885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3704072320 0x7f370414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f36fb7fe640 1 -- 172.21.15.99:0/609415885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3704072320 msgr2=0x7f370414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:15.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f36fb7fe640 1 --2- 172.21.15.99:0/609415885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3704072320 0x7f370414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f36fb7fe640 1 -- 172.21.15.99:0/609415885 >> v1:172.21.15.157:6789/0 conn(0x7f37040b19f0 legacy=0x7f3704144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:15.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f36fb7fe640 1 -- 172.21.15.99:0/609415885 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704144790 con 0x7f370406ebe0 2024-01-19T05:19:15.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.419+0000 7f36fb7fe640 1 --2- 172.21.15.99:0/609415885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f370406ebe0 0x7f3704071de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009870 tx=0x7f36ec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d65a51c02e17b16 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:15.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f37037fe640 1 -- 172.21.15.99:0/609415885 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0ab620 con 0x7f370406ebe0 2024-01-19T05:19:15.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f37037fe640 1 -- 172.21.15.99:0/609415885 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec0ab780 con 0x7f370406ebe0 2024-01-19T05:19:15.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f37037fe640 1 -- 172.21.15.99:0/609415885 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0abb10 con 0x7f370406ebe0 2024-01-19T05:19:15.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- 172.21.15.99:0/609415885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f370406ebe0 msgr2=0x7f3704071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 --2- 172.21.15.99:0/609415885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f370406ebe0 0x7f3704071de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009870 tx=0x7f36ec01c440 comp rx=0 tx=0).stop 2024-01-19T05:19:15.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- 172.21.15.99:0/609415885 shutdown_connections 2024-01-19T05:19:15.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 --2- 172.21.15.99:0/609415885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3704072320 0x7f370414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 --2- 172.21.15.99:0/609415885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f370406ebe0 0x7f3704071de0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- 172.21.15.99:0/609415885 >> 172.21.15.99:0/609415885 conn(0x7f37040b8080 msgr2=0x7f37040b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:15.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- 172.21.15.99:0/609415885 shutdown_connections 2024-01-19T05:19:15.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- 172.21.15.99:0/609415885 wait complete. 2024-01-19T05:19:15.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 Processor -- start 2024-01-19T05:19:15.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- start start 2024-01-19T05:19:15.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f370406ebe0 0x7f37040b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3704072320 0x7f3704137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37040b19f0 0x7f37041e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704134120 con 0x7f3704072320 2024-01-19T05:19:15.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040b6d10 con 0x7f37040b19f0 2024-01-19T05:19:15.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370413f070 con 0x7f370406ebe0 2024-01-19T05:19:15.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3704072320 0x7f3704137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3704072320 0x7f3704137090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58018/0 (socket says 172.21.15.99:58018) 2024-01-19T05:19:15.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 -- 172.21.15.99:0/2048216174 learned_addr learned my addr 172.21.15.99:0/2048216174 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:15.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f3708acc640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37040b19f0 0x7f37041e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 -- 172.21.15.99:0/2048216174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f370406ebe0 msgr2=0x7f37040b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f370406ebe0 0x7f37040b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 -- 172.21.15.99:0/2048216174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37040b19f0 msgr2=0x7f37041e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37040b19f0 0x7f37041e02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 -- 172.21.15.99:0/2048216174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec0094d0 con 0x7f3704072320 2024-01-19T05:19:15.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f36fb7fe640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3704072320 0x7f3704137090 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0ad040 tx=0x7f36ec01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:15.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f37017fa640 1 -- 172.21.15.99:0/2048216174 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0be3f0 con 0x7f3704072320 2024-01-19T05:19:15.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f37017fa640 1 -- 172.21.15.99:0/2048216174 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec0be550 con 0x7f3704072320 2024-01-19T05:19:15.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3704134300 con 0x7f3704072320 2024-01-19T05:19:15.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f37017fa640 1 -- 172.21.15.99:0/2048216174 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0be900 con 0x7f3704072320 2024-01-19T05:19:15.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37041e0800 con 0x7f3704072320 2024-01-19T05:19:15.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.423+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37040696e0 con 0x7f3704072320 2024-01-19T05:19:15.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.427+0000 7f37017fa640 1 -- 172.21.15.99:0/2048216174 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f36ec0c7440 con 0x7f3704072320 2024-01-19T05:19:15.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.427+0000 7f37017fa640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f36e4066500 0x7f36e40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:15.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.427+0000 7f37017fa640 1 -- 172.21.15.99:0/2048216174 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f36ec11e1f0 con 0x7f3704072320 2024-01-19T05:19:15.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.427+0000 7f3703fff640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f36e4066500 0x7f36e40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:15.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.427+0000 7f3703fff640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f36e4066500 0x7f36e40689c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3704133970 tx=0x7f36f4006bd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:15.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.431+0000 7f37017fa640 1 -- 172.21.15.99:0/2048216174 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f36ec0eb820 con 0x7f3704072320 2024-01-19T05:19:15.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.571+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3704072730 con 0x7f36e4066500 2024-01-19T05:19:15.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.575+0000 7f37017fa640 1 -- 172.21.15.99:0/2048216174 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49412 (secure 0 0 0) 0x7f36f4013430 con 0x7f36e4066500 2024-01-19T05:19:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:15.579 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:19:15.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f36e4066500 msgr2=0x7f36e40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f36e4066500 0x7f36e40689c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3704133970 tx=0x7f36f4006bd0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3704072320 msgr2=0x7f3704137090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3704072320 0x7f3704137090 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0ad040 tx=0x7f36ec01ac80 comp rx=0 tx=0).stop 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 shutdown_connections 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f36e4066500 0x7f36e40689c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37040b19f0 0x7f37041e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3704072320 0x7f3704137090 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 --2- 172.21.15.99:0/2048216174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f370406ebe0 0x7f37040b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 >> 172.21.15.99:0/2048216174 conn(0x7f37040b8080 msgr2=0x7f37040735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:15.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 shutdown_connections 2024-01-19T05:19:15.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:15.579+0000 7f370a52f640 1 -- 172.21.15.99:0/2048216174 wait complete. 2024-01-19T05:19:15.595 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-01-19T05:19:15.362899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":241020,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733700,"statfs":{"total":773094113280,"available":772847308800,"internally_reserved":0,"allocated":4136960,"data_stored":2313832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.540903"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-19T05:19:07.031324+0000","last_change":"2024-01-19T05:17:53.355077+0000","last_active":"2024-01-19T05:19:07.031324+0000","last_peered":"2024-01-19T05:19:07.031324+0000","last_clean":"2024-01-19T05:19:07.031324+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:19:07.031324+0000","last_undegraded":"2024-01-19T05:19:07.031324+0000","last_fullsized":"2024-01-19T05:19:07.031324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-19T05:17:51.555434+0000","last_clean_scrub_stamp":"2024-01-19T05:17:51.555434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T13:40:16.763917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36280,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335560,"statfs":{"total":96636764160,"available":96599613440,"internally_reserved":0,"allocated":962560,"data_stored":732005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.024}]},{"osd":3,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.1299999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.87}]},{"osd":5,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.175},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.97099999999999997}]},{"osd":6,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.99299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.204}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.095}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.2430000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0609999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.284}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.3280000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":1.175}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.351},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.89100000000000001}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.2949999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.2490000000000001}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.83499999999999996}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.03}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.3280000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.4930000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0700000000000001}]},{"osd":1,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.355},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.387},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.28}]},{"osd":7,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.028}]},{"osd":6,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.075},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.2589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.1299999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.054}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.137},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.78800000000000003}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.204},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.341}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.167},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0549999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":732005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.20000000000000001}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.379}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.75},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:19:15.599 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-19T05:17:51.555434+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=17, tm_sec=51, tm_wday=4, tm_yday=19, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=19, tm_hour=5, tm_min=19, tm_sec=10, tm_wday=4, tm_yday=19, tm_isdst=0) 2024-01-19T05:19:15.599 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-19T05:19:35.600 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-19T05:19:35.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d16a92640 1 Processor -- start 2024-01-19T05:19:35.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d16a92640 1 -- start start 2024-01-19T05:19:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d16a92640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6d100b4df0 0x7f6d100714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d16a92640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10071a20 0x7f6d10146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d16a92640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d100b51d0 con 0x7f6d10146e70 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d16a92640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d10070dd0 con 0x7f6d100b4df0 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d16a92640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10147620 con 0x7f6d10071a20 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d1482e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6d100b4df0 0x7f6d100714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d1482e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6d100b4df0 0x7f6d100714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50992/0 (socket says 172.21.15.99:50992) 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d1482e640 1 -- 172.21.15.99:0/4079119342 learned_addr learned my addr 172.21.15.99:0/4079119342 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d0ffff640 1 --2- 172.21.15.99:0/4079119342 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10071a20 0x7f6d10146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d1482e640 1 -- 172.21.15.99:0/4079119342 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10071a20 msgr2=0x7f6d10146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d1482e640 1 --2- 172.21.15.99:0/4079119342 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10071a20 0x7f6d10146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d1482e640 1 -- 172.21.15.99:0/4079119342 >> v1:172.21.15.157:6789/0 conn(0x7f6d10146e70 legacy=0x7f6d10149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.730+0000 7f6d1482e640 1 -- 172.21.15.99:0/4079119342 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d10070fe0 con 0x7f6d100b4df0 2024-01-19T05:19:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d1482e640 1 --2- 172.21.15.99:0/4079119342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100714e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6d000098a0 tx=0x7f6d0001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ff7c7dc4913c3f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d0f7fe640 1 -- 172.21.15.99:0/4079119342 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000ab600 con 0x7f6d100b4df0 2024-01-19T05:19:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d0f7fe640 1 -- 172.21.15.99:0/4079119342 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d000a7050 con 0x7f6d100b4df0 2024-01-19T05:19:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d0f7fe640 1 -- 172.21.15.99:0/4079119342 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000ab980 con 0x7f6d100b4df0 2024-01-19T05:19:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d16a92640 1 -- 172.21.15.99:0/4079119342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 msgr2=0x7f6d100714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d16a92640 1 --2- 172.21.15.99:0/4079119342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100714e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6d000098a0 tx=0x7f6d0001c4e0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d16a92640 1 -- 172.21.15.99:0/4079119342 shutdown_connections 2024-01-19T05:19:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d16a92640 1 --2- 172.21.15.99:0/4079119342 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10071a20 0x7f6d10146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d16a92640 1 --2- 172.21.15.99:0/4079119342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100714e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d16a92640 1 -- 172.21.15.99:0/4079119342 >> 172.21.15.99:0/4079119342 conn(0x7f6d10066c40 msgr2=0x7f6d100ba190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d16a92640 1 -- 172.21.15.99:0/4079119342 shutdown_connections 2024-01-19T05:19:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.734+0000 7f6d16a92640 1 -- 172.21.15.99:0/4079119342 wait complete. 2024-01-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 Processor -- start 2024-01-19T05:19:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 -- start start 2024-01-19T05:19:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d10071a20 0x7f6d100b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10146e70 0x7f6d1009c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100b1180 con 0x7f6d100b4df0 2024-01-19T05:19:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1009b2f0 con 0x7f6d10071a20 2024-01-19T05:19:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10150fd0 con 0x7f6d10146e70 2024-01-19T05:19:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51000/0 (socket says 172.21.15.99:51000) 2024-01-19T05:19:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 -- 172.21.15.99:0/1276070824 learned_addr learned my addr 172.21.15.99:0/1276070824 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d1482e640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d10071a20 0x7f6d100b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d1502f640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10146e70 0x7f6d1009c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 -- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10146e70 msgr2=0x7f6d1009c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10146e70 0x7f6d1009c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 -- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d10071a20 msgr2=0x7f6d100b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d10071a20 0x7f6d100b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 -- 172.21.15.99:0/1276070824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000094d0 con 0x7f6d100b4df0 2024-01-19T05:19:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d1482e640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d10071a20 0x7f6d100b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d1502f640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10146e70 0x7f6d1009c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-19T05:19:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0ffff640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100af7b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d800 tx=0x7f6d0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/1276070824 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400b6c0 con 0x7f6d100b4df0 2024-01-19T05:19:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/1276070824 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0400b820 con 0x7f6d100b4df0 2024-01-19T05:19:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d100b3370 con 0x7f6d100b4df0 2024-01-19T05:19:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/1276070824 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400bb90 con 0x7f6d100b4df0 2024-01-19T05:19:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1009c8b0 con 0x7f6d100b4df0 2024-01-19T05:19:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d10067bf0 con 0x7f6d100b4df0 2024-01-19T05:19:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.738+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/1276070824 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6d0400bcf0 con 0x7f6d100b4df0 2024-01-19T05:19:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.742+0000 7f6d0d7fa640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6cfc066530 0x7f6cfc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.742+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/1276070824 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d04084030 con 0x7f6d100b4df0 2024-01-19T05:19:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.742+0000 7f6d1482e640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6cfc066530 0x7f6cfc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.742+0000 7f6d1482e640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6cfc066530 0x7f6cfc0689f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d000ad000 tx=0x7f6d00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.746+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/1276070824 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6d04051660 con 0x7f6d100b4df0 2024-01-19T05:19:35.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:19:35.830 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:19:35.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.894+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 --> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d100696e0 con 0x7f6cfc066530 2024-01-19T05:19:35.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.898+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/1276070824 <== mgr.4111 v2:172.21.15.99:6832/2084845362 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49190 (secure 0 0 0) 0x7f6d100696e0 con 0x7f6cfc066530 2024-01-19T05:19:35.902 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:35.902 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-19T05:19:35.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6cfc066530 msgr2=0x7f6cfc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:35.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6cfc066530 0x7f6cfc0689f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d000ad000 tx=0x7f6d00008040 comp rx=0 tx=0).stop 2024-01-19T05:19:35.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 msgr2=0x7f6d100af7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100af7b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d800 tx=0x7f6d0400dcc0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 shutdown_connections 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f6cfc066530 0x7f6cfc0689f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d10146e70 0x7f6d1009c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d100b4df0 0x7f6d100af7b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 --2- 172.21.15.99:0/1276070824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d10071a20 0x7f6d100b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 >> 172.21.15.99:0/1276070824 conn(0x7f6d10066c40 msgr2=0x7f6d1006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 shutdown_connections 2024-01-19T05:19:35.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:35.902+0000 7f6d16a92640 1 -- 172.21.15.99:0/1276070824 wait complete. 2024-01-19T05:19:35.919 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-01-19T05:19:35.367864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":241012,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733708,"statfs":{"total":773094113280,"available":772847316992,"internally_reserved":0,"allocated":4136960,"data_stored":2313832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003049"},"pg_stats":[{"pgid":"1.0","version":"32'119","reported_seq":186,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-19T05:19:15.872079+0000","last_change":"2024-01-19T05:19:15.872226+0000","last_active":"2024-01-19T05:19:15.872079+0000","last_peered":"2024-01-19T05:19:15.872079+0000","last_clean":"2024-01-19T05:19:15.872079+0000","last_became_active":"2024-01-19T05:17:53.352978+0000","last_became_peered":"2024-01-19T05:17:53.352978+0000","last_unstale":"2024-01-19T05:19:15.872079+0000","last_undegraded":"2024-01-19T05:19:15.872079+0000","last_fullsized":"2024-01-19T05:19:15.872079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-01-19T05:19:15.871828+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-01-19T05:19:15.871828+0000","last_clean_scrub_stamp":"2024-01-19T05:19:15.871828+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-20T09:17:05.560357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":962560,"data_stored":732005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.75}]},{"osd":1,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.143}]},{"osd":2,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.085},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81599999999999995}]},{"osd":3,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.2130000000000001}]},{"osd":4,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.002},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.1859999999999999}]},{"osd":5,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.048},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.268}]},{"osd":6,"last update":"Fri Jan 19 05:18:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.238}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.143}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.032}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.105}]},{"osd":3,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0660000000000001}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.89200000000000002}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":1.1759999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.103}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.05},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.84299999999999997}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.94199999999999995}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.999}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.03},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1459999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.01}]},{"osd":2,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.04},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.167}]},{"osd":3,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.1950000000000001}]},{"osd":5,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.754}]},{"osd":6,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0920000000000001}]},{"osd":7,"last update":"Fri Jan 19 05:18:54 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.2390000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.97499999999999998}]},{"osd":2,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.024}]},{"osd":4,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.1000000000000001}]},{"osd":5,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.222},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.88700000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.165},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.137}]},{"osd":7,"last update":"Fri Jan 19 05:18:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.26}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.72999999999999998}]},{"osd":4,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.98399999999999999}]},{"osd":6,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Jan 19 05:18:52 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.006},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.95899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":141637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.82699999999999996}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.98099999999999998}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.92900000000000005}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.91300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":962560,"data_stored":732005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.876}]},{"osd":3,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.996}]},{"osd":4,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.03},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.198},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.96299999999999997}]},{"osd":7,"last update":"Fri Jan 19 05:18:50 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.228}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-19T05:19:35.921 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-19T05:19:36.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.078+0000 7f01bb77a640 1 Processor -- start 2024-01-19T05:19:36.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.078+0000 7f01bb77a640 1 -- start start 2024-01-19T05:19:36.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01bb77a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b406ebe0 0x7f01b4071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01bb77a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01b4072320 0x7f01b414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01bb77a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b4070680 con 0x7f01b40b19f0 2024-01-19T05:19:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01bb77a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b4070410 con 0x7f01b4072320 2024-01-19T05:19:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01bb77a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b406f040 con 0x7f01b406ebe0 2024-01-19T05:19:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b9d17640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01b4072320 0x7f01b414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b8d15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b406ebe0 0x7f01b4071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b9d17640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01b4072320 0x7f01b414ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.99:43804/0 (socket says 172.21.15.99:43804) 2024-01-19T05:19:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b9d17640 1 -- 172.21.15.99:0/757704543 learned_addr learned my addr 172.21.15.99:0/757704543 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b8d15640 1 -- 172.21.15.99:0/757704543 >> v2:172.21.15.157:3300/0 conn(0x7f01b4072320 msgr2=0x7f01b414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b8d15640 1 --2- 172.21.15.99:0/757704543 >> v2:172.21.15.157:3300/0 conn(0x7f01b4072320 0x7f01b414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b8d15640 1 -- 172.21.15.99:0/757704543 >> v1:172.21.15.157:6789/0 conn(0x7f01b40b19f0 legacy=0x7f01b4144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b8d15640 1 -- 172.21.15.99:0/757704543 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4144790 con 0x7f01b406ebe0 2024-01-19T05:19:36.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01b8d15640 1 --2- 172.21.15.99:0/757704543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b406ebe0 0x7f01b4071de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f01b4070810 tx=0x7f01b001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cafa4bf6c13c7972 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:36.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01abfff640 1 -- 172.21.15.99:0/757704543 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00ac640 con 0x7f01b406ebe0 2024-01-19T05:19:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01abfff640 1 -- 172.21.15.99:0/757704543 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b00ac7a0 con 0x7f01b406ebe0 2024-01-19T05:19:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.082+0000 7f01abfff640 1 -- 172.21.15.99:0/757704543 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00acb30 con 0x7f01b406ebe0 2024-01-19T05:19:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- 172.21.15.99:0/757704543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b406ebe0 msgr2=0x7f01b4071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 --2- 172.21.15.99:0/757704543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b406ebe0 0x7f01b4071de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f01b4070810 tx=0x7f01b001c3c0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- 172.21.15.99:0/757704543 shutdown_connections 2024-01-19T05:19:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 --2- 172.21.15.99:0/757704543 >> v2:172.21.15.157:3300/0 conn(0x7f01b4072320 0x7f01b414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 --2- 172.21.15.99:0/757704543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b406ebe0 0x7f01b4071de0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- 172.21.15.99:0/757704543 >> 172.21.15.99:0/757704543 conn(0x7f01b40b8080 msgr2=0x7f01b40b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- 172.21.15.99:0/757704543 shutdown_connections 2024-01-19T05:19:36.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- 172.21.15.99:0/757704543 wait complete. 2024-01-19T05:19:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 Processor -- start 2024-01-19T05:19:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- start start 2024-01-19T05:19:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b406ebe0 0x7f01b4136fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01b4072320 0x7f01b4133150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b40b19f0 0x7f01b41302b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40b7020 con 0x7f01b406ebe0 2024-01-19T05:19:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b4139220 con 0x7f01b4072320 2024-01-19T05:19:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b4137c90 con 0x7f01b40b19f0 2024-01-19T05:19:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b406ebe0 0x7f01b4136fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b406ebe0 0x7f01b4136fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51002/0 (socket says 172.21.15.99:51002) 2024-01-19T05:19:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 -- 172.21.15.99:0/1639992253 learned_addr learned my addr 172.21.15.99:0/1639992253 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:36.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b8d15640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01b4072320 0x7f01b4133150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9d17640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b40b19f0 0x7f01b41302b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 -- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b40b19f0 msgr2=0x7f01b41302b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b40b19f0 0x7f01b41302b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 -- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01b4072320 msgr2=0x7f01b4133150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01b4072320 0x7f01b4133150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 -- 172.21.15.99:0/1639992253 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0009420 con 0x7f01b406ebe0 2024-01-19T05:19:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b8d15640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01b4072320 0x7f01b4133150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-19T05:19:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01b9516640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b406ebe0 0x7f01b4136fe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c420 tx=0x7f01a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01a9ffb640 1 -- 172.21.15.99:0/1639992253 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40052d0 con 0x7f01b406ebe0 2024-01-19T05:19:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01a9ffb640 1 -- 172.21.15.99:0/1639992253 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a4005430 con 0x7f01b406ebe0 2024-01-19T05:19:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b40b7200 con 0x7f01b406ebe0 2024-01-19T05:19:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01a9ffb640 1 -- 172.21.15.99:0/1639992253 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4007260 con 0x7f01b406ebe0 2024-01-19T05:19:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.086+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b4139490 con 0x7f01b406ebe0 2024-01-19T05:19:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.090+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b40696e0 con 0x7f01b406ebe0 2024-01-19T05:19:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.090+0000 7f01a9ffb640 1 -- 172.21.15.99:0/1639992253 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f01a40073c0 con 0x7f01b406ebe0 2024-01-19T05:19:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.090+0000 7f01a9ffb640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0198066500 0x7f01980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.090+0000 7f01a9ffb640 1 -- 172.21.15.99:0/1639992253 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01a4082f90 con 0x7f01b406ebe0 2024-01-19T05:19:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.090+0000 7f01b8d15640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0198066500 0x7f01980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.090+0000 7f01b8d15640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0198066500 0x7f01980689c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f01b00ae000 tx=0x7f01b0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.094+0000 7f01a9ffb640 1 -- 172.21.15.99:0/1639992253 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f01a4050520 con 0x7f01b406ebe0 2024-01-19T05:19:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.242+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f01b41443d0 con 0x7f01b406ebe0 2024-01-19T05:19:36.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.246+0000 7f01a9ffb640 1 -- 172.21.15.99:0/1639992253 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f01a4053b40 con 0x7f01b406ebe0 2024-01-19T05:19:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01a9ffb640 1 -- 172.21.15.99:0/1639992253 <== mon.0 v2:172.21.15.99:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f01a4050520 con 0x7f01b406ebe0 2024-01-19T05:19:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0198066500 msgr2=0x7f01980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0198066500 0x7f01980689c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f01b00ae000 tx=0x7f01b0008040 comp rx=0 tx=0).stop 2024-01-19T05:19:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b406ebe0 msgr2=0x7f01b4136fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b406ebe0 0x7f01b4136fe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c420 tx=0x7f01a400c8e0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 shutdown_connections 2024-01-19T05:19:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f0198066500 0x7f01980689c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01b40b19f0 0x7f01b41302b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01b4072320 0x7f01b4133150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 --2- 172.21.15.99:0/1639992253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b406ebe0 0x7f01b4136fe0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 >> 172.21.15.99:0/1639992253 conn(0x7f01b40b8080 msgr2=0x7f01b4142660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:36.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 shutdown_connections 2024-01-19T05:19:36.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.250+0000 7f01bb77a640 1 -- 172.21.15.99:0/1639992253 wait complete. 2024-01-19T05:19:36.270 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-19T05:19:36.270 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-19T05:19:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f930b988640 1 Processor -- start 2024-01-19T05:19:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f930b988640 1 -- start start 2024-01-19T05:19:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f930b988640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93040b19f0 0x7f930406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f930b988640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9304144c70 0x7f9304145100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f930b988640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9304070680 con 0x7f9304071de0 2024-01-19T05:19:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f930b988640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9304070410 con 0x7f93040b19f0 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f930b988640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9304144790 con 0x7f9304144c70 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f9309724640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93040b19f0 0x7f930406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f9309724640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93040b19f0 0x7f930406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51004/0 (socket says 172.21.15.99:51004) 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f9309724640 1 -- 172.21.15.99:0/1402026393 learned_addr learned my addr 172.21.15.99:0/1402026393 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f9308f23640 1 --2- 172.21.15.99:0/1402026393 >> v2:172.21.15.157:3300/0 conn(0x7f9304144c70 0x7f9304145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f9309724640 1 -- 172.21.15.99:0/1402026393 >> v2:172.21.15.157:3300/0 conn(0x7f9304144c70 msgr2=0x7f9304145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f9309724640 1 --2- 172.21.15.99:0/1402026393 >> v2:172.21.15.157:3300/0 conn(0x7f9304144c70 0x7f9304145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f9309724640 1 -- 172.21.15.99:0/1402026393 >> v1:172.21.15.99:6789/0 conn(0x7f9304071de0 legacy=0x7f93040721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f9309724640 1 -- 172.21.15.99:0/1402026393 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930406f2b0 con 0x7f93040b19f0 2024-01-19T05:19:36.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.386+0000 7f92fbfff640 1 -- 172.21.15.99:0/1402026393 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498553455 0 0) 0x7f9304070680 con 0x7f9304071de0 2024-01-19T05:19:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f9309724640 1 --2- 172.21.15.99:0/1402026393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93040b19f0 0x7f930406ebe0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9304072cc0 tx=0x7f92fc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860fc266d10afa2f server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f92fbfff640 1 -- 172.21.15.99:0/1402026393 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc0a57a0 con 0x7f93040b19f0 2024-01-19T05:19:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f92fbfff640 1 -- 172.21.15.99:0/1402026393 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f92fc0a5900 con 0x7f93040b19f0 2024-01-19T05:19:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f92fbfff640 1 -- 172.21.15.99:0/1402026393 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc0a5cb0 con 0x7f93040b19f0 2024-01-19T05:19:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 -- 172.21.15.99:0/1402026393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93040b19f0 msgr2=0x7f930406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 --2- 172.21.15.99:0/1402026393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93040b19f0 0x7f930406ebe0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9304072cc0 tx=0x7f92fc01c940 comp rx=0 tx=0).stop 2024-01-19T05:19:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 -- 172.21.15.99:0/1402026393 shutdown_connections 2024-01-19T05:19:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 --2- 172.21.15.99:0/1402026393 >> v2:172.21.15.157:3300/0 conn(0x7f9304144c70 0x7f9304145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 --2- 172.21.15.99:0/1402026393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93040b19f0 0x7f930406ebe0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 -- 172.21.15.99:0/1402026393 >> 172.21.15.99:0/1402026393 conn(0x7f93040b8080 msgr2=0x7f93040b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:36.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 -- 172.21.15.99:0/1402026393 shutdown_connections 2024-01-19T05:19:36.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 -- 172.21.15.99:0/1402026393 wait complete. 2024-01-19T05:19:36.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 Processor -- start 2024-01-19T05:19:36.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.390+0000 7f930b988640 1 -- start start 2024-01-19T05:19:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9304071de0 0x7f9304140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93040b19f0 0x7f930413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9304144c70 0x7f930413b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930413ee80 con 0x7f9304144c70 2024-01-19T05:19:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9304141230 con 0x7f93040b19f0 2024-01-19T05:19:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93041402e0 con 0x7f9304071de0 2024-01-19T05:19:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9304144c70 0x7f930413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9304144c70 0x7f930413b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51012/0 (socket says 172.21.15.99:51012) 2024-01-19T05:19:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 -- 172.21.15.99:0/1831056349 learned_addr learned my addr 172.21.15.99:0/1831056349 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-19T05:19:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9308f23640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93040b19f0 0x7f930413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309724640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9304071de0 0x7f9304140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 -- 172.21.15.99:0/1831056349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9304071de0 msgr2=0x7f9304140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9304071de0 0x7f9304140cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 -- 172.21.15.99:0/1831056349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93040b19f0 msgr2=0x7f930413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93040b19f0 0x7f930413fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 -- 172.21.15.99:0/1831056349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc009b30 con 0x7f9304144c70 2024-01-19T05:19:36.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309f25640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9304144c70 0x7f930413b520 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f930000c410 tx=0x7f930000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:36.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f92f9ffb640 1 -- 172.21.15.99:0/1831056349 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000052d0 con 0x7f9304144c70 2024-01-19T05:19:36.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f92f9ffb640 1 -- 172.21.15.99:0/1831056349 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9300005450 con 0x7f9304144c70 2024-01-19T05:19:36.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930413ba60 con 0x7f9304144c70 2024-01-19T05:19:36.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f92f9ffb640 1 -- 172.21.15.99:0/1831056349 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300003880 con 0x7f9304144c70 2024-01-19T05:19:36.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9304141540 con 0x7f9304144c70 2024-01-19T05:19:36.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930413f030 con 0x7f9304144c70 2024-01-19T05:19:36.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f92f9ffb640 1 -- 172.21.15.99:0/1831056349 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f93000039e0 con 0x7f9304144c70 2024-01-19T05:19:36.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f92f9ffb640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f92e8066530 0x7f92e80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-19T05:19:36.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309724640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f92e8066530 0x7f92e80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-19T05:19:36.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f92f9ffb640 1 -- 172.21.15.99:0/1831056349 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9300083100 con 0x7f9304144c70 2024-01-19T05:19:36.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.394+0000 7f9309724640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f92e8066530 0x7f92e80689f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0ae000 tx=0x7f92fc0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-19T05:19:36.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.398+0000 7f92f9ffb640 1 -- 172.21.15.99:0/1831056349 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f930413f030 con 0x7f9304144c70 2024-01-19T05:19:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.590+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93040696e0 con 0x7f9304144c70 2024-01-19T05:19:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f92f9ffb640 1 -- 172.21.15.99:0/1831056349 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2114 (secure 0 0 0) 0x7f93000506a0 con 0x7f9304144c70 2024-01-19T05:19:36.596 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-19T05:19:36.596 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4544,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/84065038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":84065038},{"type":"v1","addr":"172.21.15.157:6833","nonce":84065038}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1803404649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1803404649},{"type":"v1","addr":"172.21.15.99:6835","nonce":1803404649}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":15}],"filesystems":[]} 2024-01-19T05:19:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-01-19T05:19:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f92e8066530 msgr2=0x7f92e80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f92e8066530 0x7f92e80689f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0ae000 tx=0x7f92fc0a7070 comp rx=0 tx=0).stop 2024-01-19T05:19:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9304144c70 msgr2=0x7f930413b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-19T05:19:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9304144c70 0x7f930413b520 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f930000c410 tx=0x7f930000c8d0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 shutdown_connections 2024-01-19T05:19:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:6832/2084845362,v1:172.21.15.99:6833/2084845362] conn(0x7f92e8066530 0x7f92e80689f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9304144c70 0x7f930413b520 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93040b19f0 0x7f930413fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 --2- 172.21.15.99:0/1831056349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9304071de0 0x7f9304140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-19T05:19:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 >> 172.21.15.99:0/1831056349 conn(0x7f93040b8080 msgr2=0x7f9304070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-19T05:19:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 shutdown_connections 2024-01-19T05:19:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-19T05:19:36.594+0000 7f930b988640 1 -- 172.21.15.99:0/1831056349 wait complete. 2024-01-19T05:19:36.614 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-19T05:19:36.614 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-19T05:19:36.615 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-19T05:19:36.615 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:36.625 INFO:tasks.ceph.mds.a:Stopped 2024-01-19T05:19:36.626 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-19T05:19:36.626 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:36.645 INFO:tasks.ceph.mds.b:Stopped 2024-01-19T05:19:36.645 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-19T05:19:36.645 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-19T05:19:36.645 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:36.745 INFO:tasks.ceph.osd.0:Stopped 2024-01-19T05:19:36.746 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-19T05:19:36.746 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:36.828 INFO:tasks.ceph.osd.1:Stopped 2024-01-19T05:19:36.828 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-19T05:19:36.828 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:36.902 INFO:tasks.ceph.osd.2:Stopped 2024-01-19T05:19:36.902 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-19T05:19:36.903 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:36.976 INFO:tasks.ceph.osd.3:Stopped 2024-01-19T05:19:36.976 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-19T05:19:36.977 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.061 INFO:tasks.ceph.osd.4:Stopped 2024-01-19T05:19:37.061 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-19T05:19:37.061 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.134 INFO:tasks.ceph.osd.5:Stopped 2024-01-19T05:19:37.135 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-19T05:19:37.135 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.217 INFO:tasks.ceph.osd.6:Stopped 2024-01-19T05:19:37.217 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-19T05:19:37.217 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.285 INFO:tasks.ceph.osd.7:Stopped 2024-01-19T05:19:37.286 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-19T05:19:37.286 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-19T05:19:37.286 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.315 INFO:tasks.ceph.mgr.y:Stopped 2024-01-19T05:19:37.315 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-19T05:19:37.315 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-01-19T05:19:37.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-01-19T05:19:37.343 INFO:tasks.ceph.mgr.x:Stopped 2024-01-19T05:19:37.343 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-19T05:19:37.343 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-19T05:19:37.343 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.371 INFO:tasks.ceph.mon.a:Stopped 2024-01-19T05:19:37.371 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-19T05:19:37.371 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.396 INFO:tasks.ceph.mon.b:Stopped 2024-01-19T05:19:37.397 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-19T05:19:37.397 INFO:teuthology.orchestra.run:waiting for 300 2024-01-19T05:19:37.454 INFO:tasks.ceph.mon.c:Stopped 2024-01-19T05:19:37.455 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-19T05:19:37.455 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-19T05:19:37.470 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:19:37.471 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-19T05:19:37.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:19:37.790 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-19T05:19:37.959 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:19:37.959 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-19T05:19:38.109 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:19:38.109 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-19T05:19:38.268 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:19:38.269 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-19T05:19:38.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:19:38.397 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-19T05:19:38.604 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:19:38.605 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-19T05:19:38.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:19:38.771 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-19T05:19:38.939 INFO:tasks.ceph:Archiving mon data... 2024-01-19T05:19:38.940 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/data/mon.a.tgz 2024-01-19T05:19:38.940 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-01-19T05:19:38.946 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.vlmgxwLrIw 2024-01-19T05:19:38.947 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vlmgxwLrIw 2024-01-19T05:19:39.052 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.vlmgxwLrIw 2024-01-19T05:19:39.116 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.vlmgxwLrIw is 262KB 2024-01-19T05:19:39.177 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.vlmgxwLrIw 2024-01-19T05:19:39.183 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/data/mon.b.tgz 2024-01-19T05:19:39.183 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-01-19T05:19:39.189 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.mgleVExzwI 2024-01-19T05:19:39.189 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.mgleVExzwI 2024-01-19T05:19:39.311 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.mgleVExzwI 2024-01-19T05:19:39.377 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.mgleVExzwI is 354KB 2024-01-19T05:19:39.434 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.mgleVExzwI 2024-01-19T05:19:39.439 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/data/mon.c.tgz 2024-01-19T05:19:39.440 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-01-19T05:19:39.489 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.Q3DBXPIJPc 2024-01-19T05:19:39.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Q3DBXPIJPc 2024-01-19T05:19:39.613 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.Q3DBXPIJPc 2024-01-19T05:19:39.681 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.Q3DBXPIJPc is 354KB 2024-01-19T05:19:39.738 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.Q3DBXPIJPc 2024-01-19T05:19:39.744 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-19T05:19:39.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-19T05:19:39.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-19T05:19:39.807 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-19T05:19:39.849 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-19T05:19:39.849 INFO:tasks.ceph:Archiving crash dumps... 2024-01-19T05:19:39.851 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/remote/smithi099/crash 2024-01-19T05:19:39.852 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-19T05:19:39.865 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/remote/smithi157/crash 2024-01-19T05:19:39.866 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-19T05:19:39.904 INFO:tasks.ceph:Shutting down logrotate 2024-01-19T05:19:39.905 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:19:39.912 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-19T05:19:39.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-19T05:19:40.009 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-19T05:19:40.022 INFO:tasks.ceph:Compressing logs... 2024-01-19T05:19:40.022 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-19T05:19:40.052 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-19T05:19:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35717.log 2024-01-19T05:19:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35240.log 2024-01-19T05:19:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34090.log 2024-01-19T05:19:40.075 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35717.log.gz 2024-01-19T05:19:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 2024-01-19T05:19:40.075 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35240.log.gz 2024-01-19T05:19:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33091.log 2024-01-19T05:19:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33631.log 2024-01-19T05:19:40.075 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34090.log.gz 2024-01-19T05:19:40.075 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-01-19T05:19:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27207.log 2024-01-19T05:19:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33631.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33091.log.gz 2024-01-19T05:19:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36606.log 2024-01-19T05:19:40.080 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33631.log.gz 2024-01-19T05:19:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.27207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34099.log 2024-01-19T05:19:40.081 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27207.log.gz 2024-01-19T05:19:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38049.log 2024-01-19T05:19:40.081 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36606.log.gz 2024-01-19T05:19:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-19T05:19:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34099.log: /var/log/ceph/ceph-client.admin.38049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36061.log 2024-01-19T05:19:40.081 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34099.log.gz 2024-01-19T05:19:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.y.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38049.log.gz 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34619.log 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35606.log 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36061.log: /var/log/ceph/ceph-client.admin.34619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35188.log 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36061.log.gz 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35606.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34619.log.gz 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35743.log 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35606.log.gz 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-01-19T05:19:40.082 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35188.log.gz 2024-01-19T05:19:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33683.log 2024-01-19T05:19:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37138.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35743.log.gz 2024-01-19T05:19:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33313.log 2024-01-19T05:19:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33683.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-01-19T05:19:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35795.log 2024-01-19T05:19:40.083 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33683.log.gz 2024-01-19T05:19:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-19T05:19:40.090 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33313.log: /var/log/ceph/ceph-client.admin.35795.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33313.log.gz 2024-01-19T05:19:40.090 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33813.log 2024-01-19T05:19:40.090 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35795.log.gz 2024-01-19T05:19:40.091 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34879.log 2024-01-19T05:19:40.091 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33158.log 2024-01-19T05:19:40.091 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34879.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33813.log.gz 2024-01-19T05:19:40.091 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38439.log 2024-01-19T05:19:40.091 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33158.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.34879.log.gz 2024-01-19T05:19:40.091 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36035.log 2024-01-19T05:19:40.091 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33158.log.gz 2024-01-19T05:19:40.091 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33605.log 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34853.log 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38439.log.gz 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36035.log.gz 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36774.log 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37600.log 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33605.log.gz 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34853.log: /var/log/ceph/ceph-client.admin.36774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36271.log 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34853.log.gz 2024-01-19T05:19:40.092 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36774.log.gz 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36450.log 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33735.log 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36271.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37600.log.gz 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36271.log.gz 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34593.log 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36450.log.gz 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33447.log 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37387.log 2024-01-19T05:19:40.093 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34593.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33735.log.gz 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34300.log 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33447.log.gz 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34593.log.gz 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36193.log 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35110.log 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34300.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37387.log.gz 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36193.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.34300.log.gz --verbose 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.36554.log 2024-01-19T05:19:40.094 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36193.log.gz 2024-01-19T05:19:40.095 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33287.log 2024-01-19T05:19:40.095 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35110.log.gz 2024-01-19T05:19:40.095 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33261.log 2024-01-19T05:19:40.095 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36554.log.gz 2024-01-19T05:19:40.095 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37444.log 2024-01-19T05:19:40.095 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33287.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-19T05:19:40.095 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33261.log: /var/log/ceph/ceph-client.admin.37444.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33287.log.gz 2024-01-19T05:19:40.095 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36398.log 2024-01-19T05:19:40.106 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27213.log 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27237.log 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27213.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27213.log.gz 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27309.log 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27237.log.gz 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27285.log 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.6.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27309.log.gz 2024-01-19T05:19:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-19T05:19:40.108 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27357.log/var/log/ceph/ceph-client.admin.27285.log: 2024-01-19T05:19:40.108 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27285.log.gz 2024-01-19T05:19:40.108 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-19T05:19:40.108 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-19T05:19:40.108 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27357.log: /var/log/ceph/ceph-mgr.x.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.27357.log.gz 2024-01-19T05:19:40.108 INFO:teuthology.orchestra.run.smithi157.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27333.log 2024-01-19T05:19:40.108 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27381.log 2024-01-19T05:19:40.108 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27333.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27381.log: 91.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27333.log.gz 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27381.log.gz 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.b.log: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-19T05:19:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27261.log 2024-01-19T05:19:40.110 INFO:teuthology.orchestra.run.smithi157.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-osd.4.log: 2024-01-19T05:19:40.110 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27261.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27261.log.gz 2024-01-19T05:19:40.111 INFO:teuthology.orchestra.run.smithi157.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-19T05:19:40.130 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33261.log.gz 2024-01-19T05:19:40.130 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37444.log.gz 2024-01-19T05:19:40.130 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36326.log 2024-01-19T05:19:40.130 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38127.log 2024-01-19T05:19:40.131 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36398.log: /var/log/ceph/ceph-client.admin.36326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34489.log 2024-01-19T05:19:40.131 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36398.log.gz 2024-01-19T05:19:40.131 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36326.log.gz 2024-01-19T05:19:40.131 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37652.log 2024-01-19T05:19:40.131 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34489.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38127.log.gz 2024-01-19T05:19:40.131 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38335.log 2024-01-19T05:19:40.131 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2024-01-19T05:19:40.131 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37010.log 2024-01-19T05:19:40.132 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33551.log 2024-01-19T05:19:40.132 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38335.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37652.log.gz 2024-01-19T05:19:40.132 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38179.log 2024-01-19T05:19:40.132 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38335.log.gz 2024-01-19T05:19:40.132 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37010.log.gz 2024-01-19T05:19:40.132 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5/var/log/ceph/ceph-client.admin.33551.log: --verbose -- /var/log/ceph/ceph-client.admin.36722.log 2024-01-19T05:19:40.132 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38179.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-19T05:19:40.132 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33551.log.gz 2024-01-19T05:19:40.133 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38179.log.gz 2024-01-19T05:19:40.133 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-01-19T05:19:40.133 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37418.log 2024-01-19T05:19:40.133 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.a.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36722.log.gz 2024-01-19T05:19:40.133 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37335.log 2024-01-19T05:19:40.133 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37626.log 2024-01-19T05:19:40.133 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37418.log: -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2024-01-19T05:19:40.133 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37418.log.gz 2024-01-19T05:19:40.134 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37036.log 2024-01-19T05:19:40.134 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35580.log 2024-01-19T05:19:40.134 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37335.log.gz 2024-01-19T05:19:40.134 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37626.log: /var/log/ceph/ceph-client.admin.37036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33188.log 2024-01-19T05:19:40.134 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37626.log.gz 2024-01-19T05:19:40.134 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35580.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37036.log.gz 2024-01-19T05:19:40.134 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34671.log 2024-01-19T05:19:40.134 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35580.log.gz 2024-01-19T05:19:40.135 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34697.log 2024-01-19T05:19:40.135 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34671.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33188.log.gz 2024-01-19T05:19:40.135 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36009.log 2024-01-19T05:19:40.135 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34671.log.gz 2024-01-19T05:19:40.135 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34098.log 2024-01-19T05:19:40.135 INFO:teuthology.orchestra.run.smithi099.stderr:gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.34697.log.gz --verbose 2024-01-19T05:19:40.135 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.27325.log 2024-01-19T05:19:40.135 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36009.log: /var/log/ceph/ceph-client.admin.34098.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36009.log.gz 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34297.log 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34098.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36245.log 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.27325.log: /var/log/ceph/ceph-client.admin.34297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36688.log 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27325.log.gz 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33657.log 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34297.log.gz 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37893.log 2024-01-19T05:19:40.136 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36245.log.gz 2024-01-19T05:19:40.137 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36688.log: /var/log/ceph/ceph-client.admin.33657.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36688.log.gz 2024-01-19T05:19:40.137 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33657.log.gz 2024-01-19T05:19:40.137 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37803.log 2024-01-19T05:19:40.137 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35318.log 2024-01-19T05:19:40.137 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37893.log.gz 2024-01-19T05:19:40.137 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33419.log 2024-01-19T05:19:40.137 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37777.log 2024-01-19T05:19:40.137 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37803.log.gz 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34775.log 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35318.log.gz 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33761.log 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37777.log: -- replaced with /var/log/ceph/ceph-client.admin.33419.log.gz 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35398.log 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37777.log.gz 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34775.log.gz 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37253.log 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33761.log: /var/log/ceph/ceph-client.admin.35398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35058.log 2024-01-19T05:19:40.138 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37253.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35398.log.gz 2024-01-19T05:19:40.139 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35450.log 2024-01-19T05:19:40.139 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33761.log.gz 2024-01-19T05:19:40.139 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.35058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35632.log 2024-01-19T05:19:40.139 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37253.log.gz 2024-01-19T05:19:40.139 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35957.log 2024-01-19T05:19:40.139 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2%/var/log/ceph/ceph-client.admin.35632.log: 89.3% -- replaced with /var/log/ceph/ceph-client.0.35058.log.gz 2024-01-19T05:19:40.139 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35450.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33876.log 2024-01-19T05:19:40.139 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38257.log 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35632.log.gz/var/log/ceph/ceph-client.admin.35957.log: 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38465.log 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35957.log.gz 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35769.log 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38257.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33876.log.gz 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38465.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34309.log 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38257.log.gz 2024-01-19T05:19:40.140 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38465.log.gz 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35769.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35769.log.gz 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37470.log 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34309.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34309.log.gz 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36580.log 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34645.log 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.3.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37470.log.gz 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33339.log 2024-01-19T05:19:40.141 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34645.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36580.log.gz 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35848.log 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34645.log.gz 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33339.log: /var/log/ceph/ceph-client.admin.35848.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35848.log.gz 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33339.log.gz 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36087.log 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37574.log 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2%/var/log/ceph/ceph-client.admin.36087.log: -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2024-01-19T05:19:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36476.log 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36087.log.gz 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37574.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37574.log.gz 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37919.log 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34281.log 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37919.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36476.log.gz 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36854.log 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33787.log 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37919.log.gz 2024-01-19T05:19:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36854.log: /var/log/ceph/ceph-client.admin.34281.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36854.log.gz 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34281.log.gz 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37548.log 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34100.log 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37548.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33787.log.gz 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36632.log 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37704.log 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37548.log.gz 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34100.log: /var/log/ceph/ceph-client.admin.36632.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34100.log.gz 2024-01-19T05:19:40.144 INFO:teuthology.orchestra.run.smithi099.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36632.log.gz 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38205.log 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35162.log 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4%/var/log/ceph/ceph-client.admin.38205.log: -- replaced with /var/log/ceph/ceph-client.admin.37704.log.gz 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37751.log 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35162.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38205.log.gz 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36167.log 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35162.log.gz 2024-01-19T05:19:40.145 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35983.log 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2%/var/log/ceph/ceph-client.admin.36167.log: -- replaced with /var/log/ceph/ceph-client.admin.37751.log.gz 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36167.log.gz 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34097.log 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35983.log.gz 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36984.log 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35691.log 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6%/var/log/ceph/ceph-client.admin.36984.log: -- replaced with /var/log/ceph/ceph-client.admin.34097.log.gz 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33892.log 2024-01-19T05:19:40.146 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36984.log.gz 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35691.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35691.log.gz 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38413.log 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33473.log 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38413.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33892.log.gz 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36932.log 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38023.log 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38413.log.gz 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33473.log: /var/log/ceph/ceph-client.admin.36932.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33473.log.gz 2024-01-19T05:19:40.147 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36932.log.gz 2024-01-19T05:19:40.148 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37829.log 2024-01-19T05:19:40.148 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37496.log 2024-01-19T05:19:40.148 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3%/var/log/ceph/ceph-client.admin.37829.log: -- replaced with /var/log/ceph/ceph-client.admin.38023.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35370.log 2024-01-19T05:19:40.148 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-19T05:19:40.148 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37829.log.gz 2024-01-19T05:19:40.148 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37496.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37496.log.gz 2024-01-19T05:19:40.148 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33893.log 2024-01-19T05:19:40.148 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38387.log 2024-01-19T05:19:40.149 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5%/var/log/ceph/ceph-client.admin.33893.log: -- replaced with /var/log/ceph/ceph-client.admin.35370.log.gz 2024-01-19T05:19:40.149 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33525.log 2024-01-19T05:19:40.149 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33893.log.gz 2024-01-19T05:19:40.149 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38387.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38387.log.gz 2024-01-19T05:19:40.161 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-01-19T05:19:40.161 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38309.log 2024-01-19T05:19:40.161 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33885.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33525.log.gz 2024-01-19T05:19:40.161 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38231.log 2024-01-19T05:19:40.161 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33839.log 2024-01-19T05:19:40.162 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38309.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-01-19T05:19:40.162 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38231.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38309.log.gz 2024-01-19T05:19:40.162 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38231.log.gz 2024-01-19T05:19:40.162 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37945.log 2024-01-19T05:19:40.162 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33839.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-19T05:19:40.162 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37945.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33839.log.gz 2024-01-19T05:19:40.162 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37309.log 2024-01-19T05:19:40.162 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34293.log 2024-01-19T05:19:40.163 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37945.log.gz 2024-01-19T05:19:40.163 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37309.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37309.log.gz 2024-01-19T05:19:40.163 INFO:teuthology.orchestra.run.smithi099.stderr: 83.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-19T05:19:40.163 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36219.log 2024-01-19T05:19:40.163 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2024-01-19T05:19:40.163 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6%/var/log/ceph/ceph-client.admin.36219.log: -- replaced with /var/log/ceph/ceph-client.admin.34293.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35502.log 2024-01-19T05:19:40.163 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-19T05:19:40.163 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36219.log.gz 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35266.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38101.log 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34301.log 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1%/var/log/ceph/ceph-client.admin.38101.log: -- replaced with /var/log/ceph/ceph-client.admin.35502.log.gz 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38101.log.gz 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33391.log 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34301.log.gz 2024-01-19T05:19:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37997.log 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33391.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37062.log 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36141.log 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33391.log.gz 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37997.log: /var/log/ceph/ceph-client.admin.37062.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37997.log.gz 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37062.log.gz 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35292.log 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34515.log 2024-01-19T05:19:40.165 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35292.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37867.log 2024-01-19T05:19:40.166 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36141.log.gz 2024-01-19T05:19:40.166 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35292.log.gz 2024-01-19T05:19:40.166 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34515.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34515.log.gz 2024-01-19T05:19:40.166 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33886.log 2024-01-19T05:19:40.166 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36115.log 2024-01-19T05:19:40.166 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0%/var/log/ceph/ceph-client.admin.33886.log: -- replaced with /var/log/ceph/ceph-client.admin.37867.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33365.log 2024-01-19T05:19:40.166 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-19T05:19:40.166 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33886.log.gz 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36115.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36115.log.gz 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35900.log 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37361.log 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34723.log 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33365.log.gz 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35900.log: /var/log/ceph/ceph-client.admin.37361.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35900.log.gz 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37361.log.gz 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-19T05:19:40.167 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33889.log 2024-01-19T05:19:40.168 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34723.log.gz 2024-01-19T05:19:40.168 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2024-01-19T05:19:40.168 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36802.log 2024-01-19T05:19:40.168 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8%/var/log/ceph/ceph-client.admin.36906.log: -- replaced with /var/log/ceph/ceph-client.admin.33889.log.gz 2024-01-19T05:19:40.168 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2024-01-19T05:19:40.168 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-19T05:19:40.168 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36297.log 2024-01-19T05:19:40.168 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36802.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-19T05:19:40.169 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36297.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38283.log 2024-01-19T05:19:40.169 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36802.log.gz 2024-01-19T05:19:40.169 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36297.log.gz 2024-01-19T05:19:40.169 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34082.log 2024-01-19T05:19:40.169 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2024-01-19T05:19:40.169 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34082.log: /var/log/ceph/ceph-client.admin.38283.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38283.log.gz 2024-01-19T05:19:40.169 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34082.log.gz 2024-01-19T05:19:40.169 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33890.log 2024-01-19T05:19:40.170 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34567.log 2024-01-19T05:19:40.177 INFO:teuthology.orchestra.run.smithi157.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-19T05:19:40.178 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36528.log: /var/log/ceph/ceph-client.admin.33890.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33890.log.gz 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35476.log 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33499.log 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34567.log: /var/log/ceph/ceph-client.admin.35476.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34567.log.gz 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35476.log.gz 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35344.log 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34801.log 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33499.log: /var/log/ceph/ceph-client.admin.35344.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33499.log.gz 2024-01-19T05:19:40.179 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35344.log.gz 2024-01-19T05:19:40.180 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36880.log 2024-01-19T05:19:40.180 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35136.log 2024-01-19T05:19:40.180 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34801.log: /var/log/ceph/ceph-client.admin.36880.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36880.log.gz 2024-01-19T05:19:40.180 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34801.log.gz 2024-01-19T05:19:40.180 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33709.log 2024-01-19T05:19:40.180 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38361.log 2024-01-19T05:19:40.180 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35136.log: /var/log/ceph/ceph-client.admin.33709.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35136.log.gz 2024-01-19T05:19:40.180 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33709.log.gz 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34827.log 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37522.log 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38361.log: /var/log/ceph/ceph-client.admin.34827.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38361.log.gz 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34827.log.gz 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36748.log 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37522.log: /var/log/ceph/ceph-client.admin.36748.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37522.log.gz 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36748.log.gz 2024-01-19T05:19:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34308.log 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33234.log 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37088.log: /var/log/ceph/ceph-client.admin.34308.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34308.log.gz 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36424.log 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38075.log 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33234.log: /var/log/ceph/ceph-client.admin.36424.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33234.log.gz 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36424.log.gz 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37971.log 2024-01-19T05:19:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34101.log 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38075.log: /var/log/ceph/ceph-client.admin.37971.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38075.log.gz 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37971.log.gz 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35822.log 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37194.log 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5%/var/log/ceph/ceph-client.admin.35822.log: -- replaced with /var/log/ceph/ceph-client.admin.34101.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27090.log 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35822.log.gz 2024-01-19T05:19:40.183 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.37194.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-19T05:19:40.184 INFO:teuthology.orchestra.run.smithi099.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.37194.log.gz 2024-01-19T05:19:40.184 INFO:teuthology.orchestra.run.smithi157.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-19T05:19:40.191 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37283.log 2024-01-19T05:19:40.191 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.27090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35554.log 2024-01-19T05:19:40.191 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37283.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34299.log 2024-01-19T05:19:40.191 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27090.log.gz 2024-01-19T05:19:40.191 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35554.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37283.log.gz 2024-01-19T05:19:40.191 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22281.log 2024-01-19T05:19:40.191 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35658.log 2024-01-19T05:19:40.192 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35554.log.gz 2024-01-19T05:19:40.192 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34299.log: /var/log/ceph/ceph.tmp-client.admin.22281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34934.log 2024-01-19T05:19:40.192 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22281.log.gz 2024-01-19T05:19:40.192 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34299.log.gz 2024-01-19T05:19:40.192 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35214.log 2024-01-19T05:19:40.192 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35658.log.gz 2024-01-19T05:19:40.192 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35874.log 2024-01-19T05:19:40.192 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35214.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34934.log.gz 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33881.log 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35214.log.gz 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35874.log.gz 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34749.log 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36828.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33881.log.gz 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35528.log 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2024-01-19T05:19:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33579.log 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34749.log.gz 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34541.log 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36502.log 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35528.log.gz 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34541.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33579.log.gz 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35424.log 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.34541.log.gz -5 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36372.log 2024-01-19T05:19:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36502.log: /var/log/ceph/ceph-client.admin.35424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35926.log 2024-01-19T05:19:40.195 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35424.log.gz 2024-01-19T05:19:40.195 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36502.log.gz 2024-01-19T05:19:40.195 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38153.log 2024-01-19T05:19:40.195 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36372.log: /var/log/ceph/ceph-client.admin.35926.log: 88.8%/var/log/ceph/ceph-client.admin.38153.log: -- replaced with /var/log/ceph/ceph-client.admin.35926.log.gz 2024-01-19T05:19:40.195 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36372.log.gz 2024-01-19T05:19:40.195 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38153.log.gz 2024-01-19T05:19:40.196 INFO:teuthology.orchestra.run.smithi157.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-19T05:19:40.199 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-19T05:19:40.209 INFO:teuthology.orchestra.run.smithi099.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-19T05:19:40.209 INFO:teuthology.orchestra.run.smithi157.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-19T05:19:40.225 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-19T05:19:40.225 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-19T05:19:40.242 INFO:teuthology.orchestra.run.smithi157.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-19T05:19:40.243 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-01-19T05:19:40.243 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m0.172s 2024-01-19T05:19:40.243 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m0.652s 2024-01-19T05:19:40.243 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.048s 2024-01-19T05:19:40.281 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-19T05:19:40.282 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-19T05:19:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m0.228s 2024-01-19T05:19:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m0.871s 2024-01-19T05:19:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.088s 2024-01-19T05:19:40.282 INFO:tasks.ceph:Archiving logs... 2024-01-19T05:19:40.283 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/remote/smithi099/log 2024-01-19T05:19:40.284 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-19T05:19:40.528 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/remote/smithi157/log 2024-01-19T05:19:40.528 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-19T05:19:40.612 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-19T05:19:40.632 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-19T05:19:40.632 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-19T05:19:40.634 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-19T05:19:40.708 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-19T05:19:40.717 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-19T05:19:40.718 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T05:19:40.720 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-19T05:19:40.729 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T05:19:40.729 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-01-19T05:19:40.729 INFO:teuthology.orchestra.run.smithi099.stdout:*hv01.front.sepi 44.4.53.2 2 u 44 64 37 0.105 -2.095 1.089 2024-01-19T05:19:40.730 INFO:teuthology.orchestra.run.smithi099.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 37 0.085 -1.318 1.070 2024-01-19T05:19:40.730 INFO:teuthology.orchestra.run.smithi099.stdout:+hv03.front.sepi 74.6.168.72 3 u 42 64 37 0.133 -1.456 1.037 2024-01-19T05:19:40.730 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:19:40.733 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-01-19T05:19:40.733 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-01-19T05:19:40.733 INFO:teuthology.orchestra.run.smithi157.stdout:*hv01.front.sepi 44.4.53.2 2 u 45 64 37 0.189 -1.537 0.768 2024-01-19T05:19:40.733 INFO:teuthology.orchestra.run.smithi157.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 64 37 0.099 -0.663 0.684 2024-01-19T05:19:40.733 INFO:teuthology.orchestra.run.smithi157.stdout:+hv03.front.sepi 74.6.168.72 3 u 46 64 37 0.127 -0.909 0.712 2024-01-19T05:19:40.733 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-19T05:19:40.734 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-19T05:19:40.753 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-19T05:19:40.754 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-19T05:19:40.764 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-19T05:19:40.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-19T05:19:40.783 INFO:teuthology.task.internal:Duration was 718.628029 seconds 2024-01-19T05:19:40.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-19T05:19:40.793 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-19T05:19:40.793 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-19T05:19:40.796 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-19T05:19:40.833 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-19T05:19:40.833 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-01-19T05:19:40.833 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-19T05:19:40.884 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-01-19T05:19:40.884 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-19T05:19:40.895 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-19T05:19:40.896 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-19T05:19:40.928 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-19T05:19:40.961 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-19T05:19:40.961 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-19T05:19:40.996 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-19T05:19:41.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-19T05:19:41.069 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-19T05:19:41.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-19T05:19:41.082 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-19T05:19:41.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-19T05:19:41.103 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-19T05:19:41.128 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-19T05:19:41.137 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-01-19T05:19:41.146 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-01-19T05:19:41.159 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-19T05:19:41.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:19:41.195 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-19T05:19:41.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-19T05:19:41.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-19T05:19:41.215 INFO:teuthology.task.internal:Transferring archived files... 2024-01-19T05:19:41.215 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/remote/smithi099 2024-01-19T05:19:41.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-19T05:19:41.258 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057/remote/smithi157 2024-01-19T05:19:41.258 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-19T05:19:41.279 INFO:teuthology.task.internal:Removing archive directory... 2024-01-19T05:19:41.279 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-19T05:19:41.300 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-19T05:19:41.325 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-19T05:19:41.336 INFO:teuthology.task.internal:Not uploading archives. 2024-01-19T05:19:41.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-19T05:19:41.346 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-19T05:19:41.346 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-19T05:19:41.349 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-19T05:19:41.352 INFO:teuthology.orchestra.run.smithi099.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 19 05:19 /home/ubuntu/cephtest 2024-01-19T05:19:41.373 INFO:teuthology.orchestra.run.smithi157.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 19 05:19 /home/ubuntu/cephtest 2024-01-19T05:19:41.374 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-19T05:19:41.385 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-19T05:19:41.406 INFO:teuthology.nuke:Checking targets against current locks 2024-01-19T05:19:41.436 DEBUG:teuthology.nuke:shortname: smithi099 2024-01-19T05:19:41.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T05:19:41.461 DEBUG:teuthology.nuke:shortname: smithi157 2024-01-19T05:19:41.461 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T05:19:41.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:58:04.825793', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfiVunQDKfNx9LTfRCAwSrrm0/hhiCKt9BVOdnWdCr+m3+AQmo7Qfa4JdQ/a9ztO0tgJNRmDGbgYir37pDdL6c='} 2024-01-19T05:19:41.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521057', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 04:58:04.827183', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfUEUddYhwqVdeto7MfqW7MZKsicO6ghR9JkflmRp7mkJV8r3Tf9pxoUhFdbWyrPG3i7g65u+ME2L/1VUFxKM4='} 2024-01-19T05:19:41.514 INFO:teuthology.orchestra.console.smithi099:Power off 2024-01-19T05:19:41.514 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T05:19:41.538 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-01-19T05:19:41.538 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:19:41.555 INFO:teuthology.orchestra.console.smithi157:Power off 2024-01-19T05:19:41.555 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T05:19:41.564 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-01-19T05:19:41.579 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-01-19T05:19:41.579 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:19:41.599 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-01-19T05:19:42.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-01-19T05:19:42.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-01-19T05:19:45.566 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:19:45.600 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:19:45.677 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-01-19T05:19:45.710 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-01-19T05:19:49.680 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:19:49.711 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:19:49.790 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-01-19T05:19:49.820 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-01-19T05:19:49.892 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-01-19T05:19:53.823 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T05:19:53.934 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-01-19T05:19:54.035 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-01-19T05:19:54.139 INFO:teuthology.run:Summary data: description: fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} duration: 718.6280291080475 failure_reason: 'Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=6776adbfd8a7491c803e1ec86db72777 status: fail success: false 2024-01-19T05:19:54.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T05:19:54.217 INFO:teuthology.run:FAIL